Aug 26 23:08:40 user nova-compute[73497]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 26 23:08:42 user nova-compute[73497]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=73497) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 26 23:08:42 user nova-compute[73497]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=73497) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 26 23:08:42 user nova-compute[73497]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=73497) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 26 23:08:42 user nova-compute[73497]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:08:43 user nova-compute[73497]: INFO nova.virt.driver [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 26 23:08:43 user nova-compute[73497]: INFO nova.compute.provider_config [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] Acquiring lock "singleton_lock" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] Acquired lock "singleton_lock" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] Releasing lock "singleton_lock" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] Full set of CONF: {{(pid=73497) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] ******************************************************************************** {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] Configuration options gathered from: {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] ================================================================================ {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] allow_resize_to_same_host      = True {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] arq_binding_timeout            = 300 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] backdoor_port                  = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] backdoor_socket                = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] block_device_allocate_retries  = 300 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] block_device_allocate_retries_interval = 5 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cert                           = self.pem {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] compute_monitors               = [] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] config_dir                     = [] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] config_drive_format            = iso9660 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] config_source                  = [] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] console_host                   = user {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] control_exchange               = nova {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cpu_allocation_ratio           = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] daemon                         = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] debug                          = True {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] default_access_ip_network_name = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] default_availability_zone      = nova {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] default_ephemeral_format       = ext4 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] default_green_pool_size        = 1000 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] default_schedule_zone          = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] disk_allocation_ratio          = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] enable_new_services            = True {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] enabled_apis                   = ['osapi_compute'] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] enabled_ssl_apis               = [] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] flat_injected                  = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] force_config_drive             = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] force_raw_images               = True {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] graceful_shutdown_timeout      = 5 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] heal_instance_info_cache_interval = 60 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] host                           = user {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] instance_build_timeout         = 0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] instance_delete_interval       = 300 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] instance_format                = [instance: %(uuid)s]  {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] instance_name_template         = instance-%08x {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] instance_usage_audit           = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] instance_usage_audit_period    = month {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] internal_service_availability_zone = internal {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] key                            = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] live_migration_retry_count     = 30 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] log_config_append              = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] log_dir                        = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] log_file                       = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] log_options                    = True {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] log_rotate_interval            = 1 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] log_rotate_interval_type       = days {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] log_rotation_type              = none {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] long_rpc_timeout               = 1800 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] max_concurrent_builds          = 10 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] max_concurrent_live_migrations = 1 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] max_concurrent_snapshots       = 5 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] max_local_block_devices        = 3 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] max_logfile_count              = 30 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] max_logfile_size_mb            = 200 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] maximum_instance_delete_attempts = 5 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] metadata_listen                = 0.0.0.0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] metadata_listen_port           = 8775 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] metadata_workers               = 3 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] migrate_max_retries            = -1 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] mkisofs_cmd                    = genisoimage {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] my_ip                          = 10.0.0.210 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] network_allocate_retries       = 0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] osapi_compute_listen_port      = 8774 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] osapi_compute_unique_server_name_scope =  {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] osapi_compute_workers          = 3 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] password_length                = 12 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] periodic_enable                = True {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] periodic_fuzzy_delay           = 60 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] pointer_model                  = ps2mouse {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] preallocate_images             = none {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] publish_errors                 = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] pybasedir                      = /opt/stack/nova {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] ram_allocation_ratio           = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] rate_limit_burst               = 0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] rate_limit_except_level        = CRITICAL {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] rate_limit_interval            = 0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] reboot_timeout                 = 0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] reclaim_instance_interval      = 0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] record                         = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] reimage_timeout_per_gb         = 60 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] report_interval                = 120 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] rescue_timeout                 = 0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] reserved_host_cpus             = 0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] reserved_host_disk_mb          = 0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] reserved_host_memory_mb        = 512 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] reserved_huge_pages            = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] resize_confirm_window          = 0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] resize_fs_using_block_device   = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] resume_guests_state_on_host_boot = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] rpc_response_timeout           = 60 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] run_external_periodic_tasks    = True {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] running_deleted_instance_action = reap {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] running_deleted_instance_poll_interval = 1800 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] running_deleted_instance_timeout = 0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] scheduler_instance_sync_interval = 120 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] service_down_time              = 720 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] servicegroup_driver            = db {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] shelved_offload_time           = 0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] shelved_poll_interval          = 3600 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] shutdown_timeout               = 0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] source_is_ipv6                 = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] ssl_only                       = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] state_path                     = /opt/stack/data/nova {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] sync_power_state_interval      = 600 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] sync_power_state_pool_size     = 1000 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] syslog_log_facility            = LOG_USER {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] tempdir                        = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] timeout_nbd                    = 10 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] transport_url                  = **** {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] update_resources_interval      = 0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] use_cow_images                 = True {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] use_eventlog                   = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] use_journal                    = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] use_json                       = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] use_rootwrap_daemon            = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] use_stderr                     = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] use_syslog                     = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vcpu_pin_set                   = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vif_plugging_is_fatal          = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vif_plugging_timeout           = 0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] virt_mkfs                      = [] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] volume_usage_poll_interval     = 0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] watch_log_file                 = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] web                            = /usr/share/spice-html5 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_concurrency.disable_process_locking = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api.auth_strategy              = keystone {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api.compute_link_prefix        = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api.dhcp_domain                = novalocal {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api.enable_instance_password   = True {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api.glance_link_prefix         = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api.instance_list_per_project_cells = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api.list_records_by_skipping_down_cells = True {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api.local_metadata_per_cell    = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api.max_limit                  = 1000 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api.metadata_cache_expiration  = 15 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api.neutron_default_tenant_id  = default {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api.use_forwarded_for          = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api.use_neutron_default_nets   = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api.vendordata_dynamic_targets = [] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api.vendordata_jsonfile_path   = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cache.backend                  = dogpile.cache.memcached {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cache.backend_argument         = **** {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cache.config_prefix            = cache.oslo {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cache.dead_timeout             = 60.0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cache.debug_cache_backend      = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cache.enable_retry_client      = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cache.enable_socket_keepalive  = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cache.enabled                  = True {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cache.expiration_time          = 600 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cache.hashclient_retry_attempts = 2 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cache.memcache_dead_retry      = 300 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cache.memcache_password        =  {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cache.memcache_pool_maxsize    = 10 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cache.memcache_sasl_enabled    = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cache.memcache_username        =  {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cache.proxies                  = [] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cache.retry_attempts           = 2 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cache.retry_delay              = 0.0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cache.socket_keepalive_count   = 1 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cache.socket_keepalive_idle    = 1 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cache.socket_keepalive_interval = 1 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cache.tls_allowed_ciphers      = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cache.tls_cafile               = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cache.tls_certfile             = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cache.tls_enabled              = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cache.tls_keyfile              = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cinder.auth_section            = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cinder.auth_type               = password {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cinder.cafile                  = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cinder.certfile                = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cinder.collect_timing          = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cinder.cross_az_attach         = True {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cinder.debug                   = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cinder.endpoint_template       = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cinder.http_retries            = 3 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cinder.insecure                = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cinder.keyfile                 = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cinder.os_region_name          = RegionOne {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cinder.split_loggers           = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cinder.timeout                 = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] compute.cpu_dedicated_set      = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] compute.cpu_shared_set         = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] compute.image_type_exclude_list = [] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] compute.max_concurrent_disk_ops = 0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] compute.max_disk_devices_to_attach = -1 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] compute.resource_provider_association_refresh = 300 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] compute.shutdown_retry_interval = 10 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] conductor.workers              = 3 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] console.allowed_origins        = [] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] console.ssl_ciphers            = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] console.ssl_minimum_version    = default {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] consoleauth.token_ttl          = 600 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cyborg.cafile                  = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cyborg.certfile                = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cyborg.collect_timing          = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cyborg.connect_retries         = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cyborg.connect_retry_delay     = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cyborg.endpoint_override       = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cyborg.insecure                = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cyborg.keyfile                 = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cyborg.max_version             = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cyborg.min_version             = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cyborg.region_name             = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cyborg.service_name            = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cyborg.service_type            = accelerator {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cyborg.split_loggers           = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cyborg.status_code_retries     = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cyborg.status_code_retry_delay = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cyborg.timeout                 = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] cyborg.version                 = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] database.backend               = sqlalchemy {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] database.connection            = **** {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] database.connection_debug      = 0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] database.connection_parameters =  {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] database.connection_recycle_time = 3600 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] database.connection_trace      = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] database.db_inc_retry_interval = True {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] database.db_max_retries        = 20 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] database.db_max_retry_interval = 10 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] database.db_retry_interval     = 1 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] database.max_overflow          = 50 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] database.max_pool_size         = 5 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] database.max_retries           = 10 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] database.mysql_enable_ndb      = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] database.mysql_wsrep_sync_wait = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] database.pool_timeout          = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] database.retry_interval        = 10 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] database.slave_connection      = **** {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] database.sqlite_synchronous    = True {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api_database.backend           = sqlalchemy {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api_database.connection        = **** {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api_database.connection_debug  = 0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api_database.connection_parameters =  {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api_database.connection_recycle_time = 3600 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api_database.connection_trace  = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api_database.db_inc_retry_interval = True {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api_database.db_max_retries    = 20 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api_database.db_max_retry_interval = 10 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api_database.db_retry_interval = 1 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api_database.max_overflow      = 50 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api_database.max_pool_size     = 5 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api_database.max_retries       = 10 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api_database.mysql_enable_ndb  = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api_database.pool_timeout      = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api_database.retry_interval    = 10 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api_database.slave_connection  = **** {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] api_database.sqlite_synchronous = True {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] devices.enabled_mdev_types     = [] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] ephemeral_storage_encryption.enabled = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] glance.api_servers             = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] glance.cafile                  = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] glance.certfile                = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] glance.collect_timing          = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] glance.connect_retries         = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] glance.connect_retry_delay     = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] glance.debug                   = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] glance.default_trusted_certificate_ids = [] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] glance.enable_certificate_validation = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] glance.enable_rbd_download     = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] glance.endpoint_override       = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] glance.insecure                = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] glance.keyfile                 = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] glance.max_version             = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] glance.min_version             = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] glance.num_retries             = 3 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] glance.rbd_ceph_conf           =  {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] glance.rbd_connect_timeout     = 5 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] glance.rbd_pool                =  {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] glance.rbd_user                =  {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] glance.region_name             = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] glance.service_name            = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] glance.service_type            = image {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] glance.split_loggers           = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] glance.status_code_retries     = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] glance.status_code_retry_delay = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] glance.timeout                 = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] glance.verify_glance_signatures = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] glance.version                 = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] guestfs.debug                  = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] hyperv.config_drive_cdrom      = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] hyperv.config_drive_inject_password = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] hyperv.enable_instance_metrics_collection = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] hyperv.enable_remotefx         = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] hyperv.instances_path_share    =  {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] hyperv.iscsi_initiator_list    = [] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] hyperv.limit_cpu_features      = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] hyperv.power_state_check_timeframe = 60 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] hyperv.use_multipath_io        = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] hyperv.volume_attach_retry_count = 10 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] hyperv.vswitch_name            = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] mks.enabled                    = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] image_cache.manager_interval   = 2400 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] image_cache.precache_concurrency = 1 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] image_cache.remove_unused_base_images = True {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] image_cache.subdirectory_name  = _base {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] ironic.api_max_retries         = 60 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] ironic.api_retry_interval      = 2 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] ironic.auth_section            = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] ironic.auth_type               = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] ironic.cafile                  = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] ironic.certfile                = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] ironic.collect_timing          = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] ironic.connect_retries         = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] ironic.connect_retry_delay     = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] ironic.endpoint_override       = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] ironic.insecure                = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] ironic.keyfile                 = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] ironic.max_version             = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] ironic.min_version             = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] ironic.partition_key           = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] ironic.peer_list               = [] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] ironic.region_name             = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] ironic.serial_console_state_timeout = 10 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] ironic.service_name            = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] ironic.service_type            = baremetal {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] ironic.split_loggers           = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] ironic.status_code_retries     = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] ironic.status_code_retry_delay = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] ironic.timeout                 = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] ironic.version                 = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] key_manager.fixed_key          = **** {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] barbican.barbican_api_version  = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] barbican.barbican_endpoint     = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] barbican.barbican_endpoint_type = public {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] barbican.barbican_region_name  = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] barbican.cafile                = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] barbican.certfile              = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] barbican.collect_timing        = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] barbican.insecure              = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] barbican.keyfile               = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] barbican.number_of_retries     = 60 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] barbican.retry_delay           = 1 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] barbican.send_service_user_token = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] barbican.split_loggers         = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] barbican.timeout               = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] barbican.verify_ssl            = True {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] barbican.verify_ssl_path       = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] barbican_service_user.auth_section = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] barbican_service_user.auth_type = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] barbican_service_user.cafile   = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] barbican_service_user.certfile = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] barbican_service_user.collect_timing = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] barbican_service_user.insecure = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] barbican_service_user.keyfile  = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] barbican_service_user.split_loggers = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] barbican_service_user.timeout  = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vault.approle_role_id          = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vault.approle_secret_id        = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vault.cafile                   = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vault.certfile                 = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vault.collect_timing           = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vault.insecure                 = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vault.keyfile                  = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vault.kv_mountpoint            = secret {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vault.kv_version               = 2 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vault.namespace                = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vault.root_token_id            = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vault.split_loggers            = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vault.ssl_ca_crt_file          = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vault.timeout                  = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vault.use_ssl                  = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] keystone.cafile                = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] keystone.certfile              = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] keystone.collect_timing        = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] keystone.connect_retries       = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] keystone.connect_retry_delay   = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] keystone.endpoint_override     = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] keystone.insecure              = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] keystone.keyfile               = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] keystone.max_version           = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] keystone.min_version           = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] keystone.region_name           = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] keystone.service_name          = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] keystone.service_type          = identity {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] keystone.split_loggers         = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] keystone.status_code_retries   = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] keystone.status_code_retry_delay = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] keystone.timeout               = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] keystone.version               = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.connection_uri         =  {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.cpu_mode               = custom {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: WARNING oslo_config.cfg [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.cpu_power_governor_high = performance {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.cpu_power_governor_low = powersave {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.cpu_power_management   = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.device_detach_attempts = 8 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.device_detach_timeout  = 20 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.disk_cachemodes        = [] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.disk_prefix            = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.enabled_perf_events    = [] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.file_backed_memory     = 0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.gid_maps               = [] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.hw_disk_discard        = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.hw_machine_type        = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.images_rbd_glance_store_name =  {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.images_rbd_pool        = rbd {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.images_type            = default {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.images_volume_group    = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.inject_key             = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.inject_partition       = -2 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.inject_password        = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.iscsi_iface            = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.iser_use_multipath     = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.live_migration_bandwidth = 0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.live_migration_downtime = 500 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.live_migration_inbound_addr = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.live_migration_permit_post_copy = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.live_migration_scheme  = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.live_migration_timeout_action = abort {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.live_migration_tunnelled = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: WARNING oslo_config.cfg [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 26 23:08:43 user nova-compute[73497]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 26 23:08:43 user nova-compute[73497]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 26 23:08:43 user nova-compute[73497]: and ``live_migration_inbound_addr`` respectively.
Aug 26 23:08:43 user nova-compute[73497]: ).  Its value may be silently ignored in the future.
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.live_migration_with_native_tls = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.max_queues             = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.nfs_mount_options      = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.num_memory_encrypted_guests = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.num_pcie_ports         = 0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.pmem_namespaces        = [] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.quobyte_client_cfg     = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.rbd_secret_uuid        = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.rbd_user               = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.remote_filesystem_transport = ssh {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.rescue_image_id        = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.rescue_kernel_id       = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.rescue_ramdisk_id      = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.rx_queue_size          = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.smbfs_mount_options    =  {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.snapshot_compression   = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.snapshot_image_format  = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.sparse_logical_volumes = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.swtpm_enabled          = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.swtpm_group            = tss {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.swtpm_user             = tss {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.sysinfo_serial         = unique {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.tb_cache_size          = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.tx_queue_size          = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.uid_maps               = [] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.use_virtio_for_bridges = True {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.virt_type              = kvm {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.volume_clear           = zero {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.volume_clear_size      = 0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.volume_use_multipath   = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.vzstorage_cache_path   = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.vzstorage_mount_user   = stack {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] neutron.auth_section           = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] neutron.auth_type              = password {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] neutron.cafile                 = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] neutron.certfile               = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] neutron.collect_timing         = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] neutron.connect_retries        = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] neutron.connect_retry_delay    = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] neutron.default_floating_pool  = public {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] neutron.endpoint_override      = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] neutron.extension_sync_interval = 600 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] neutron.http_retries           = 3 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] neutron.insecure               = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] neutron.keyfile                = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] neutron.max_version            = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] neutron.min_version            = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] neutron.ovs_bridge             = br-int {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] neutron.physnets               = [] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] neutron.region_name            = RegionOne {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] neutron.service_metadata_proxy = True {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] neutron.service_name           = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] neutron.service_type           = network {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] neutron.split_loggers          = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] neutron.status_code_retries    = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] neutron.status_code_retry_delay = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] neutron.timeout                = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] neutron.version                = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] notifications.bdms_in_notifications = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] notifications.default_level    = INFO {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] notifications.notification_format = unversioned {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] notifications.notify_on_state_change = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] pci.alias                      = [] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] pci.device_spec                = [] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] pci.report_in_placement        = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] placement.auth_section         = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] placement.auth_type            = password {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] placement.cafile               = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] placement.certfile             = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] placement.collect_timing       = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] placement.connect_retries      = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] placement.connect_retry_delay  = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] placement.default_domain_id    = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] placement.default_domain_name  = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] placement.domain_id            = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] placement.domain_name          = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] placement.endpoint_override    = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] placement.insecure             = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] placement.keyfile              = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] placement.max_version          = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] placement.min_version          = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] placement.password             = **** {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] placement.project_domain_id    = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] placement.project_domain_name  = Default {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] placement.project_id           = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] placement.project_name         = service {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] placement.region_name          = RegionOne {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] placement.service_name         = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] placement.service_type         = placement {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] placement.split_loggers        = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] placement.status_code_retries  = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] placement.status_code_retry_delay = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] placement.system_scope         = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] placement.timeout              = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] placement.trust_id             = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] placement.user_domain_id       = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] placement.user_domain_name     = Default {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] placement.user_id              = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] placement.username             = placement {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] placement.version              = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] quota.cores                    = 20 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] quota.count_usage_from_placement = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] quota.injected_file_content_bytes = 10240 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] quota.injected_file_path_length = 255 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] quota.injected_files           = 5 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] quota.instances                = 10 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] quota.key_pairs                = 100 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] quota.metadata_items           = 128 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] quota.ram                      = 51200 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] quota.recheck_quota            = True {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] quota.server_group_members     = 10 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] quota.server_groups            = 10 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] rdp.enabled                    = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] scheduler.image_metadata_prefilter = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] scheduler.max_attempts         = 3 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] scheduler.max_placement_results = 1000 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] scheduler.query_placement_for_availability_zone = True {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] scheduler.query_placement_for_image_type_support = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] scheduler.workers              = 3 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] filter_scheduler.host_subset_size = 1 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] filter_scheduler.isolated_hosts = [] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] filter_scheduler.isolated_images = [] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] filter_scheduler.pci_in_placement = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] filter_scheduler.track_instance_changes = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] metrics.required               = True {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] metrics.weight_multiplier      = 1.0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] metrics.weight_setting         = [] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] serial_console.enabled         = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] serial_console.port_range      = 10000:20000 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] serial_console.serialproxy_port = 6083 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] service_user.auth_section      = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] service_user.auth_type         = password {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] service_user.cafile            = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] service_user.certfile          = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] service_user.collect_timing    = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] service_user.insecure          = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] service_user.keyfile           = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] service_user.send_service_user_token = True {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] service_user.split_loggers     = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] service_user.timeout           = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] spice.agent_enabled            = True {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] spice.enabled                  = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] spice.html5proxy_port          = 6082 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] spice.image_compression        = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] spice.jpeg_compression         = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] spice.playback_compression     = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] spice.server_listen            = 127.0.0.1 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] spice.streaming_mode           = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] spice.zlib_compression         = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] upgrade_levels.baseapi         = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] upgrade_levels.cert            = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] upgrade_levels.compute         = auto {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] upgrade_levels.conductor       = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] upgrade_levels.scheduler       = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vendordata_dynamic_auth.auth_section = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vendordata_dynamic_auth.auth_type = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vendordata_dynamic_auth.cafile = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vendordata_dynamic_auth.certfile = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vendordata_dynamic_auth.insecure = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vendordata_dynamic_auth.keyfile = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vendordata_dynamic_auth.timeout = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vmware.api_retry_count         = 10 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vmware.ca_file                 = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vmware.cache_prefix            = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vmware.cluster_name            = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vmware.connection_pool_size    = 10 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vmware.console_delay_seconds   = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vmware.datastore_regex         = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vmware.host_ip                 = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vmware.host_password           = **** {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vmware.host_port               = 443 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vmware.host_username           = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vmware.insecure                = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vmware.integration_bridge      = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vmware.maximum_objects         = 100 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vmware.pbm_default_policy      = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vmware.pbm_enabled             = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vmware.pbm_wsdl_location       = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vmware.serial_port_proxy_uri   = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vmware.serial_port_service_uri = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vmware.task_poll_interval      = 0.5 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vmware.use_linked_clone        = True {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vmware.vnc_keymap              = en-us {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vmware.vnc_port                = 5900 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vmware.vnc_port_total          = 10000 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vnc.auth_schemes               = ['none'] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vnc.enabled                    = True {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vnc.novncproxy_port            = 6080 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vnc.server_listen              = 0.0.0.0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vnc.vencrypt_ca_certs          = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vnc.vencrypt_client_cert       = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vnc.vencrypt_client_key        = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] workarounds.disable_rootwrap   = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] workarounds.enable_numa_live_migration = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] workarounds.libvirt_disable_apic = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] wsgi.client_socket_timeout     = 900 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] wsgi.default_pool_size         = 1000 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] wsgi.keep_alive                = True {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] wsgi.max_header_line           = 16384 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] wsgi.ssl_ca_file               = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] wsgi.ssl_cert_file             = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] wsgi.ssl_key_file              = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] wsgi.tcp_keepidle              = 600 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] zvm.ca_file                    = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] zvm.cloud_connector_url        = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] zvm.reachable_timeout          = 300 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_policy.enforce_new_defaults = True {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_policy.enforce_scope      = True {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_policy.policy_default_rule = default {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_policy.policy_file        = policy.yaml {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] profiler.connection_string     = messaging:// {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] profiler.enabled               = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] profiler.es_doc_type           = notification {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] profiler.es_scroll_size        = 10000 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] profiler.es_scroll_time        = 2m {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] profiler.filter_error_trace    = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] profiler.hmac_keys             = **** {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] profiler.sentinel_service_name = mymaster {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] profiler.socket_timeout        = 0.1 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] profiler.trace_requests        = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] profiler.trace_sqlalchemy      = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] profiler_jaeger.process_tags   = {} {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] profiler_jaeger.service_name_prefix = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] profiler_otlp.service_name_prefix = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] remote_debug.host              = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] remote_debug.port              = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_rabbit.ssl      = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_notifications.retry = -1 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_limit.auth_section        = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_limit.auth_type           = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_limit.cafile              = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_limit.certfile            = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_limit.collect_timing      = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_limit.connect_retries     = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_limit.connect_retry_delay = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_limit.endpoint_id         = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_limit.endpoint_override   = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_limit.insecure            = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_limit.keyfile             = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_limit.max_version         = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_limit.min_version         = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_limit.region_name         = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_limit.service_name        = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_limit.service_type        = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_limit.split_loggers       = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_limit.status_code_retries = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_limit.status_code_retry_delay = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_limit.timeout             = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_limit.valid_interfaces    = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_limit.version             = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_reports.file_event_handler = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] oslo_reports.log_dir           = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vif_plug_ovs_privileged.group  = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] vif_plug_ovs_privileged.user   = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] os_vif_linux_bridge.flat_interface = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] os_vif_ovs.isolate_vif         = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] os_vif_ovs.per_port_bridge     = False {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] os_brick.lock_path             = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] privsep_osbrick.capabilities   = [21] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] privsep_osbrick.group          = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] privsep_osbrick.helper_command = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] privsep_osbrick.user           = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] nova_sys_admin.group           = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] nova_sys_admin.helper_command  = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] nova_sys_admin.user            = None {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG oslo_service.service [None req-a273bfeb-8890-401a-aa50-35567cd10f63 None None] ******************************************************************************** {{(pid=73497) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 26 23:08:43 user nova-compute[73497]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 26 23:08:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Starting native event thread {{(pid=73497) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Starting green dispatch thread {{(pid=73497) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Starting connection event dispatch thread {{(pid=73497) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Connecting to libvirt: qemu:///system {{(pid=73497) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f28358fe7d0> {{(pid=73497) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Aug 26 23:08:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f28358fe7d0> {{(pid=73497) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Aug 26 23:08:43 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Connection event '1' reason 'None'
Aug 26 23:08:43 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 26 23:08:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.mount [None req-637e650d-452d-4192-8976-09f50273a439 None None] Initialising _HostMountState generation 0 {{(pid=73497) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 26 23:08:51 user nova-compute[73497]: INFO nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Libvirt host capabilities <capabilities>
Aug 26 23:08:51 user nova-compute[73497]:   <host>
Aug 26 23:08:51 user nova-compute[73497]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 26 23:08:51 user nova-compute[73497]:     <cpu>
Aug 26 23:08:51 user nova-compute[73497]:       <arch>x86_64</arch>
Aug 26 23:08:51 user nova-compute[73497]:       <model>IvyBridge-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <vendor>Intel</vendor>
Aug 26 23:08:51 user nova-compute[73497]:       <microcode version='1070'/>
Aug 26 23:08:51 user nova-compute[73497]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 26 23:08:51 user nova-compute[73497]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature name='ss'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature name='vmx'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature name='pcid'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature name='osxsave'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature name='hypervisor'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature name='arat'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature name='tsc_adjust'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature name='md-clear'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature name='stibp'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature name='arch-capabilities'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature name='ssbd'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature name='invtsc'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature name='rsba'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature name='skip-l1dfl-vmentry'/>
Aug 26 23:08:51 user nova-compute[73497]:       <pages unit='KiB' size='4'/>
Aug 26 23:08:51 user nova-compute[73497]:       <pages unit='KiB' size='2048'/>
Aug 26 23:08:51 user nova-compute[73497]:     </cpu>
Aug 26 23:08:51 user nova-compute[73497]:     <power_management>
Aug 26 23:08:51 user nova-compute[73497]:       <suspend_mem/>
Aug 26 23:08:51 user nova-compute[73497]:       <suspend_disk/>
Aug 26 23:08:51 user nova-compute[73497]:       <suspend_hybrid/>
Aug 26 23:08:51 user nova-compute[73497]:     </power_management>
Aug 26 23:08:51 user nova-compute[73497]:     <iommu support='no'/>
Aug 26 23:08:51 user nova-compute[73497]:     <migration_features>
Aug 26 23:08:51 user nova-compute[73497]:       <live/>
Aug 26 23:08:51 user nova-compute[73497]:       <uri_transports>
Aug 26 23:08:51 user nova-compute[73497]:         <uri_transport>tcp</uri_transport>
Aug 26 23:08:51 user nova-compute[73497]:         <uri_transport>rdma</uri_transport>
Aug 26 23:08:51 user nova-compute[73497]:       </uri_transports>
Aug 26 23:08:51 user nova-compute[73497]:     </migration_features>
Aug 26 23:08:51 user nova-compute[73497]:     <topology>
Aug 26 23:08:51 user nova-compute[73497]:       <cells num='2'>
Aug 26 23:08:51 user nova-compute[73497]:         <cell id='0'>
Aug 26 23:08:51 user nova-compute[73497]:           <memory unit='KiB'>8189224</memory>
Aug 26 23:08:51 user nova-compute[73497]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 26 23:08:51 user nova-compute[73497]:           <pages unit='KiB' size='2048'>0</pages>
Aug 26 23:08:51 user nova-compute[73497]:           <distances>
Aug 26 23:08:51 user nova-compute[73497]:             <sibling id='0' value='10'/>
Aug 26 23:08:51 user nova-compute[73497]:             <sibling id='1' value='20'/>
Aug 26 23:08:51 user nova-compute[73497]:           </distances>
Aug 26 23:08:51 user nova-compute[73497]:           <cpus num='6'>
Aug 26 23:08:51 user nova-compute[73497]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 26 23:08:51 user nova-compute[73497]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 26 23:08:51 user nova-compute[73497]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 26 23:08:51 user nova-compute[73497]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 26 23:08:51 user nova-compute[73497]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 26 23:08:51 user nova-compute[73497]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 26 23:08:51 user nova-compute[73497]:           </cpus>
Aug 26 23:08:51 user nova-compute[73497]:         </cell>
Aug 26 23:08:51 user nova-compute[73497]:         <cell id='1'>
Aug 26 23:08:51 user nova-compute[73497]:           <memory unit='KiB'>8206460</memory>
Aug 26 23:08:51 user nova-compute[73497]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 26 23:08:51 user nova-compute[73497]:           <pages unit='KiB' size='2048'>0</pages>
Aug 26 23:08:51 user nova-compute[73497]:           <distances>
Aug 26 23:08:51 user nova-compute[73497]:             <sibling id='0' value='20'/>
Aug 26 23:08:51 user nova-compute[73497]:             <sibling id='1' value='10'/>
Aug 26 23:08:51 user nova-compute[73497]:           </distances>
Aug 26 23:08:51 user nova-compute[73497]:           <cpus num='6'>
Aug 26 23:08:51 user nova-compute[73497]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 26 23:08:51 user nova-compute[73497]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 26 23:08:51 user nova-compute[73497]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 26 23:08:51 user nova-compute[73497]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 26 23:08:51 user nova-compute[73497]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 26 23:08:51 user nova-compute[73497]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 26 23:08:51 user nova-compute[73497]:           </cpus>
Aug 26 23:08:51 user nova-compute[73497]:         </cell>
Aug 26 23:08:51 user nova-compute[73497]:       </cells>
Aug 26 23:08:51 user nova-compute[73497]:     </topology>
Aug 26 23:08:51 user nova-compute[73497]:     <cache>
Aug 26 23:08:51 user nova-compute[73497]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 26 23:08:51 user nova-compute[73497]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 26 23:08:51 user nova-compute[73497]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 26 23:08:51 user nova-compute[73497]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 26 23:08:51 user nova-compute[73497]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 26 23:08:51 user nova-compute[73497]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 26 23:08:51 user nova-compute[73497]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 26 23:08:51 user nova-compute[73497]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 26 23:08:51 user nova-compute[73497]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 26 23:08:51 user nova-compute[73497]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 26 23:08:51 user nova-compute[73497]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 26 23:08:51 user nova-compute[73497]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 26 23:08:51 user nova-compute[73497]:     </cache>
Aug 26 23:08:51 user nova-compute[73497]:     <secmodel>
Aug 26 23:08:51 user nova-compute[73497]:       <model>apparmor</model>
Aug 26 23:08:51 user nova-compute[73497]:       <doi>0</doi>
Aug 26 23:08:51 user nova-compute[73497]:     </secmodel>
Aug 26 23:08:51 user nova-compute[73497]:     <secmodel>
Aug 26 23:08:51 user nova-compute[73497]:       <model>dac</model>
Aug 26 23:08:51 user nova-compute[73497]:       <doi>0</doi>
Aug 26 23:08:51 user nova-compute[73497]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 26 23:08:51 user nova-compute[73497]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 26 23:08:51 user nova-compute[73497]:     </secmodel>
Aug 26 23:08:51 user nova-compute[73497]:   </host>
Aug 26 23:08:51 user nova-compute[73497]:   <guest>
Aug 26 23:08:51 user nova-compute[73497]:     <os_type>hvm</os_type>
Aug 26 23:08:51 user nova-compute[73497]:     <arch name='alpha'>
Aug 26 23:08:51 user nova-compute[73497]:       <wordsize>64</wordsize>
Aug 26 23:08:51 user nova-compute[73497]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='4'>clipper</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <domain type='qemu'/>
Aug 26 23:08:51 user nova-compute[73497]:     </arch>
Aug 26 23:08:51 user nova-compute[73497]:     <features>
Aug 26 23:08:51 user nova-compute[73497]:       <cpuselection/>
Aug 26 23:08:51 user nova-compute[73497]:       <deviceboot/>
Aug 26 23:08:51 user nova-compute[73497]:       <disksnapshot default='on' toggle='no'/>
Aug 26 23:08:51 user nova-compute[73497]:     </features>
Aug 26 23:08:51 user nova-compute[73497]:   </guest>
Aug 26 23:08:51 user nova-compute[73497]:   <guest>
Aug 26 23:08:51 user nova-compute[73497]:     <os_type>hvm</os_type>
Aug 26 23:08:51 user nova-compute[73497]:     <arch name='armv6l'>
Aug 26 23:08:51 user nova-compute[73497]:       <wordsize>32</wordsize>
Aug 26 23:08:51 user nova-compute[73497]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>integratorcp</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>borzoi</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>spitz</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>nuri</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>musca-b1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>versatileab</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>kzm</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>musca-a</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>smdkc210</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>sx1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>z2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>tosa</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='4'>sabrelite</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>realview-eb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>n810</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>n800</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>versatilepb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>terrier</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>mainstone</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='4'>midway</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>musicpal</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>microbit</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>cubieboard</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>verdex</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>netduino2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='4'>raspi2b</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>cheetah</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='4'>highbank</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>akita</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>connex</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>collie</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>raspi0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <domain type='qemu'/>
Aug 26 23:08:51 user nova-compute[73497]:     </arch>
Aug 26 23:08:51 user nova-compute[73497]:     <features>
Aug 26 23:08:51 user nova-compute[73497]:       <cpuselection/>
Aug 26 23:08:51 user nova-compute[73497]:       <deviceboot/>
Aug 26 23:08:51 user nova-compute[73497]:       <disksnapshot default='on' toggle='no'/>
Aug 26 23:08:51 user nova-compute[73497]:     </features>
Aug 26 23:08:51 user nova-compute[73497]:   </guest>
Aug 26 23:08:51 user nova-compute[73497]:   <guest>
Aug 26 23:08:51 user nova-compute[73497]:     <os_type>hvm</os_type>
Aug 26 23:08:51 user nova-compute[73497]:     <arch name='armv7l'>
Aug 26 23:08:51 user nova-compute[73497]:       <wordsize>32</wordsize>
Aug 26 23:08:51 user nova-compute[73497]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>integratorcp</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>borzoi</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>spitz</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>nuri</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>musca-b1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>versatileab</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>kzm</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>musca-a</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>smdkc210</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>sx1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>z2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>tosa</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='4'>sabrelite</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>realview-eb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>n810</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>n800</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>versatilepb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>terrier</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>mainstone</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='4'>midway</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>musicpal</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>microbit</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>cubieboard</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>verdex</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>netduino2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='4'>raspi2b</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>cheetah</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='4'>highbank</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>akita</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>connex</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>collie</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>raspi0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <domain type='qemu'/>
Aug 26 23:08:51 user nova-compute[73497]:     </arch>
Aug 26 23:08:51 user nova-compute[73497]:     <features>
Aug 26 23:08:51 user nova-compute[73497]:       <cpuselection/>
Aug 26 23:08:51 user nova-compute[73497]:       <deviceboot/>
Aug 26 23:08:51 user nova-compute[73497]:       <disksnapshot default='on' toggle='no'/>
Aug 26 23:08:51 user nova-compute[73497]:     </features>
Aug 26 23:08:51 user nova-compute[73497]:   </guest>
Aug 26 23:08:51 user nova-compute[73497]:   <guest>
Aug 26 23:08:51 user nova-compute[73497]:     <os_type>hvm</os_type>
Aug 26 23:08:51 user nova-compute[73497]:     <arch name='aarch64'>
Aug 26 23:08:51 user nova-compute[73497]:       <wordsize>64</wordsize>
Aug 26 23:08:51 user nova-compute[73497]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>integratorcp</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>borzoi</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>spitz</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>nuri</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>musca-b1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>versatileab</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>kzm</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>musca-a</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>smdkc210</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>sx1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>z2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>tosa</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='4'>sabrelite</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>realview-eb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>n810</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>n800</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>versatilepb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>terrier</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>mainstone</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='4'>midway</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>musicpal</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>microbit</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>cubieboard</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>verdex</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>netduino2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='4'>raspi3b</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='4'>raspi2b</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>cheetah</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='4'>highbank</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>akita</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>connex</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>collie</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>raspi0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <domain type='qemu'/>
Aug 26 23:08:51 user nova-compute[73497]:     </arch>
Aug 26 23:08:51 user nova-compute[73497]:     <features>
Aug 26 23:08:51 user nova-compute[73497]:       <acpi default='on' toggle='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:       <cpuselection/>
Aug 26 23:08:51 user nova-compute[73497]:       <deviceboot/>
Aug 26 23:08:51 user nova-compute[73497]:       <disksnapshot default='on' toggle='no'/>
Aug 26 23:08:51 user nova-compute[73497]:     </features>
Aug 26 23:08:51 user nova-compute[73497]:   </guest>
Aug 26 23:08:51 user nova-compute[73497]:   <guest>
Aug 26 23:08:51 user nova-compute[73497]:     <os_type>hvm</os_type>
Aug 26 23:08:51 user nova-compute[73497]:     <arch name='cris'>
Aug 26 23:08:51 user nova-compute[73497]:       <wordsize>32</wordsize>
Aug 26 23:08:51 user nova-compute[73497]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <domain type='qemu'/>
Aug 26 23:08:51 user nova-compute[73497]:     </arch>
Aug 26 23:08:51 user nova-compute[73497]:     <features>
Aug 26 23:08:51 user nova-compute[73497]:       <cpuselection/>
Aug 26 23:08:51 user nova-compute[73497]:       <deviceboot/>
Aug 26 23:08:51 user nova-compute[73497]:       <disksnapshot default='on' toggle='no'/>
Aug 26 23:08:51 user nova-compute[73497]:     </features>
Aug 26 23:08:51 user nova-compute[73497]:   </guest>
Aug 26 23:08:51 user nova-compute[73497]:   <guest>
Aug 26 23:08:51 user nova-compute[73497]:     <os_type>hvm</os_type>
Aug 26 23:08:51 user nova-compute[73497]:     <arch name='i686'>
Aug 26 23:08:51 user nova-compute[73497]:       <wordsize>32</wordsize>
Aug 26 23:08:51 user nova-compute[73497]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>x-remote</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>isapc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>microvm</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <domain type='qemu'/>
Aug 26 23:08:51 user nova-compute[73497]:       <domain type='kvm'/>
Aug 26 23:08:51 user nova-compute[73497]:     </arch>
Aug 26 23:08:51 user nova-compute[73497]:     <features>
Aug 26 23:08:51 user nova-compute[73497]:       <pae/>
Aug 26 23:08:51 user nova-compute[73497]:       <nonpae/>
Aug 26 23:08:51 user nova-compute[73497]:       <acpi default='on' toggle='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:       <apic default='on' toggle='no'/>
Aug 26 23:08:51 user nova-compute[73497]:       <cpuselection/>
Aug 26 23:08:51 user nova-compute[73497]:       <deviceboot/>
Aug 26 23:08:51 user nova-compute[73497]:       <disksnapshot default='on' toggle='no'/>
Aug 26 23:08:51 user nova-compute[73497]:     </features>
Aug 26 23:08:51 user nova-compute[73497]:   </guest>
Aug 26 23:08:51 user nova-compute[73497]:   <guest>
Aug 26 23:08:51 user nova-compute[73497]:     <os_type>hvm</os_type>
Aug 26 23:08:51 user nova-compute[73497]:     <arch name='m68k'>
Aug 26 23:08:51 user nova-compute[73497]:       <wordsize>32</wordsize>
Aug 26 23:08:51 user nova-compute[73497]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>an5206</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>q800</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>next-cube</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <domain type='qemu'/>
Aug 26 23:08:51 user nova-compute[73497]:     </arch>
Aug 26 23:08:51 user nova-compute[73497]:     <features>
Aug 26 23:08:51 user nova-compute[73497]:       <cpuselection/>
Aug 26 23:08:51 user nova-compute[73497]:       <deviceboot/>
Aug 26 23:08:51 user nova-compute[73497]:       <disksnapshot default='on' toggle='no'/>
Aug 26 23:08:51 user nova-compute[73497]:     </features>
Aug 26 23:08:51 user nova-compute[73497]:   </guest>
Aug 26 23:08:51 user nova-compute[73497]:   <guest>
Aug 26 23:08:51 user nova-compute[73497]:     <os_type>hvm</os_type>
Aug 26 23:08:51 user nova-compute[73497]:     <arch name='microblaze'>
Aug 26 23:08:51 user nova-compute[73497]:       <wordsize>32</wordsize>
Aug 26 23:08:51 user nova-compute[73497]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <domain type='qemu'/>
Aug 26 23:08:51 user nova-compute[73497]:     </arch>
Aug 26 23:08:51 user nova-compute[73497]:     <features>
Aug 26 23:08:51 user nova-compute[73497]:       <cpuselection/>
Aug 26 23:08:51 user nova-compute[73497]:       <deviceboot/>
Aug 26 23:08:51 user nova-compute[73497]:       <disksnapshot default='on' toggle='no'/>
Aug 26 23:08:51 user nova-compute[73497]:     </features>
Aug 26 23:08:51 user nova-compute[73497]:   </guest>
Aug 26 23:08:51 user nova-compute[73497]:   <guest>
Aug 26 23:08:51 user nova-compute[73497]:     <os_type>hvm</os_type>
Aug 26 23:08:51 user nova-compute[73497]:     <arch name='microblazeel'>
Aug 26 23:08:51 user nova-compute[73497]:       <wordsize>32</wordsize>
Aug 26 23:08:51 user nova-compute[73497]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <domain type='qemu'/>
Aug 26 23:08:51 user nova-compute[73497]:     </arch>
Aug 26 23:08:51 user nova-compute[73497]:     <features>
Aug 26 23:08:51 user nova-compute[73497]:       <cpuselection/>
Aug 26 23:08:51 user nova-compute[73497]:       <deviceboot/>
Aug 26 23:08:51 user nova-compute[73497]:       <disksnapshot default='on' toggle='no'/>
Aug 26 23:08:51 user nova-compute[73497]:     </features>
Aug 26 23:08:51 user nova-compute[73497]:   </guest>
Aug 26 23:08:51 user nova-compute[73497]:   <guest>
Aug 26 23:08:51 user nova-compute[73497]:     <os_type>hvm</os_type>
Aug 26 23:08:51 user nova-compute[73497]:     <arch name='mips'>
Aug 26 23:08:51 user nova-compute[73497]:       <wordsize>32</wordsize>
Aug 26 23:08:51 user nova-compute[73497]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='16'>malta</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <domain type='qemu'/>
Aug 26 23:08:51 user nova-compute[73497]:     </arch>
Aug 26 23:08:51 user nova-compute[73497]:     <features>
Aug 26 23:08:51 user nova-compute[73497]:       <cpuselection/>
Aug 26 23:08:51 user nova-compute[73497]:       <deviceboot/>
Aug 26 23:08:51 user nova-compute[73497]:       <disksnapshot default='on' toggle='no'/>
Aug 26 23:08:51 user nova-compute[73497]:     </features>
Aug 26 23:08:51 user nova-compute[73497]:   </guest>
Aug 26 23:08:51 user nova-compute[73497]:   <guest>
Aug 26 23:08:51 user nova-compute[73497]:     <os_type>hvm</os_type>
Aug 26 23:08:51 user nova-compute[73497]:     <arch name='mipsel'>
Aug 26 23:08:51 user nova-compute[73497]:       <wordsize>32</wordsize>
Aug 26 23:08:51 user nova-compute[73497]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='16'>malta</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <domain type='qemu'/>
Aug 26 23:08:51 user nova-compute[73497]:     </arch>
Aug 26 23:08:51 user nova-compute[73497]:     <features>
Aug 26 23:08:51 user nova-compute[73497]:       <cpuselection/>
Aug 26 23:08:51 user nova-compute[73497]:       <deviceboot/>
Aug 26 23:08:51 user nova-compute[73497]:       <disksnapshot default='on' toggle='no'/>
Aug 26 23:08:51 user nova-compute[73497]:     </features>
Aug 26 23:08:51 user nova-compute[73497]:   </guest>
Aug 26 23:08:51 user nova-compute[73497]:   <guest>
Aug 26 23:08:51 user nova-compute[73497]:     <os_type>hvm</os_type>
Aug 26 23:08:51 user nova-compute[73497]:     <arch name='mips64'>
Aug 26 23:08:51 user nova-compute[73497]:       <wordsize>64</wordsize>
Aug 26 23:08:51 user nova-compute[73497]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='16'>malta</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>pica61</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>magnum</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <domain type='qemu'/>
Aug 26 23:08:51 user nova-compute[73497]:     </arch>
Aug 26 23:08:51 user nova-compute[73497]:     <features>
Aug 26 23:08:51 user nova-compute[73497]:       <cpuselection/>
Aug 26 23:08:51 user nova-compute[73497]:       <deviceboot/>
Aug 26 23:08:51 user nova-compute[73497]:       <disksnapshot default='on' toggle='no'/>
Aug 26 23:08:51 user nova-compute[73497]:     </features>
Aug 26 23:08:51 user nova-compute[73497]:   </guest>
Aug 26 23:08:51 user nova-compute[73497]:   <guest>
Aug 26 23:08:51 user nova-compute[73497]:     <os_type>hvm</os_type>
Aug 26 23:08:51 user nova-compute[73497]:     <arch name='mips64el'>
Aug 26 23:08:51 user nova-compute[73497]:       <wordsize>64</wordsize>
Aug 26 23:08:51 user nova-compute[73497]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='16'>malta</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>pica61</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>magnum</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='16'>boston</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <domain type='qemu'/>
Aug 26 23:08:51 user nova-compute[73497]:     </arch>
Aug 26 23:08:51 user nova-compute[73497]:     <features>
Aug 26 23:08:51 user nova-compute[73497]:       <cpuselection/>
Aug 26 23:08:51 user nova-compute[73497]:       <deviceboot/>
Aug 26 23:08:51 user nova-compute[73497]:       <disksnapshot default='on' toggle='no'/>
Aug 26 23:08:51 user nova-compute[73497]:     </features>
Aug 26 23:08:51 user nova-compute[73497]:   </guest>
Aug 26 23:08:51 user nova-compute[73497]:   <guest>
Aug 26 23:08:51 user nova-compute[73497]:     <os_type>hvm</os_type>
Aug 26 23:08:51 user nova-compute[73497]:     <arch name='ppc'>
Aug 26 23:08:51 user nova-compute[73497]:       <wordsize>32</wordsize>
Aug 26 23:08:51 user nova-compute[73497]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>g3beige</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>mac99</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='32'>ppce500</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>pegasos2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>sam460ex</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>bamboo</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>40p</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>ref405ep</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>taihu</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <domain type='qemu'/>
Aug 26 23:08:51 user nova-compute[73497]:     </arch>
Aug 26 23:08:51 user nova-compute[73497]:     <features>
Aug 26 23:08:51 user nova-compute[73497]:       <cpuselection/>
Aug 26 23:08:51 user nova-compute[73497]:       <deviceboot/>
Aug 26 23:08:51 user nova-compute[73497]:       <disksnapshot default='on' toggle='no'/>
Aug 26 23:08:51 user nova-compute[73497]:     </features>
Aug 26 23:08:51 user nova-compute[73497]:   </guest>
Aug 26 23:08:51 user nova-compute[73497]:   <guest>
Aug 26 23:08:51 user nova-compute[73497]:     <os_type>hvm</os_type>
Aug 26 23:08:51 user nova-compute[73497]:     <arch name='ppc64'>
Aug 26 23:08:51 user nova-compute[73497]:       <wordsize>64</wordsize>
Aug 26 23:08:51 user nova-compute[73497]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2048'>powernv9</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>taihu</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2048'>powernv10</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='32'>ppce500</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>40p</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>pegasos2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>bamboo</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>g3beige</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>mac99</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>sam460ex</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>ref405ep</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2048'>powernv8</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <domain type='qemu'/>
Aug 26 23:08:51 user nova-compute[73497]:     </arch>
Aug 26 23:08:51 user nova-compute[73497]:     <features>
Aug 26 23:08:51 user nova-compute[73497]:       <cpuselection/>
Aug 26 23:08:51 user nova-compute[73497]:       <deviceboot/>
Aug 26 23:08:51 user nova-compute[73497]:       <disksnapshot default='on' toggle='no'/>
Aug 26 23:08:51 user nova-compute[73497]:     </features>
Aug 26 23:08:51 user nova-compute[73497]:   </guest>
Aug 26 23:08:51 user nova-compute[73497]:   <guest>
Aug 26 23:08:51 user nova-compute[73497]:     <os_type>hvm</os_type>
Aug 26 23:08:51 user nova-compute[73497]:     <arch name='ppc64le'>
Aug 26 23:08:51 user nova-compute[73497]:       <wordsize>64</wordsize>
Aug 26 23:08:51 user nova-compute[73497]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2048'>powernv9</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>taihu</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2048'>powernv10</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='32'>ppce500</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>40p</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>pegasos2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>bamboo</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>g3beige</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>mac99</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>sam460ex</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>ref405ep</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2048'>powernv8</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <domain type='qemu'/>
Aug 26 23:08:51 user nova-compute[73497]:     </arch>
Aug 26 23:08:51 user nova-compute[73497]:     <features>
Aug 26 23:08:51 user nova-compute[73497]:       <cpuselection/>
Aug 26 23:08:51 user nova-compute[73497]:       <deviceboot/>
Aug 26 23:08:51 user nova-compute[73497]:       <disksnapshot default='on' toggle='no'/>
Aug 26 23:08:51 user nova-compute[73497]:     </features>
Aug 26 23:08:51 user nova-compute[73497]:   </guest>
Aug 26 23:08:51 user nova-compute[73497]:   <guest>
Aug 26 23:08:51 user nova-compute[73497]:     <os_type>hvm</os_type>
Aug 26 23:08:51 user nova-compute[73497]:     <arch name='riscv32'>
Aug 26 23:08:51 user nova-compute[73497]:       <wordsize>32</wordsize>
Aug 26 23:08:51 user nova-compute[73497]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='8'>spike</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>opentitan</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='5'>sifive_u</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>sifive_e</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='8'>virt</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <domain type='qemu'/>
Aug 26 23:08:51 user nova-compute[73497]:     </arch>
Aug 26 23:08:51 user nova-compute[73497]:     <features>
Aug 26 23:08:51 user nova-compute[73497]:       <cpuselection/>
Aug 26 23:08:51 user nova-compute[73497]:       <deviceboot/>
Aug 26 23:08:51 user nova-compute[73497]:       <disksnapshot default='on' toggle='no'/>
Aug 26 23:08:51 user nova-compute[73497]:     </features>
Aug 26 23:08:51 user nova-compute[73497]:   </guest>
Aug 26 23:08:51 user nova-compute[73497]:   <guest>
Aug 26 23:08:51 user nova-compute[73497]:     <os_type>hvm</os_type>
Aug 26 23:08:51 user nova-compute[73497]:     <arch name='riscv64'>
Aug 26 23:08:51 user nova-compute[73497]:       <wordsize>64</wordsize>
Aug 26 23:08:51 user nova-compute[73497]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='8'>spike</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='5'>sifive_u</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>shakti_c</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>sifive_e</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='8'>virt</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <domain type='qemu'/>
Aug 26 23:08:51 user nova-compute[73497]:     </arch>
Aug 26 23:08:51 user nova-compute[73497]:     <features>
Aug 26 23:08:51 user nova-compute[73497]:       <cpuselection/>
Aug 26 23:08:51 user nova-compute[73497]:       <deviceboot/>
Aug 26 23:08:51 user nova-compute[73497]:       <disksnapshot default='on' toggle='no'/>
Aug 26 23:08:51 user nova-compute[73497]:     </features>
Aug 26 23:08:51 user nova-compute[73497]:   </guest>
Aug 26 23:08:51 user nova-compute[73497]:   <guest>
Aug 26 23:08:51 user nova-compute[73497]:     <os_type>hvm</os_type>
Aug 26 23:08:51 user nova-compute[73497]:     <arch name='s390x'>
Aug 26 23:08:51 user nova-compute[73497]:       <wordsize>64</wordsize>
Aug 26 23:08:51 user nova-compute[73497]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <domain type='qemu'/>
Aug 26 23:08:51 user nova-compute[73497]:     </arch>
Aug 26 23:08:51 user nova-compute[73497]:     <features>
Aug 26 23:08:51 user nova-compute[73497]:       <cpuselection/>
Aug 26 23:08:51 user nova-compute[73497]:       <deviceboot/>
Aug 26 23:08:51 user nova-compute[73497]:       <disksnapshot default='on' toggle='no'/>
Aug 26 23:08:51 user nova-compute[73497]:     </features>
Aug 26 23:08:51 user nova-compute[73497]:   </guest>
Aug 26 23:08:51 user nova-compute[73497]:   <guest>
Aug 26 23:08:51 user nova-compute[73497]:     <os_type>hvm</os_type>
Aug 26 23:08:51 user nova-compute[73497]:     <arch name='sh4'>
Aug 26 23:08:51 user nova-compute[73497]:       <wordsize>32</wordsize>
Aug 26 23:08:51 user nova-compute[73497]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>shix</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>r2d</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <domain type='qemu'/>
Aug 26 23:08:51 user nova-compute[73497]:     </arch>
Aug 26 23:08:51 user nova-compute[73497]:     <features>
Aug 26 23:08:51 user nova-compute[73497]:       <cpuselection/>
Aug 26 23:08:51 user nova-compute[73497]:       <deviceboot/>
Aug 26 23:08:51 user nova-compute[73497]:       <disksnapshot default='on' toggle='no'/>
Aug 26 23:08:51 user nova-compute[73497]:     </features>
Aug 26 23:08:51 user nova-compute[73497]:   </guest>
Aug 26 23:08:51 user nova-compute[73497]:   <guest>
Aug 26 23:08:51 user nova-compute[73497]:     <os_type>hvm</os_type>
Aug 26 23:08:51 user nova-compute[73497]:     <arch name='sh4eb'>
Aug 26 23:08:51 user nova-compute[73497]:       <wordsize>64</wordsize>
Aug 26 23:08:51 user nova-compute[73497]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>shix</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>r2d</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <domain type='qemu'/>
Aug 26 23:08:51 user nova-compute[73497]:     </arch>
Aug 26 23:08:51 user nova-compute[73497]:     <features>
Aug 26 23:08:51 user nova-compute[73497]:       <cpuselection/>
Aug 26 23:08:51 user nova-compute[73497]:       <deviceboot/>
Aug 26 23:08:51 user nova-compute[73497]:       <disksnapshot default='on' toggle='no'/>
Aug 26 23:08:51 user nova-compute[73497]:     </features>
Aug 26 23:08:51 user nova-compute[73497]:   </guest>
Aug 26 23:08:51 user nova-compute[73497]:   <guest>
Aug 26 23:08:51 user nova-compute[73497]:     <os_type>hvm</os_type>
Aug 26 23:08:51 user nova-compute[73497]:     <arch name='sparc'>
Aug 26 23:08:51 user nova-compute[73497]:       <wordsize>32</wordsize>
Aug 26 23:08:51 user nova-compute[73497]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>SS-5</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='4'>SS-20</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>LX</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>SS-4</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='4'>SS-10</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>Voyager</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <domain type='qemu'/>
Aug 26 23:08:51 user nova-compute[73497]:     </arch>
Aug 26 23:08:51 user nova-compute[73497]:     <features>
Aug 26 23:08:51 user nova-compute[73497]:       <cpuselection/>
Aug 26 23:08:51 user nova-compute[73497]:       <deviceboot/>
Aug 26 23:08:51 user nova-compute[73497]:       <disksnapshot default='on' toggle='no'/>
Aug 26 23:08:51 user nova-compute[73497]:     </features>
Aug 26 23:08:51 user nova-compute[73497]:   </guest>
Aug 26 23:08:51 user nova-compute[73497]:   <guest>
Aug 26 23:08:51 user nova-compute[73497]:     <os_type>hvm</os_type>
Aug 26 23:08:51 user nova-compute[73497]:     <arch name='sparc64'>
Aug 26 23:08:51 user nova-compute[73497]:       <wordsize>64</wordsize>
Aug 26 23:08:51 user nova-compute[73497]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>sun4u</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>niagara</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>sun4v</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <domain type='qemu'/>
Aug 26 23:08:51 user nova-compute[73497]:     </arch>
Aug 26 23:08:51 user nova-compute[73497]:     <features>
Aug 26 23:08:51 user nova-compute[73497]:       <cpuselection/>
Aug 26 23:08:51 user nova-compute[73497]:       <deviceboot/>
Aug 26 23:08:51 user nova-compute[73497]:       <disksnapshot default='on' toggle='no'/>
Aug 26 23:08:51 user nova-compute[73497]:     </features>
Aug 26 23:08:51 user nova-compute[73497]:   </guest>
Aug 26 23:08:51 user nova-compute[73497]:   <guest>
Aug 26 23:08:51 user nova-compute[73497]:     <os_type>hvm</os_type>
Aug 26 23:08:51 user nova-compute[73497]:     <arch name='x86_64'>
Aug 26 23:08:51 user nova-compute[73497]:       <wordsize>64</wordsize>
Aug 26 23:08:51 user nova-compute[73497]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>x-remote</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='1'>isapc</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>microvm</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <domain type='qemu'/>
Aug 26 23:08:51 user nova-compute[73497]:       <domain type='kvm'/>
Aug 26 23:08:51 user nova-compute[73497]:     </arch>
Aug 26 23:08:51 user nova-compute[73497]:     <features>
Aug 26 23:08:51 user nova-compute[73497]:       <acpi default='on' toggle='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:       <apic default='on' toggle='no'/>
Aug 26 23:08:51 user nova-compute[73497]:       <cpuselection/>
Aug 26 23:08:51 user nova-compute[73497]:       <deviceboot/>
Aug 26 23:08:51 user nova-compute[73497]:       <disksnapshot default='on' toggle='no'/>
Aug 26 23:08:51 user nova-compute[73497]:     </features>
Aug 26 23:08:51 user nova-compute[73497]:   </guest>
Aug 26 23:08:51 user nova-compute[73497]:   <guest>
Aug 26 23:08:51 user nova-compute[73497]:     <os_type>hvm</os_type>
Aug 26 23:08:51 user nova-compute[73497]:     <arch name='xtensa'>
Aug 26 23:08:51 user nova-compute[73497]:       <wordsize>32</wordsize>
Aug 26 23:08:51 user nova-compute[73497]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='4'>sim</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='32'>kc705</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='32'>ml605</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='32'>virt</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='32'>lx200</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='32'>lx60</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <domain type='qemu'/>
Aug 26 23:08:51 user nova-compute[73497]:     </arch>
Aug 26 23:08:51 user nova-compute[73497]:     <features>
Aug 26 23:08:51 user nova-compute[73497]:       <cpuselection/>
Aug 26 23:08:51 user nova-compute[73497]:       <deviceboot/>
Aug 26 23:08:51 user nova-compute[73497]:       <disksnapshot default='on' toggle='no'/>
Aug 26 23:08:51 user nova-compute[73497]:     </features>
Aug 26 23:08:51 user nova-compute[73497]:   </guest>
Aug 26 23:08:51 user nova-compute[73497]:   <guest>
Aug 26 23:08:51 user nova-compute[73497]:     <os_type>hvm</os_type>
Aug 26 23:08:51 user nova-compute[73497]:     <arch name='xtensaeb'>
Aug 26 23:08:51 user nova-compute[73497]:       <wordsize>32</wordsize>
Aug 26 23:08:51 user nova-compute[73497]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='4'>sim</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='32'>kc705</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='32'>ml605</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='32'>virt</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='32'>lx200</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='32'>lx60</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 26 23:08:51 user nova-compute[73497]:       <domain type='qemu'/>
Aug 26 23:08:51 user nova-compute[73497]:     </arch>
Aug 26 23:08:51 user nova-compute[73497]:     <features>
Aug 26 23:08:51 user nova-compute[73497]:       <cpuselection/>
Aug 26 23:08:51 user nova-compute[73497]:       <deviceboot/>
Aug 26 23:08:51 user nova-compute[73497]:       <disksnapshot default='on' toggle='no'/>
Aug 26 23:08:51 user nova-compute[73497]:     </features>
Aug 26 23:08:51 user nova-compute[73497]:   </guest>
Aug 26 23:08:51 user nova-compute[73497]: </capabilities>
Aug 26 23:08:51 user nova-compute[73497]: 
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=73497) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=73497) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=73497) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73497) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73497) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=73497) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73497) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=73497) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=73497) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=73497) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=73497) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'q35', 'ubuntu', 'pc'} {{(pid=73497) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 26 23:08:51 user nova-compute[73497]: <domainCapabilities>
Aug 26 23:08:51 user nova-compute[73497]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 23:08:51 user nova-compute[73497]:   <domain>kvm</domain>
Aug 26 23:08:51 user nova-compute[73497]:   <machine>pc-q35-jammy</machine>
Aug 26 23:08:51 user nova-compute[73497]:   <arch>i686</arch>
Aug 26 23:08:51 user nova-compute[73497]:   <vcpu max='288'/>
Aug 26 23:08:51 user nova-compute[73497]:   <iothreads supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:   <os supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:     <enum name='firmware'/>
Aug 26 23:08:51 user nova-compute[73497]:     <loader supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 23:08:51 user nova-compute[73497]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 23:08:51 user nova-compute[73497]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 23:08:51 user nova-compute[73497]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 23:08:51 user nova-compute[73497]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='type'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>rom</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>pflash</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='readonly'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>yes</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>no</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='secure'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>no</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </loader>
Aug 26 23:08:51 user nova-compute[73497]:   </os>
Aug 26 23:08:51 user nova-compute[73497]:   <cpu>
Aug 26 23:08:51 user nova-compute[73497]:     <mode name='host-passthrough' supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='hostPassthroughMigratable'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>off</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </mode>
Aug 26 23:08:51 user nova-compute[73497]:     <mode name='maximum' supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='maximumMigratable'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>on</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>off</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </mode>
Aug 26 23:08:51 user nova-compute[73497]:     <mode name='host-model' supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <vendor>Intel</vendor>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='ss'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='vmx'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='pcid'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='hypervisor'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='arat'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='umip'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='md-clear'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='stibp'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='ssbd'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='ibpb'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='ibrs'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='amd-stibp'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='disable' name='erms'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='disable' name='lm'/>
Aug 26 23:08:51 user nova-compute[73497]:     </mode>
Aug 26 23:08:51 user nova-compute[73497]:     <mode name='custom' supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>qemu64</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>qemu32</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>phenom</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>pentium3</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>pentium2</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>pentium</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>n270</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>kvm64</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>kvm32</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>coreduo</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>core2duo</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>athlon</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Westmere</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Snowridge</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Server</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Client</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>SandyBridge</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Penryn</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Opteron_G5</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Opteron_G4</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Opteron_G3</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Opteron_G2</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Opteron_G1</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Nehalem</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>IvyBridge</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Icelake-Server</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Haswell</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>EPYC-Rome</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>EPYC-Milan</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>EPYC</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Dhyana</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Cooperlake</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Conroe</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Broadwell</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>486</model>
Aug 26 23:08:51 user nova-compute[73497]:     </mode>
Aug 26 23:08:51 user nova-compute[73497]:   </cpu>
Aug 26 23:08:51 user nova-compute[73497]:   <memoryBacking supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:     <enum name='sourceType'>
Aug 26 23:08:51 user nova-compute[73497]:       <value>file</value>
Aug 26 23:08:51 user nova-compute[73497]:       <value>anonymous</value>
Aug 26 23:08:51 user nova-compute[73497]:       <value>memfd</value>
Aug 26 23:08:51 user nova-compute[73497]:     </enum>
Aug 26 23:08:51 user nova-compute[73497]:   </memoryBacking>
Aug 26 23:08:51 user nova-compute[73497]:   <devices>
Aug 26 23:08:51 user nova-compute[73497]:     <disk supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='diskDevice'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>disk</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>cdrom</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>floppy</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>lun</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='bus'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>fdc</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>scsi</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>usb</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>sata</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='model'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio-transitional</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio-non-transitional</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </disk>
Aug 26 23:08:51 user nova-compute[73497]:     <graphics supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='type'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>sdl</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>vnc</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>spice</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>egl-headless</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </graphics>
Aug 26 23:08:51 user nova-compute[73497]:     <video supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='modelType'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>vga</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>cirrus</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>vmvga</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>qxl</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>none</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>bochs</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>ramfb</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </video>
Aug 26 23:08:51 user nova-compute[73497]:     <hostdev supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='mode'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>subsystem</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='startupPolicy'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>default</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>mandatory</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>requisite</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>optional</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='subsysType'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>usb</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>pci</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>scsi</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='capsType'/>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='pciBackend'/>
Aug 26 23:08:51 user nova-compute[73497]:     </hostdev>
Aug 26 23:08:51 user nova-compute[73497]:     <rng supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='model'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio-transitional</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio-non-transitional</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='backendModel'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>random</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>egd</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>builtin</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </rng>
Aug 26 23:08:51 user nova-compute[73497]:     <filesystem supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='driverType'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>path</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>handle</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtiofs</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </filesystem>
Aug 26 23:08:51 user nova-compute[73497]:     <tpm supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='model'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>tpm-tis</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>tpm-crb</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='backendModel'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>passthrough</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>emulator</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </tpm>
Aug 26 23:08:51 user nova-compute[73497]:   </devices>
Aug 26 23:08:51 user nova-compute[73497]:   <features>
Aug 26 23:08:51 user nova-compute[73497]:     <gic supported='no'/>
Aug 26 23:08:51 user nova-compute[73497]:     <vmcoreinfo supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:     <genid supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:     <backingStoreInput supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:     <backup supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:     <sev supported='no'/>
Aug 26 23:08:51 user nova-compute[73497]:   </features>
Aug 26 23:08:51 user nova-compute[73497]: </domainCapabilities>
Aug 26 23:08:51 user nova-compute[73497]:  {{(pid=73497) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 26 23:08:51 user nova-compute[73497]: <domainCapabilities>
Aug 26 23:08:51 user nova-compute[73497]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 23:08:51 user nova-compute[73497]:   <domain>kvm</domain>
Aug 26 23:08:51 user nova-compute[73497]:   <machine>pc-q35-6.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:   <arch>i686</arch>
Aug 26 23:08:51 user nova-compute[73497]:   <vcpu max='288'/>
Aug 26 23:08:51 user nova-compute[73497]:   <iothreads supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:   <os supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:     <enum name='firmware'/>
Aug 26 23:08:51 user nova-compute[73497]:     <loader supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 23:08:51 user nova-compute[73497]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 23:08:51 user nova-compute[73497]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 23:08:51 user nova-compute[73497]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 23:08:51 user nova-compute[73497]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='type'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>rom</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>pflash</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='readonly'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>yes</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>no</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='secure'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>no</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </loader>
Aug 26 23:08:51 user nova-compute[73497]:   </os>
Aug 26 23:08:51 user nova-compute[73497]:   <cpu>
Aug 26 23:08:51 user nova-compute[73497]:     <mode name='host-passthrough' supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='hostPassthroughMigratable'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>off</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </mode>
Aug 26 23:08:51 user nova-compute[73497]:     <mode name='maximum' supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='maximumMigratable'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>on</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>off</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </mode>
Aug 26 23:08:51 user nova-compute[73497]:     <mode name='host-model' supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <vendor>Intel</vendor>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='ss'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='vmx'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='pcid'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='hypervisor'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='arat'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='umip'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='md-clear'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='stibp'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='ssbd'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='ibpb'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='ibrs'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='amd-stibp'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='disable' name='erms'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='disable' name='lm'/>
Aug 26 23:08:51 user nova-compute[73497]:     </mode>
Aug 26 23:08:51 user nova-compute[73497]:     <mode name='custom' supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>qemu64</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>qemu32</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>phenom</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>pentium3</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>pentium2</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>pentium</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>n270</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>kvm64</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>kvm32</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>coreduo</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>core2duo</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>athlon</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Westmere</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Snowridge</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Server</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Client</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>SandyBridge</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Penryn</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Opteron_G5</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Opteron_G4</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Opteron_G3</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Opteron_G2</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Opteron_G1</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Nehalem</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>IvyBridge</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Icelake-Server</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Haswell</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>EPYC-Rome</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>EPYC-Milan</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>EPYC</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Dhyana</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Cooperlake</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Conroe</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Broadwell</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>486</model>
Aug 26 23:08:51 user nova-compute[73497]:     </mode>
Aug 26 23:08:51 user nova-compute[73497]:   </cpu>
Aug 26 23:08:51 user nova-compute[73497]:   <memoryBacking supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:     <enum name='sourceType'>
Aug 26 23:08:51 user nova-compute[73497]:       <value>file</value>
Aug 26 23:08:51 user nova-compute[73497]:       <value>anonymous</value>
Aug 26 23:08:51 user nova-compute[73497]:       <value>memfd</value>
Aug 26 23:08:51 user nova-compute[73497]:     </enum>
Aug 26 23:08:51 user nova-compute[73497]:   </memoryBacking>
Aug 26 23:08:51 user nova-compute[73497]:   <devices>
Aug 26 23:08:51 user nova-compute[73497]:     <disk supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='diskDevice'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>disk</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>cdrom</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>floppy</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>lun</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='bus'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>fdc</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>scsi</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>usb</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>sata</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='model'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio-transitional</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio-non-transitional</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </disk>
Aug 26 23:08:51 user nova-compute[73497]:     <graphics supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='type'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>sdl</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>vnc</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>spice</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>egl-headless</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </graphics>
Aug 26 23:08:51 user nova-compute[73497]:     <video supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='modelType'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>vga</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>cirrus</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>vmvga</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>qxl</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>none</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>bochs</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>ramfb</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </video>
Aug 26 23:08:51 user nova-compute[73497]:     <hostdev supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='mode'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>subsystem</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='startupPolicy'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>default</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>mandatory</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>requisite</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>optional</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='subsysType'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>usb</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>pci</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>scsi</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='capsType'/>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='pciBackend'/>
Aug 26 23:08:51 user nova-compute[73497]:     </hostdev>
Aug 26 23:08:51 user nova-compute[73497]:     <rng supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='model'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio-transitional</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio-non-transitional</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='backendModel'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>random</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>egd</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>builtin</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </rng>
Aug 26 23:08:51 user nova-compute[73497]:     <filesystem supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='driverType'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>path</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>handle</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtiofs</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </filesystem>
Aug 26 23:08:51 user nova-compute[73497]:     <tpm supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='model'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>tpm-tis</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>tpm-crb</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='backendModel'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>passthrough</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>emulator</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </tpm>
Aug 26 23:08:51 user nova-compute[73497]:   </devices>
Aug 26 23:08:51 user nova-compute[73497]:   <features>
Aug 26 23:08:51 user nova-compute[73497]:     <gic supported='no'/>
Aug 26 23:08:51 user nova-compute[73497]:     <vmcoreinfo supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:     <genid supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:     <backingStoreInput supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:     <backup supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:     <sev supported='no'/>
Aug 26 23:08:51 user nova-compute[73497]:   </features>
Aug 26 23:08:51 user nova-compute[73497]: </domainCapabilities>
Aug 26 23:08:51 user nova-compute[73497]:  {{(pid=73497) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 26 23:08:51 user nova-compute[73497]: <domainCapabilities>
Aug 26 23:08:51 user nova-compute[73497]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 23:08:51 user nova-compute[73497]:   <domain>kvm</domain>
Aug 26 23:08:51 user nova-compute[73497]:   <machine>pc-i440fx-jammy</machine>
Aug 26 23:08:51 user nova-compute[73497]:   <arch>i686</arch>
Aug 26 23:08:51 user nova-compute[73497]:   <vcpu max='255'/>
Aug 26 23:08:51 user nova-compute[73497]:   <iothreads supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:   <os supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:     <enum name='firmware'/>
Aug 26 23:08:51 user nova-compute[73497]:     <loader supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 23:08:51 user nova-compute[73497]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 23:08:51 user nova-compute[73497]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 23:08:51 user nova-compute[73497]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 23:08:51 user nova-compute[73497]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='type'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>rom</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>pflash</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='readonly'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>yes</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>no</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='secure'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>no</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </loader>
Aug 26 23:08:51 user nova-compute[73497]:   </os>
Aug 26 23:08:51 user nova-compute[73497]:   <cpu>
Aug 26 23:08:51 user nova-compute[73497]:     <mode name='host-passthrough' supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='hostPassthroughMigratable'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>off</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </mode>
Aug 26 23:08:51 user nova-compute[73497]:     <mode name='maximum' supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='maximumMigratable'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>on</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>off</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </mode>
Aug 26 23:08:51 user nova-compute[73497]:     <mode name='host-model' supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <vendor>Intel</vendor>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='ss'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='vmx'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='pcid'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='hypervisor'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='arat'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='umip'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='md-clear'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='stibp'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='ssbd'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='ibpb'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='ibrs'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='amd-stibp'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='disable' name='erms'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='disable' name='lm'/>
Aug 26 23:08:51 user nova-compute[73497]:     </mode>
Aug 26 23:08:51 user nova-compute[73497]:     <mode name='custom' supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>qemu64</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>qemu32</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>phenom</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>pentium3</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>pentium2</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>pentium</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>n270</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>kvm64</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>kvm32</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>coreduo</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>core2duo</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>athlon</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Westmere</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Snowridge</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Server</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Client</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>SandyBridge</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Penryn</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Opteron_G5</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Opteron_G4</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Opteron_G3</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Opteron_G2</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Opteron_G1</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Nehalem</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>IvyBridge</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Icelake-Server</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Haswell</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>EPYC-Rome</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>EPYC-Milan</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>EPYC</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Dhyana</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Cooperlake</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Conroe</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Broadwell</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>486</model>
Aug 26 23:08:51 user nova-compute[73497]:     </mode>
Aug 26 23:08:51 user nova-compute[73497]:   </cpu>
Aug 26 23:08:51 user nova-compute[73497]:   <memoryBacking supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:     <enum name='sourceType'>
Aug 26 23:08:51 user nova-compute[73497]:       <value>file</value>
Aug 26 23:08:51 user nova-compute[73497]:       <value>anonymous</value>
Aug 26 23:08:51 user nova-compute[73497]:       <value>memfd</value>
Aug 26 23:08:51 user nova-compute[73497]:     </enum>
Aug 26 23:08:51 user nova-compute[73497]:   </memoryBacking>
Aug 26 23:08:51 user nova-compute[73497]:   <devices>
Aug 26 23:08:51 user nova-compute[73497]:     <disk supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='diskDevice'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>disk</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>cdrom</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>floppy</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>lun</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='bus'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>ide</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>fdc</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>scsi</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>usb</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>sata</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='model'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio-transitional</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio-non-transitional</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </disk>
Aug 26 23:08:51 user nova-compute[73497]:     <graphics supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='type'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>sdl</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>vnc</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>spice</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>egl-headless</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </graphics>
Aug 26 23:08:51 user nova-compute[73497]:     <video supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='modelType'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>vga</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>cirrus</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>vmvga</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>qxl</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>none</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>bochs</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>ramfb</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </video>
Aug 26 23:08:51 user nova-compute[73497]:     <hostdev supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='mode'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>subsystem</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='startupPolicy'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>default</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>mandatory</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>requisite</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>optional</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='subsysType'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>usb</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>pci</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>scsi</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='capsType'/>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='pciBackend'/>
Aug 26 23:08:51 user nova-compute[73497]:     </hostdev>
Aug 26 23:08:51 user nova-compute[73497]:     <rng supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='model'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio-transitional</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio-non-transitional</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='backendModel'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>random</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>egd</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>builtin</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </rng>
Aug 26 23:08:51 user nova-compute[73497]:     <filesystem supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='driverType'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>path</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>handle</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtiofs</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </filesystem>
Aug 26 23:08:51 user nova-compute[73497]:     <tpm supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='model'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>tpm-tis</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>tpm-crb</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='backendModel'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>passthrough</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>emulator</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </tpm>
Aug 26 23:08:51 user nova-compute[73497]:   </devices>
Aug 26 23:08:51 user nova-compute[73497]:   <features>
Aug 26 23:08:51 user nova-compute[73497]:     <gic supported='no'/>
Aug 26 23:08:51 user nova-compute[73497]:     <vmcoreinfo supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:     <genid supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:     <backingStoreInput supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:     <backup supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:     <sev supported='no'/>
Aug 26 23:08:51 user nova-compute[73497]:   </features>
Aug 26 23:08:51 user nova-compute[73497]: </domainCapabilities>
Aug 26 23:08:51 user nova-compute[73497]:  {{(pid=73497) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 26 23:08:51 user nova-compute[73497]: <domainCapabilities>
Aug 26 23:08:51 user nova-compute[73497]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 23:08:51 user nova-compute[73497]:   <domain>kvm</domain>
Aug 26 23:08:51 user nova-compute[73497]:   <machine>pc-i440fx-6.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:   <arch>i686</arch>
Aug 26 23:08:51 user nova-compute[73497]:   <vcpu max='255'/>
Aug 26 23:08:51 user nova-compute[73497]:   <iothreads supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:   <os supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:     <enum name='firmware'/>
Aug 26 23:08:51 user nova-compute[73497]:     <loader supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 23:08:51 user nova-compute[73497]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 23:08:51 user nova-compute[73497]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 23:08:51 user nova-compute[73497]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 23:08:51 user nova-compute[73497]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='type'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>rom</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>pflash</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='readonly'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>yes</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>no</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='secure'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>no</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </loader>
Aug 26 23:08:51 user nova-compute[73497]:   </os>
Aug 26 23:08:51 user nova-compute[73497]:   <cpu>
Aug 26 23:08:51 user nova-compute[73497]:     <mode name='host-passthrough' supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='hostPassthroughMigratable'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>off</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </mode>
Aug 26 23:08:51 user nova-compute[73497]:     <mode name='maximum' supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='maximumMigratable'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>on</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>off</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </mode>
Aug 26 23:08:51 user nova-compute[73497]:     <mode name='host-model' supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <vendor>Intel</vendor>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='ss'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='vmx'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='pcid'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='hypervisor'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='arat'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='umip'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='md-clear'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='stibp'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='ssbd'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='ibpb'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='ibrs'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='amd-stibp'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='disable' name='erms'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='disable' name='lm'/>
Aug 26 23:08:51 user nova-compute[73497]:     </mode>
Aug 26 23:08:51 user nova-compute[73497]:     <mode name='custom' supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>qemu64</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>qemu32</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>phenom</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>pentium3</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>pentium2</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>pentium</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>n270</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>kvm64</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>kvm32</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>coreduo</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>core2duo</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>athlon</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Westmere</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Snowridge</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Server</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Client</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>SandyBridge</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Penryn</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Opteron_G5</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Opteron_G4</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Opteron_G3</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Opteron_G2</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Opteron_G1</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Nehalem</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>IvyBridge</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Icelake-Server</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Haswell</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>EPYC-Rome</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>EPYC-Milan</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>EPYC</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Dhyana</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Cooperlake</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Conroe</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Broadwell</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>486</model>
Aug 26 23:08:51 user nova-compute[73497]:     </mode>
Aug 26 23:08:51 user nova-compute[73497]:   </cpu>
Aug 26 23:08:51 user nova-compute[73497]:   <memoryBacking supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:     <enum name='sourceType'>
Aug 26 23:08:51 user nova-compute[73497]:       <value>file</value>
Aug 26 23:08:51 user nova-compute[73497]:       <value>anonymous</value>
Aug 26 23:08:51 user nova-compute[73497]:       <value>memfd</value>
Aug 26 23:08:51 user nova-compute[73497]:     </enum>
Aug 26 23:08:51 user nova-compute[73497]:   </memoryBacking>
Aug 26 23:08:51 user nova-compute[73497]:   <devices>
Aug 26 23:08:51 user nova-compute[73497]:     <disk supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='diskDevice'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>disk</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>cdrom</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>floppy</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>lun</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='bus'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>ide</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>fdc</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>scsi</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>usb</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>sata</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='model'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio-transitional</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio-non-transitional</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </disk>
Aug 26 23:08:51 user nova-compute[73497]:     <graphics supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='type'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>sdl</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>vnc</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>spice</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>egl-headless</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </graphics>
Aug 26 23:08:51 user nova-compute[73497]:     <video supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='modelType'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>vga</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>cirrus</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>vmvga</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>qxl</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>none</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>bochs</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>ramfb</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </video>
Aug 26 23:08:51 user nova-compute[73497]:     <hostdev supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='mode'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>subsystem</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='startupPolicy'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>default</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>mandatory</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>requisite</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>optional</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='subsysType'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>usb</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>pci</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>scsi</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='capsType'/>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='pciBackend'/>
Aug 26 23:08:51 user nova-compute[73497]:     </hostdev>
Aug 26 23:08:51 user nova-compute[73497]:     <rng supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='model'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio-transitional</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio-non-transitional</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='backendModel'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>random</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>egd</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>builtin</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </rng>
Aug 26 23:08:51 user nova-compute[73497]:     <filesystem supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='driverType'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>path</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>handle</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtiofs</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </filesystem>
Aug 26 23:08:51 user nova-compute[73497]:     <tpm supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='model'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>tpm-tis</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>tpm-crb</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='backendModel'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>passthrough</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>emulator</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </tpm>
Aug 26 23:08:51 user nova-compute[73497]:   </devices>
Aug 26 23:08:51 user nova-compute[73497]:   <features>
Aug 26 23:08:51 user nova-compute[73497]:     <gic supported='no'/>
Aug 26 23:08:51 user nova-compute[73497]:     <vmcoreinfo supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:     <genid supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:     <backingStoreInput supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:     <backup supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:     <sev supported='no'/>
Aug 26 23:08:51 user nova-compute[73497]:   </features>
Aug 26 23:08:51 user nova-compute[73497]: </domainCapabilities>
Aug 26 23:08:51 user nova-compute[73497]:  {{(pid=73497) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=73497) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73497) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73497) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=73497) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=73497) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=73497) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=73497) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=73497) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=73497) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=73497) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=73497) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=73497) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=73497) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=73497) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=73497) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=73497) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=73497) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=73497) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73497) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73497) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73497) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=73497) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73497) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73497) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=73497) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=73497) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=73497) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=73497) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=73497) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=73497) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=73497) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=73497) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=73497) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=73497) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=73497) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=73497) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=73497) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=73497) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'q35', 'ubuntu', 'pc'} {{(pid=73497) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 26 23:08:51 user nova-compute[73497]: <domainCapabilities>
Aug 26 23:08:51 user nova-compute[73497]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 23:08:51 user nova-compute[73497]:   <domain>kvm</domain>
Aug 26 23:08:51 user nova-compute[73497]:   <machine>pc-q35-jammy</machine>
Aug 26 23:08:51 user nova-compute[73497]:   <arch>x86_64</arch>
Aug 26 23:08:51 user nova-compute[73497]:   <vcpu max='288'/>
Aug 26 23:08:51 user nova-compute[73497]:   <iothreads supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:   <os supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:     <enum name='firmware'>
Aug 26 23:08:51 user nova-compute[73497]:       <value>efi</value>
Aug 26 23:08:51 user nova-compute[73497]:     </enum>
Aug 26 23:08:51 user nova-compute[73497]:     <loader supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 26 23:08:51 user nova-compute[73497]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 26 23:08:51 user nova-compute[73497]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='type'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>rom</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>pflash</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='readonly'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>yes</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>no</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='secure'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>yes</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>no</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </loader>
Aug 26 23:08:51 user nova-compute[73497]:   </os>
Aug 26 23:08:51 user nova-compute[73497]:   <cpu>
Aug 26 23:08:51 user nova-compute[73497]:     <mode name='host-passthrough' supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='hostPassthroughMigratable'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>on</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>off</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </mode>
Aug 26 23:08:51 user nova-compute[73497]:     <mode name='maximum' supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='maximumMigratable'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>on</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>off</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </mode>
Aug 26 23:08:51 user nova-compute[73497]:     <mode name='host-model' supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <vendor>Intel</vendor>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='ss'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='vmx'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='pcid'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='hypervisor'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='arat'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='umip'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='md-clear'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='stibp'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='ssbd'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='invtsc'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='ibpb'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='ibrs'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='amd-stibp'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='rsba'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='disable' name='erms'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 23:08:51 user nova-compute[73497]:     </mode>
Aug 26 23:08:51 user nova-compute[73497]:     <mode name='custom' supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>qemu64</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>qemu32</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>phenom</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>pentium3</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>pentium2</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>pentium</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>n270</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>kvm64</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>kvm32</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>coreduo</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>core2duo</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>athlon</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>Westmere</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Snowridge</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Server</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Client</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>SandyBridge</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>Penryn</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Opteron_G5</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Opteron_G4</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Opteron_G3</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Opteron_G2</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>Opteron_G1</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>Nehalem</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>IvyBridge</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Icelake-Server</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Haswell</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>EPYC-Rome</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>EPYC-Milan</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>EPYC</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Dhyana</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Cooperlake</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>Conroe</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Broadwell</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>486</model>
Aug 26 23:08:51 user nova-compute[73497]:     </mode>
Aug 26 23:08:51 user nova-compute[73497]:   </cpu>
Aug 26 23:08:51 user nova-compute[73497]:   <memoryBacking supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:     <enum name='sourceType'>
Aug 26 23:08:51 user nova-compute[73497]:       <value>file</value>
Aug 26 23:08:51 user nova-compute[73497]:       <value>anonymous</value>
Aug 26 23:08:51 user nova-compute[73497]:       <value>memfd</value>
Aug 26 23:08:51 user nova-compute[73497]:     </enum>
Aug 26 23:08:51 user nova-compute[73497]:   </memoryBacking>
Aug 26 23:08:51 user nova-compute[73497]:   <devices>
Aug 26 23:08:51 user nova-compute[73497]:     <disk supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='diskDevice'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>disk</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>cdrom</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>floppy</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>lun</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='bus'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>fdc</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>scsi</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>usb</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>sata</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='model'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio-transitional</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio-non-transitional</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </disk>
Aug 26 23:08:51 user nova-compute[73497]:     <graphics supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='type'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>sdl</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>vnc</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>spice</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>egl-headless</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </graphics>
Aug 26 23:08:51 user nova-compute[73497]:     <video supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='modelType'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>vga</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>cirrus</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>vmvga</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>qxl</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>none</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>bochs</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>ramfb</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </video>
Aug 26 23:08:51 user nova-compute[73497]:     <hostdev supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='mode'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>subsystem</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='startupPolicy'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>default</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>mandatory</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>requisite</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>optional</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='subsysType'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>usb</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>pci</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>scsi</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='capsType'/>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='pciBackend'/>
Aug 26 23:08:51 user nova-compute[73497]:     </hostdev>
Aug 26 23:08:51 user nova-compute[73497]:     <rng supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='model'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio-transitional</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio-non-transitional</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='backendModel'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>random</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>egd</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>builtin</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </rng>
Aug 26 23:08:51 user nova-compute[73497]:     <filesystem supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='driverType'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>path</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>handle</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtiofs</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </filesystem>
Aug 26 23:08:51 user nova-compute[73497]:     <tpm supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='model'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>tpm-tis</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>tpm-crb</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='backendModel'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>passthrough</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>emulator</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </tpm>
Aug 26 23:08:51 user nova-compute[73497]:   </devices>
Aug 26 23:08:51 user nova-compute[73497]:   <features>
Aug 26 23:08:51 user nova-compute[73497]:     <gic supported='no'/>
Aug 26 23:08:51 user nova-compute[73497]:     <vmcoreinfo supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:     <genid supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:     <backingStoreInput supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:     <backup supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:     <sev supported='no'/>
Aug 26 23:08:51 user nova-compute[73497]:   </features>
Aug 26 23:08:51 user nova-compute[73497]: </domainCapabilities>
Aug 26 23:08:51 user nova-compute[73497]:  {{(pid=73497) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 26 23:08:51 user nova-compute[73497]: <domainCapabilities>
Aug 26 23:08:51 user nova-compute[73497]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 23:08:51 user nova-compute[73497]:   <domain>kvm</domain>
Aug 26 23:08:51 user nova-compute[73497]:   <machine>pc-q35-6.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:   <arch>x86_64</arch>
Aug 26 23:08:51 user nova-compute[73497]:   <vcpu max='288'/>
Aug 26 23:08:51 user nova-compute[73497]:   <iothreads supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:   <os supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:     <enum name='firmware'>
Aug 26 23:08:51 user nova-compute[73497]:       <value>efi</value>
Aug 26 23:08:51 user nova-compute[73497]:     </enum>
Aug 26 23:08:51 user nova-compute[73497]:     <loader supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 26 23:08:51 user nova-compute[73497]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 26 23:08:51 user nova-compute[73497]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='type'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>rom</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>pflash</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='readonly'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>yes</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>no</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='secure'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>yes</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>no</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </loader>
Aug 26 23:08:51 user nova-compute[73497]:   </os>
Aug 26 23:08:51 user nova-compute[73497]:   <cpu>
Aug 26 23:08:51 user nova-compute[73497]:     <mode name='host-passthrough' supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='hostPassthroughMigratable'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>on</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>off</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </mode>
Aug 26 23:08:51 user nova-compute[73497]:     <mode name='maximum' supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='maximumMigratable'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>on</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>off</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </mode>
Aug 26 23:08:51 user nova-compute[73497]:     <mode name='host-model' supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <vendor>Intel</vendor>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='ss'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='vmx'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='pcid'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='hypervisor'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='arat'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='umip'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='md-clear'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='stibp'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='ssbd'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='invtsc'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='ibpb'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='ibrs'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='amd-stibp'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='rsba'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='disable' name='erms'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 23:08:51 user nova-compute[73497]:     </mode>
Aug 26 23:08:51 user nova-compute[73497]:     <mode name='custom' supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>qemu64</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>qemu32</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>phenom</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>pentium3</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>pentium2</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>pentium</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>n270</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>kvm64</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>kvm32</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>coreduo</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>core2duo</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>athlon</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>Westmere</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Snowridge</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Server</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Client</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>SandyBridge</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>Penryn</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Opteron_G5</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Opteron_G4</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Opteron_G3</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Opteron_G2</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>Opteron_G1</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>Nehalem</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>IvyBridge</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Icelake-Server</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Haswell</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>EPYC-Rome</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>EPYC-Milan</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>EPYC</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Dhyana</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Cooperlake</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>Conroe</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Broadwell</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>486</model>
Aug 26 23:08:51 user nova-compute[73497]:     </mode>
Aug 26 23:08:51 user nova-compute[73497]:   </cpu>
Aug 26 23:08:51 user nova-compute[73497]:   <memoryBacking supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:     <enum name='sourceType'>
Aug 26 23:08:51 user nova-compute[73497]:       <value>file</value>
Aug 26 23:08:51 user nova-compute[73497]:       <value>anonymous</value>
Aug 26 23:08:51 user nova-compute[73497]:       <value>memfd</value>
Aug 26 23:08:51 user nova-compute[73497]:     </enum>
Aug 26 23:08:51 user nova-compute[73497]:   </memoryBacking>
Aug 26 23:08:51 user nova-compute[73497]:   <devices>
Aug 26 23:08:51 user nova-compute[73497]:     <disk supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='diskDevice'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>disk</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>cdrom</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>floppy</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>lun</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='bus'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>fdc</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>scsi</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>usb</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>sata</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='model'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio-transitional</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio-non-transitional</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </disk>
Aug 26 23:08:51 user nova-compute[73497]:     <graphics supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='type'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>sdl</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>vnc</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>spice</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>egl-headless</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </graphics>
Aug 26 23:08:51 user nova-compute[73497]:     <video supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='modelType'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>vga</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>cirrus</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>vmvga</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>qxl</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>none</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>bochs</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>ramfb</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </video>
Aug 26 23:08:51 user nova-compute[73497]:     <hostdev supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='mode'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>subsystem</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='startupPolicy'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>default</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>mandatory</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>requisite</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>optional</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='subsysType'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>usb</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>pci</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>scsi</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='capsType'/>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='pciBackend'/>
Aug 26 23:08:51 user nova-compute[73497]:     </hostdev>
Aug 26 23:08:51 user nova-compute[73497]:     <rng supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='model'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio-transitional</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio-non-transitional</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='backendModel'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>random</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>egd</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>builtin</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </rng>
Aug 26 23:08:51 user nova-compute[73497]:     <filesystem supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='driverType'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>path</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>handle</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtiofs</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </filesystem>
Aug 26 23:08:51 user nova-compute[73497]:     <tpm supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='model'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>tpm-tis</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>tpm-crb</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='backendModel'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>passthrough</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>emulator</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </tpm>
Aug 26 23:08:51 user nova-compute[73497]:   </devices>
Aug 26 23:08:51 user nova-compute[73497]:   <features>
Aug 26 23:08:51 user nova-compute[73497]:     <gic supported='no'/>
Aug 26 23:08:51 user nova-compute[73497]:     <vmcoreinfo supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:     <genid supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:     <backingStoreInput supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:     <backup supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:     <sev supported='no'/>
Aug 26 23:08:51 user nova-compute[73497]:   </features>
Aug 26 23:08:51 user nova-compute[73497]: </domainCapabilities>
Aug 26 23:08:51 user nova-compute[73497]:  {{(pid=73497) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 26 23:08:51 user nova-compute[73497]: <domainCapabilities>
Aug 26 23:08:51 user nova-compute[73497]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 23:08:51 user nova-compute[73497]:   <domain>kvm</domain>
Aug 26 23:08:51 user nova-compute[73497]:   <machine>pc-i440fx-jammy</machine>
Aug 26 23:08:51 user nova-compute[73497]:   <arch>x86_64</arch>
Aug 26 23:08:51 user nova-compute[73497]:   <vcpu max='255'/>
Aug 26 23:08:51 user nova-compute[73497]:   <iothreads supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:   <os supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:     <enum name='firmware'>
Aug 26 23:08:51 user nova-compute[73497]:       <value>efi</value>
Aug 26 23:08:51 user nova-compute[73497]:     </enum>
Aug 26 23:08:51 user nova-compute[73497]:     <loader supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='type'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>rom</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>pflash</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='readonly'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>yes</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>no</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='secure'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>no</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </loader>
Aug 26 23:08:51 user nova-compute[73497]:   </os>
Aug 26 23:08:51 user nova-compute[73497]:   <cpu>
Aug 26 23:08:51 user nova-compute[73497]:     <mode name='host-passthrough' supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='hostPassthroughMigratable'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>on</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>off</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </mode>
Aug 26 23:08:51 user nova-compute[73497]:     <mode name='maximum' supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='maximumMigratable'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>on</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>off</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </mode>
Aug 26 23:08:51 user nova-compute[73497]:     <mode name='host-model' supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <vendor>Intel</vendor>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='ss'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='vmx'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='pcid'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='hypervisor'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='arat'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='umip'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='md-clear'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='stibp'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='ssbd'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='invtsc'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='ibpb'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='ibrs'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='amd-stibp'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='rsba'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='disable' name='erms'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 23:08:51 user nova-compute[73497]:     </mode>
Aug 26 23:08:51 user nova-compute[73497]:     <mode name='custom' supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>qemu64</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>qemu32</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>phenom</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>pentium3</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>pentium2</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>pentium</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>n270</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>kvm64</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>kvm32</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>coreduo</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>core2duo</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>athlon</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>Westmere</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Snowridge</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Server</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Client</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>SandyBridge</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>Penryn</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Opteron_G5</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Opteron_G4</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Opteron_G3</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Opteron_G2</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>Opteron_G1</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>Nehalem</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>IvyBridge</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Icelake-Server</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Haswell</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>EPYC-Rome</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>EPYC-Milan</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>EPYC</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Dhyana</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Cooperlake</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>Conroe</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Broadwell</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>486</model>
Aug 26 23:08:51 user nova-compute[73497]:     </mode>
Aug 26 23:08:51 user nova-compute[73497]:   </cpu>
Aug 26 23:08:51 user nova-compute[73497]:   <memoryBacking supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:     <enum name='sourceType'>
Aug 26 23:08:51 user nova-compute[73497]:       <value>file</value>
Aug 26 23:08:51 user nova-compute[73497]:       <value>anonymous</value>
Aug 26 23:08:51 user nova-compute[73497]:       <value>memfd</value>
Aug 26 23:08:51 user nova-compute[73497]:     </enum>
Aug 26 23:08:51 user nova-compute[73497]:   </memoryBacking>
Aug 26 23:08:51 user nova-compute[73497]:   <devices>
Aug 26 23:08:51 user nova-compute[73497]:     <disk supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='diskDevice'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>disk</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>cdrom</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>floppy</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>lun</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='bus'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>ide</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>fdc</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>scsi</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>usb</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>sata</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='model'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio-transitional</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio-non-transitional</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </disk>
Aug 26 23:08:51 user nova-compute[73497]:     <graphics supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='type'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>sdl</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>vnc</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>spice</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>egl-headless</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </graphics>
Aug 26 23:08:51 user nova-compute[73497]:     <video supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='modelType'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>vga</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>cirrus</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>vmvga</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>qxl</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>none</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>bochs</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>ramfb</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </video>
Aug 26 23:08:51 user nova-compute[73497]:     <hostdev supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='mode'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>subsystem</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='startupPolicy'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>default</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>mandatory</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>requisite</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>optional</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='subsysType'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>usb</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>pci</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>scsi</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='capsType'/>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='pciBackend'/>
Aug 26 23:08:51 user nova-compute[73497]:     </hostdev>
Aug 26 23:08:51 user nova-compute[73497]:     <rng supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='model'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio-transitional</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio-non-transitional</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='backendModel'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>random</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>egd</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>builtin</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </rng>
Aug 26 23:08:51 user nova-compute[73497]:     <filesystem supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='driverType'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>path</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>handle</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtiofs</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </filesystem>
Aug 26 23:08:51 user nova-compute[73497]:     <tpm supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='model'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>tpm-tis</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>tpm-crb</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='backendModel'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>passthrough</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>emulator</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </tpm>
Aug 26 23:08:51 user nova-compute[73497]:   </devices>
Aug 26 23:08:51 user nova-compute[73497]:   <features>
Aug 26 23:08:51 user nova-compute[73497]:     <gic supported='no'/>
Aug 26 23:08:51 user nova-compute[73497]:     <vmcoreinfo supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:     <genid supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:     <backingStoreInput supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:     <backup supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:     <sev supported='no'/>
Aug 26 23:08:51 user nova-compute[73497]:   </features>
Aug 26 23:08:51 user nova-compute[73497]: </domainCapabilities>
Aug 26 23:08:51 user nova-compute[73497]:  {{(pid=73497) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 26 23:08:51 user nova-compute[73497]: <domainCapabilities>
Aug 26 23:08:51 user nova-compute[73497]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 23:08:51 user nova-compute[73497]:   <domain>kvm</domain>
Aug 26 23:08:51 user nova-compute[73497]:   <machine>pc-i440fx-6.2</machine>
Aug 26 23:08:51 user nova-compute[73497]:   <arch>x86_64</arch>
Aug 26 23:08:51 user nova-compute[73497]:   <vcpu max='255'/>
Aug 26 23:08:51 user nova-compute[73497]:   <iothreads supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:   <os supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:     <enum name='firmware'>
Aug 26 23:08:51 user nova-compute[73497]:       <value>efi</value>
Aug 26 23:08:51 user nova-compute[73497]:     </enum>
Aug 26 23:08:51 user nova-compute[73497]:     <loader supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='type'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>rom</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>pflash</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='readonly'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>yes</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>no</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='secure'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>no</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </loader>
Aug 26 23:08:51 user nova-compute[73497]:   </os>
Aug 26 23:08:51 user nova-compute[73497]:   <cpu>
Aug 26 23:08:51 user nova-compute[73497]:     <mode name='host-passthrough' supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='hostPassthroughMigratable'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>on</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>off</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </mode>
Aug 26 23:08:51 user nova-compute[73497]:     <mode name='maximum' supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='maximumMigratable'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>on</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>off</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </mode>
Aug 26 23:08:51 user nova-compute[73497]:     <mode name='host-model' supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <vendor>Intel</vendor>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='ss'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='vmx'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='pcid'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='hypervisor'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='arat'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='umip'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='md-clear'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='stibp'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='ssbd'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='invtsc'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='ibpb'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='ibrs'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='amd-stibp'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='rsba'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='disable' name='erms'/>
Aug 26 23:08:51 user nova-compute[73497]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 23:08:51 user nova-compute[73497]:     </mode>
Aug 26 23:08:51 user nova-compute[73497]:     <mode name='custom' supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>qemu64</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>qemu32</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>phenom</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>pentium3</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>pentium2</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>pentium</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>n270</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>kvm64</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>kvm32</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>coreduo</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>core2duo</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>athlon</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>Westmere</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Snowridge</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Server</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Skylake-Client</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>SandyBridge</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>Penryn</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Opteron_G5</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Opteron_G4</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Opteron_G3</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Opteron_G2</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>Opteron_G1</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>Nehalem</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>IvyBridge</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Icelake-Server</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Haswell</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>EPYC-Rome</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>EPYC-Milan</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>EPYC</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Dhyana</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Cooperlake</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>Conroe</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='no'>Broadwell</model>
Aug 26 23:08:51 user nova-compute[73497]:       <model usable='yes'>486</model>
Aug 26 23:08:51 user nova-compute[73497]:     </mode>
Aug 26 23:08:51 user nova-compute[73497]:   </cpu>
Aug 26 23:08:51 user nova-compute[73497]:   <memoryBacking supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:     <enum name='sourceType'>
Aug 26 23:08:51 user nova-compute[73497]:       <value>file</value>
Aug 26 23:08:51 user nova-compute[73497]:       <value>anonymous</value>
Aug 26 23:08:51 user nova-compute[73497]:       <value>memfd</value>
Aug 26 23:08:51 user nova-compute[73497]:     </enum>
Aug 26 23:08:51 user nova-compute[73497]:   </memoryBacking>
Aug 26 23:08:51 user nova-compute[73497]:   <devices>
Aug 26 23:08:51 user nova-compute[73497]:     <disk supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='diskDevice'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>disk</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>cdrom</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>floppy</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>lun</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='bus'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>ide</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>fdc</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>scsi</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>usb</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>sata</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='model'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio-transitional</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio-non-transitional</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </disk>
Aug 26 23:08:51 user nova-compute[73497]:     <graphics supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='type'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>sdl</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>vnc</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>spice</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>egl-headless</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </graphics>
Aug 26 23:08:51 user nova-compute[73497]:     <video supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='modelType'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>vga</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>cirrus</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>vmvga</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>qxl</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>none</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>bochs</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>ramfb</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </video>
Aug 26 23:08:51 user nova-compute[73497]:     <hostdev supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='mode'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>subsystem</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='startupPolicy'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>default</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>mandatory</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>requisite</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>optional</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='subsysType'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>usb</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>pci</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>scsi</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='capsType'/>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='pciBackend'/>
Aug 26 23:08:51 user nova-compute[73497]:     </hostdev>
Aug 26 23:08:51 user nova-compute[73497]:     <rng supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='model'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio-transitional</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtio-non-transitional</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='backendModel'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>random</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>egd</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>builtin</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </rng>
Aug 26 23:08:51 user nova-compute[73497]:     <filesystem supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='driverType'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>path</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>handle</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>virtiofs</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </filesystem>
Aug 26 23:08:51 user nova-compute[73497]:     <tpm supported='yes'>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='model'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>tpm-tis</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>tpm-crb</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:       <enum name='backendModel'>
Aug 26 23:08:51 user nova-compute[73497]:         <value>passthrough</value>
Aug 26 23:08:51 user nova-compute[73497]:         <value>emulator</value>
Aug 26 23:08:51 user nova-compute[73497]:       </enum>
Aug 26 23:08:51 user nova-compute[73497]:     </tpm>
Aug 26 23:08:51 user nova-compute[73497]:   </devices>
Aug 26 23:08:51 user nova-compute[73497]:   <features>
Aug 26 23:08:51 user nova-compute[73497]:     <gic supported='no'/>
Aug 26 23:08:51 user nova-compute[73497]:     <vmcoreinfo supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:     <genid supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:     <backingStoreInput supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:     <backup supported='yes'/>
Aug 26 23:08:51 user nova-compute[73497]:     <sev supported='no'/>
Aug 26 23:08:51 user nova-compute[73497]:   </features>
Aug 26 23:08:51 user nova-compute[73497]: </domainCapabilities>
Aug 26 23:08:51 user nova-compute[73497]:  {{(pid=73497) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=73497) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=73497) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=73497) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=73497) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Checking secure boot support for host arch (x86_64) {{(pid=73497) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 26 23:08:51 user nova-compute[73497]: INFO nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Secure Boot support detected
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] cpu compare xml: <cpu match="exact">
Aug 26 23:08:51 user nova-compute[73497]:   <model>Nehalem</model>
Aug 26 23:08:51 user nova-compute[73497]: </cpu>
Aug 26 23:08:51 user nova-compute[73497]:  {{(pid=73497) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 26 23:08:51 user nova-compute[73497]: INFO nova.virt.node [None req-637e650d-452d-4192-8976-09f50273a439 None None] Generated node identity 10adb234-fb0d-4578-975f-a62ca871f8a1
Aug 26 23:08:51 user nova-compute[73497]: INFO nova.virt.node [None req-637e650d-452d-4192-8976-09f50273a439 None None] Wrote node identity 10adb234-fb0d-4578-975f-a62ca871f8a1 to /opt/stack/data/nova/compute_id
Aug 26 23:08:51 user nova-compute[73497]: WARNING nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] Compute nodes ['10adb234-fb0d-4578-975f-a62ca871f8a1'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 26 23:08:51 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 26 23:08:51 user nova-compute[73497]: WARNING nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 26 23:08:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-637e650d-452d-4192-8976-09f50273a439 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-637e650d-452d-4192-8976-09f50273a439 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-637e650d-452d-4192-8976-09f50273a439 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-637e650d-452d-4192-8976-09f50273a439 None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:08:51 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:08:51 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-637e650d-452d-4192-8976-09f50273a439 None None] Hypervisor/Node resource view: name=user free_ram=10866MB free_disk=26.166889190673828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-637e650d-452d-4192-8976-09f50273a439 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-637e650d-452d-4192-8976-09f50273a439 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:08:51 user nova-compute[73497]: WARNING nova.compute.resource_tracker [None req-637e650d-452d-4192-8976-09f50273a439 None None] No compute node record for user:10adb234-fb0d-4578-975f-a62ca871f8a1: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 10adb234-fb0d-4578-975f-a62ca871f8a1 could not be found.
Aug 26 23:08:51 user nova-compute[73497]: INFO nova.compute.resource_tracker [None req-637e650d-452d-4192-8976-09f50273a439 None None] Compute node record created for user:user with uuid: 10adb234-fb0d-4578-975f-a62ca871f8a1
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-637e650d-452d-4192-8976-09f50273a439 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:08:51 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-637e650d-452d-4192-8976-09f50273a439 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:08:52 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-637e650d-452d-4192-8976-09f50273a439 None None] [req-859edcb6-c6ee-4997-8125-37329fb4ae50] Created resource provider record via placement API for resource provider with UUID 10adb234-fb0d-4578-975f-a62ca871f8a1 and name user.
Aug 26 23:08:52 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=73497) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 26 23:08:52 user nova-compute[73497]: INFO nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] kernel doesn't support AMD SEV
Aug 26 23:08:52 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-637e650d-452d-4192-8976-09f50273a439 None None] Updating inventory in ProviderTree for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 23:08:52 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:08:52 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Libvirt baseline CPU <cpu>
Aug 26 23:08:52 user nova-compute[73497]:   <arch>x86_64</arch>
Aug 26 23:08:52 user nova-compute[73497]:   <model>Nehalem</model>
Aug 26 23:08:52 user nova-compute[73497]:   <vendor>Intel</vendor>
Aug 26 23:08:52 user nova-compute[73497]:   <topology sockets="6" cores="1" threads="1"/>
Aug 26 23:08:52 user nova-compute[73497]: </cpu>
Aug 26 23:08:52 user nova-compute[73497]:  {{(pid=73497) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 26 23:08:52 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-637e650d-452d-4192-8976-09f50273a439 None None] Updated inventory for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 26 23:08:52 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-637e650d-452d-4192-8976-09f50273a439 None None] Updating resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1 generation from 0 to 1 during operation: update_inventory {{(pid=73497) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 26 23:08:52 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-637e650d-452d-4192-8976-09f50273a439 None None] Updating inventory in ProviderTree for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 23:08:52 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-637e650d-452d-4192-8976-09f50273a439 None None] Updating resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1 generation from 1 to 2 during operation: update_traits {{(pid=73497) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 26 23:08:52 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-637e650d-452d-4192-8976-09f50273a439 None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:08:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-637e650d-452d-4192-8976-09f50273a439 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.635s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:08:52 user nova-compute[73497]: DEBUG nova.service [None req-637e650d-452d-4192-8976-09f50273a439 None None] Creating RPC server for service compute {{(pid=73497) start /opt/stack/nova/nova/service.py:182}}
Aug 26 23:08:52 user nova-compute[73497]: DEBUG nova.service [None req-637e650d-452d-4192-8976-09f50273a439 None None] Join ServiceGroup membership for this service compute {{(pid=73497) start /opt/stack/nova/nova/service.py:199}}
Aug 26 23:08:52 user nova-compute[73497]: DEBUG nova.servicegroup.drivers.db [None req-637e650d-452d-4192-8976-09f50273a439 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=73497) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 26 23:09:15 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_power_states {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:09:15 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:09:43 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:09:43 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:09:43 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:09:43 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Rebuilding the list of instances to heal {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 23:09:43 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Didn't find any instances for network info cache update. {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 23:09:43 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:09:43 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:09:43 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:09:43 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:09:43 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:09:43 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:09:43 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:09:43 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:09:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:09:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:09:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:09:43 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:09:43 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:09:43 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:09:43 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=10224MB free_disk=26.070606231689453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:09:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:09:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:09:43 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:09:43 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:09:43 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:09:43 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:09:43 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:09:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.215s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:10:43 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:10:43 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:10:43 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:10:43 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:10:44 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:10:44 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:10:44 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:10:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:10:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:10:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:10:44 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:10:44 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:10:44 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:10:44 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=10171MB free_disk=26.11618423461914GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:10:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:10:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:10:44 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:10:44 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:10:44 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:10:44 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:10:44 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:10:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:10:45 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:10:45 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:10:45 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Rebuilding the list of instances to heal {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 23:10:45 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Didn't find any instances for network info cache update. {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 23:10:45 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:10:45 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:10:45 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:11:43 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:11:43 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:11:44 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:11:44 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:11:44 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:11:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:11:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:11:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:11:44 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:11:44 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:11:44 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:11:44 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=10153MB free_disk=25.900859832763672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:11:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:11:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:11:44 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:11:44 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:11:44 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:11:44 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:11:44 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:11:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:11:45 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:11:46 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:11:46 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:11:46 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:11:47 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:11:47 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:11:47 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Rebuilding the list of instances to heal {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 23:11:47 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Didn't find any instances for network info cache update. {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 23:12:44 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:12:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:12:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:12:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:12:44 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:12:44 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:12:44 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:12:44 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=9463MB free_disk=25.923904418945312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:12:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:12:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:12:44 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:12:44 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:12:44 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:12:44 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:12:44 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:12:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:12:45 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:12:45 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:12:45 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:12:46 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:12:46 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:12:47 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:12:47 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:12:48 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:12:48 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:12:49 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:12:49 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:12:49 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Rebuilding the list of instances to heal {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 23:12:49 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Didn't find any instances for network info cache update. {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 23:12:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Acquiring lock "94c286f8-2ef8-401a-ac64-693efb2f5f66" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:12:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Lock "94c286f8-2ef8-401a-ac64-693efb2f5f66" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:12:50 user nova-compute[73497]: DEBUG nova.compute.manager [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:12:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:12:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:12:50 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:12:50 user nova-compute[73497]: INFO nova.compute.claims [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Claim successful on node user
Aug 26 23:12:51 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:12:51 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:12:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.341s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:12:51 user nova-compute[73497]: DEBUG nova.compute.manager [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:12:51 user nova-compute[73497]: DEBUG nova.compute.manager [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:12:51 user nova-compute[73497]: DEBUG nova.network.neutron [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:12:51 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:12:51 user nova-compute[73497]: DEBUG nova.compute.manager [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:12:51 user nova-compute[73497]: DEBUG nova.compute.manager [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:12:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:12:51 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Creating image(s)
Aug 26 23:12:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Acquiring lock "/opt/stack/data/nova/instances/94c286f8-2ef8-401a-ac64-693efb2f5f66/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:12:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Lock "/opt/stack/data/nova/instances/94c286f8-2ef8-401a-ac64-693efb2f5f66/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:12:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Lock "/opt/stack/data/nova/instances/94c286f8-2ef8-401a-ac64-693efb2f5f66/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:12:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:12:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:12:52 user nova-compute[73497]: DEBUG nova.policy [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7d9e06ee23ac4e22bd881530dd7ad36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfec25f4b56484bb2deeaeafa30ee2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:12:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981.part --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:12:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981.part --force-share --output=json" returned: 0 in 0.189s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:12:52 user nova-compute[73497]: DEBUG nova.virt.images [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] 0c532d88-7808-4cc1-8183-4c200f1ab99a was qcow2, converting to raw {{(pid=73497) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 23:12:52 user nova-compute[73497]: DEBUG nova.privsep.utils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73497) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 23:12:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981.part /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981.converted {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:12:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981.part /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981.converted" returned: 0 in 0.196s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:12:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981.converted --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:12:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:12:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.813s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:12:53 user nova-compute[73497]: INFO oslo.privsep.daemon [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpbi68335x/privsep.sock']
Aug 26 23:12:53 user sudo[82714]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpbi68335x/privsep.sock
Aug 26 23:12:53 user sudo[82714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 26 23:12:54 user nova-compute[73497]: DEBUG nova.network.neutron [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Successfully created port: aecca1b3-87bd-4db1-9c2c-112129841f10 {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:12:54 user sudo[82714]: pam_unix(sudo:session): session closed for user root
Aug 26 23:12:54 user nova-compute[73497]: INFO oslo.privsep.daemon [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Spawned new privsep daemon via rootwrap
Aug 26 23:12:54 user nova-compute[73497]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 26 23:12:54 user nova-compute[73497]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 26 23:12:54 user nova-compute[73497]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 26 23:12:54 user nova-compute[73497]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82724
Aug 26 23:12:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:12:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.186s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:12:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:12:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:12:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:12:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Acquiring lock "926f8e5c-8d8a-4f07-bf08-e60700ce4698" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:12:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Lock "926f8e5c-8d8a-4f07-bf08-e60700ce4698" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:12:55 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:12:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:12:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:12:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.169s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:12:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/94c286f8-2ef8-401a-ac64-693efb2f5f66/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:12:55 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:12:55 user nova-compute[73497]: INFO nova.compute.claims [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Claim successful on node user
Aug 26 23:12:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/94c286f8-2ef8-401a-ac64-693efb2f5f66/disk 1073741824" returned: 0 in 0.069s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:12:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:12:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:12:55 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:12:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.227s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:12:55 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Checking if we can resize image /opt/stack/data/nova/instances/94c286f8-2ef8-401a-ac64-693efb2f5f66/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:12:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94c286f8-2ef8-401a-ac64-693efb2f5f66/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:12:55 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:12:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:12:55 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:12:55 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:12:55 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:12:55 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:12:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94c286f8-2ef8-401a-ac64-693efb2f5f66/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:12:55 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Cannot resize image /opt/stack/data/nova/instances/94c286f8-2ef8-401a-ac64-693efb2f5f66/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:12:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:12:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Ensure instance console log exists: /opt/stack/data/nova/instances/94c286f8-2ef8-401a-ac64-693efb2f5f66/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:12:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:12:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:12:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:12:55 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:12:56 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:12:56 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:12:56 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Creating image(s)
Aug 26 23:12:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Acquiring lock "/opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:12:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Lock "/opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:12:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Lock "/opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:12:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:12:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.172s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:12:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:12:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:12:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:12:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.203s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:12:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:12:56 user nova-compute[73497]: DEBUG nova.policy [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c36bef36a3e4edf97f3715472689420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7402b17f71d6489c9a419ac0d73abefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:12:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk 1073741824" returned: 0 in 0.049s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:12:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:12:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:12:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "994093f0-e6b2-4c96-b259-c559ef2b1fbc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:12:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "994093f0-e6b2-4c96-b259-c559ef2b1fbc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:12:56 user nova-compute[73497]: DEBUG nova.compute.manager [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:12:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.181s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:12:56 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Checking if we can resize image /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:12:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:12:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:12:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:12:56 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:12:56 user nova-compute[73497]: INFO nova.compute.claims [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Claim successful on node user
Aug 26 23:12:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:12:56 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Cannot resize image /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:12:56 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:12:56 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Ensure instance console log exists: /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:12:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:12:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:12:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:12:57 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:12:57 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:12:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.307s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:12:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:12:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:12:57 user nova-compute[73497]: DEBUG nova.network.neutron [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:12:57 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:12:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:12:57 user nova-compute[73497]: DEBUG nova.policy [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '83005131fdc2411abe7a198157910743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee8ef1c899342b38a624c1c28309d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:12:57 user nova-compute[73497]: DEBUG nova.network.neutron [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Successfully updated port: aecca1b3-87bd-4db1-9c2c-112129841f10 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:12:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:12:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:12:57 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Creating image(s)
Aug 26 23:12:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "/opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:12:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "/opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:12:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "/opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.029s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:12:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Acquiring lock "refresh_cache-94c286f8-2ef8-401a-ac64-693efb2f5f66" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:12:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Acquired lock "refresh_cache-94c286f8-2ef8-401a-ac64-693efb2f5f66" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:12:57 user nova-compute[73497]: DEBUG nova.network.neutron [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:12:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:12:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.188s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:12:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:12:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:12:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:12:58 user nova-compute[73497]: DEBUG nova.compute.manager [req-9ec0ae3e-f15e-4941-bf63-1100415e8e71 req-b23c5497-68e1-4940-bd0d-7657ff003777 service nova] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Received event network-changed-aecca1b3-87bd-4db1-9c2c-112129841f10 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:12:58 user nova-compute[73497]: DEBUG nova.compute.manager [req-9ec0ae3e-f15e-4941-bf63-1100415e8e71 req-b23c5497-68e1-4940-bd0d-7657ff003777 service nova] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Refreshing instance network info cache due to event network-changed-aecca1b3-87bd-4db1-9c2c-112129841f10. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:12:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9ec0ae3e-f15e-4941-bf63-1100415e8e71 req-b23c5497-68e1-4940-bd0d-7657ff003777 service nova] Acquiring lock "refresh_cache-94c286f8-2ef8-401a-ac64-693efb2f5f66" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:12:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.213s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:12:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:12:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk 1073741824" returned: 0 in 0.046s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:12:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:12:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:12:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.215s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:12:58 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Checking if we can resize image /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:12:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:12:58 user nova-compute[73497]: DEBUG nova.network.neutron [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:12:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:12:58 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Cannot resize image /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:12:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:12:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Ensure instance console log exists: /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:12:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:12:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:12:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG nova.network.neutron [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Successfully created port: 9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2 {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG nova.network.neutron [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Updating instance_info_cache with network_info: [{"id": "aecca1b3-87bd-4db1-9c2c-112129841f10", "address": "fa:16:3e:9f:f4:b7", "network": {"id": "ea7e0883-053d-42f8-9749-efc1d858f673", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2049683477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dfec25f4b56484bb2deeaeafa30ee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaecca1b3-87", "ovs_interfaceid": "aecca1b3-87bd-4db1-9c2c-112129841f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Releasing lock "refresh_cache-94c286f8-2ef8-401a-ac64-693efb2f5f66" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG nova.compute.manager [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Instance network_info: |[{"id": "aecca1b3-87bd-4db1-9c2c-112129841f10", "address": "fa:16:3e:9f:f4:b7", "network": {"id": "ea7e0883-053d-42f8-9749-efc1d858f673", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2049683477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dfec25f4b56484bb2deeaeafa30ee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaecca1b3-87", "ovs_interfaceid": "aecca1b3-87bd-4db1-9c2c-112129841f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9ec0ae3e-f15e-4941-bf63-1100415e8e71 req-b23c5497-68e1-4940-bd0d-7657ff003777 service nova] Acquired lock "refresh_cache-94c286f8-2ef8-401a-ac64-693efb2f5f66" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG nova.network.neutron [req-9ec0ae3e-f15e-4941-bf63-1100415e8e71 req-b23c5497-68e1-4940-bd0d-7657ff003777 service nova] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Refreshing network info cache for port aecca1b3-87bd-4db1-9c2c-112129841f10 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Start _get_guest_xml network_info=[{"id": "aecca1b3-87bd-4db1-9c2c-112129841f10", "address": "fa:16:3e:9f:f4:b7", "network": {"id": "ea7e0883-053d-42f8-9749-efc1d858f673", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2049683477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dfec25f4b56484bb2deeaeafa30ee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaecca1b3-87", "ovs_interfaceid": "aecca1b3-87bd-4db1-9c2c-112129841f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:13:00 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:13:00 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:13:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG nova.privsep.utils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73497) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:12:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1847347160',display_name='tempest-DeleteServersTestJSON-server-1847347160',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1847347160',id=1,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dfec25f4b56484bb2deeaeafa30ee2d',ramdisk_id='',reservation_id='r-6zvygd0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-613311809',owner_user_name='tempest-DeleteServersTestJSON-613311809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:12:51Z,user_data=None,user_id='7d9e06ee23ac4e22bd881530dd7ad36f',uuid=94c286f8-2ef8-401a-ac64-693efb2f5f66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aecca1b3-87bd-4db1-9c2c-112129841f10", "address": "fa:16:3e:9f:f4:b7", "network": {"id": "ea7e0883-053d-42f8-9749-efc1d858f673", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2049683477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dfec25f4b56484bb2deeaeafa30ee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaecca1b3-87", "ovs_interfaceid": "aecca1b3-87bd-4db1-9c2c-112129841f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Converting VIF {"id": "aecca1b3-87bd-4db1-9c2c-112129841f10", "address": "fa:16:3e:9f:f4:b7", "network": {"id": "ea7e0883-053d-42f8-9749-efc1d858f673", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2049683477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dfec25f4b56484bb2deeaeafa30ee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaecca1b3-87", "ovs_interfaceid": "aecca1b3-87bd-4db1-9c2c-112129841f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:f4:b7,bridge_name='br-int',has_traffic_filtering=True,id=aecca1b3-87bd-4db1-9c2c-112129841f10,network=Network(ea7e0883-053d-42f8-9749-efc1d858f673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaecca1b3-87') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG nova.objects.instance [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Lazy-loading 'pci_devices' on Instance uuid 94c286f8-2ef8-401a-ac64-693efb2f5f66 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:13:00 user nova-compute[73497]:   <uuid>94c286f8-2ef8-401a-ac64-693efb2f5f66</uuid>
Aug 26 23:13:00 user nova-compute[73497]:   <name>instance-00000001</name>
Aug 26 23:13:00 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:13:00 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:13:00 user nova-compute[73497]:   <metadata>
Aug 26 23:13:00 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:13:00 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:13:00 user nova-compute[73497]:       <nova:name>tempest-DeleteServersTestJSON-server-1847347160</nova:name>
Aug 26 23:13:00 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:13:00</nova:creationTime>
Aug 26 23:13:00 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:13:00 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:13:00 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:13:00 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:13:00 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:13:00 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:13:00 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:13:00 user nova-compute[73497]:       <nova:owner>
Aug 26 23:13:00 user nova-compute[73497]:         <nova:user uuid="7d9e06ee23ac4e22bd881530dd7ad36f">tempest-DeleteServersTestJSON-613311809-project-member</nova:user>
Aug 26 23:13:00 user nova-compute[73497]:         <nova:project uuid="5dfec25f4b56484bb2deeaeafa30ee2d">tempest-DeleteServersTestJSON-613311809</nova:project>
Aug 26 23:13:00 user nova-compute[73497]:       </nova:owner>
Aug 26 23:13:00 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:13:00 user nova-compute[73497]:       <nova:ports>
Aug 26 23:13:00 user nova-compute[73497]:         <nova:port uuid="aecca1b3-87bd-4db1-9c2c-112129841f10">
Aug 26 23:13:00 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 23:13:00 user nova-compute[73497]:         </nova:port>
Aug 26 23:13:00 user nova-compute[73497]:       </nova:ports>
Aug 26 23:13:00 user nova-compute[73497]:     </nova:instance>
Aug 26 23:13:00 user nova-compute[73497]:   </metadata>
Aug 26 23:13:00 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:13:00 user nova-compute[73497]:     <system>
Aug 26 23:13:00 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:13:00 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:13:00 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:13:00 user nova-compute[73497]:       <entry name="serial">94c286f8-2ef8-401a-ac64-693efb2f5f66</entry>
Aug 26 23:13:00 user nova-compute[73497]:       <entry name="uuid">94c286f8-2ef8-401a-ac64-693efb2f5f66</entry>
Aug 26 23:13:00 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:13:00 user nova-compute[73497]:     </system>
Aug 26 23:13:00 user nova-compute[73497]:   </sysinfo>
Aug 26 23:13:00 user nova-compute[73497]:   <os>
Aug 26 23:13:00 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:13:00 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:13:00 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:13:00 user nova-compute[73497]:   </os>
Aug 26 23:13:00 user nova-compute[73497]:   <features>
Aug 26 23:13:00 user nova-compute[73497]:     <acpi/>
Aug 26 23:13:00 user nova-compute[73497]:     <apic/>
Aug 26 23:13:00 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:13:00 user nova-compute[73497]:   </features>
Aug 26 23:13:00 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:13:00 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:13:00 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:13:00 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:13:00 user nova-compute[73497]:   </clock>
Aug 26 23:13:00 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:13:00 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:13:00 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:13:00 user nova-compute[73497]:   </cpu>
Aug 26 23:13:00 user nova-compute[73497]:   <devices>
Aug 26 23:13:00 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:13:00 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:13:00 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/94c286f8-2ef8-401a-ac64-693efb2f5f66/disk"/>
Aug 26 23:13:00 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:13:00 user nova-compute[73497]:     </disk>
Aug 26 23:13:00 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:13:00 user nova-compute[73497]:       <mac address="fa:16:3e:9f:f4:b7"/>
Aug 26 23:13:00 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:13:00 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:13:00 user nova-compute[73497]:       <target dev="tapaecca1b3-87"/>
Aug 26 23:13:00 user nova-compute[73497]:     </interface>
Aug 26 23:13:00 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:13:00 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/94c286f8-2ef8-401a-ac64-693efb2f5f66/console.log" append="off"/>
Aug 26 23:13:00 user nova-compute[73497]:     </serial>
Aug 26 23:13:00 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:13:00 user nova-compute[73497]:     <video>
Aug 26 23:13:00 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:13:00 user nova-compute[73497]:     </video>
Aug 26 23:13:00 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:13:00 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:13:00 user nova-compute[73497]:     </rng>
Aug 26 23:13:00 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:13:00 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:13:00 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:13:00 user nova-compute[73497]:     </memballoon>
Aug 26 23:13:00 user nova-compute[73497]:   </devices>
Aug 26 23:13:00 user nova-compute[73497]: </domain>
Aug 26 23:13:00 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:12:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1847347160',display_name='tempest-DeleteServersTestJSON-server-1847347160',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1847347160',id=1,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dfec25f4b56484bb2deeaeafa30ee2d',ramdisk_id='',reservation_id='r-6zvygd0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-613311809',owner_user_name='tempest-DeleteServersTestJSON-613311809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:12:51Z,user_data=None,user_id='7d9e06ee23ac4e22bd881530dd7ad36f',uuid=94c286f8-2ef8-401a-ac64-693efb2f5f66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aecca1b3-87bd-4db1-9c2c-112129841f10", "address": "fa:16:3e:9f:f4:b7", "network": {"id": "ea7e0883-053d-42f8-9749-efc1d858f673", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2049683477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dfec25f4b56484bb2deeaeafa30ee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaecca1b3-87", "ovs_interfaceid": "aecca1b3-87bd-4db1-9c2c-112129841f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Converting VIF {"id": "aecca1b3-87bd-4db1-9c2c-112129841f10", "address": "fa:16:3e:9f:f4:b7", "network": {"id": "ea7e0883-053d-42f8-9749-efc1d858f673", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2049683477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dfec25f4b56484bb2deeaeafa30ee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaecca1b3-87", "ovs_interfaceid": "aecca1b3-87bd-4db1-9c2c-112129841f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:f4:b7,bridge_name='br-int',has_traffic_filtering=True,id=aecca1b3-87bd-4db1-9c2c-112129841f10,network=Network(ea7e0883-053d-42f8-9749-efc1d858f673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaecca1b3-87') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG os_vif [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:f4:b7,bridge_name='br-int',has_traffic_filtering=True,id=aecca1b3-87bd-4db1-9c2c-112129841f10,network=Network(ea7e0883-053d-42f8-9749-efc1d858f673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaecca1b3-87') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Successfully created port: 400e10af-326e-4457-bf67-f7e350fd821e {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Created schema index Interface.name {{(pid=73497) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Created schema index Port.name {{(pid=73497) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Created schema index Bridge.name {{(pid=73497) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [POLLOUT] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:13:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:13:00 user nova-compute[73497]: INFO oslo.privsep.daemon [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp6t2og05l/privsep.sock']
Aug 26 23:13:00 user sudo[82839]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp6t2og05l/privsep.sock
Aug 26 23:13:00 user sudo[82839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 26 23:13:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:02 user sudo[82839]: pam_unix(sudo:session): session closed for user root
Aug 26 23:13:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:02 user nova-compute[73497]: INFO oslo.privsep.daemon [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Spawned new privsep daemon via rootwrap
Aug 26 23:13:02 user nova-compute[73497]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 26 23:13:02 user nova-compute[73497]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 26 23:13:02 user nova-compute[73497]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 26 23:13:02 user nova-compute[73497]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82870
Aug 26 23:13:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:02 user nova-compute[73497]: DEBUG nova.network.neutron [req-9ec0ae3e-f15e-4941-bf63-1100415e8e71 req-b23c5497-68e1-4940-bd0d-7657ff003777 service nova] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Updated VIF entry in instance network info cache for port aecca1b3-87bd-4db1-9c2c-112129841f10. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:13:02 user nova-compute[73497]: DEBUG nova.network.neutron [req-9ec0ae3e-f15e-4941-bf63-1100415e8e71 req-b23c5497-68e1-4940-bd0d-7657ff003777 service nova] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Updating instance_info_cache with network_info: [{"id": "aecca1b3-87bd-4db1-9c2c-112129841f10", "address": "fa:16:3e:9f:f4:b7", "network": {"id": "ea7e0883-053d-42f8-9749-efc1d858f673", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2049683477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dfec25f4b56484bb2deeaeafa30ee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaecca1b3-87", "ovs_interfaceid": "aecca1b3-87bd-4db1-9c2c-112129841f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:13:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9ec0ae3e-f15e-4941-bf63-1100415e8e71 req-b23c5497-68e1-4940-bd0d-7657ff003777 service nova] Releasing lock "refresh_cache-94c286f8-2ef8-401a-ac64-693efb2f5f66" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:13:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaecca1b3-87, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:13:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaecca1b3-87, col_values=(('external_ids', {'iface-id': 'aecca1b3-87bd-4db1-9c2c-112129841f10', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:f4:b7', 'vm-uuid': '94c286f8-2ef8-401a-ac64-693efb2f5f66'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:13:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:13:02 user nova-compute[73497]: INFO os_vif [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:f4:b7,bridge_name='br-int',has_traffic_filtering=True,id=aecca1b3-87bd-4db1-9c2c-112129841f10,network=Network(ea7e0883-053d-42f8-9749-efc1d858f673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaecca1b3-87')
Aug 26 23:13:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "171985a3-358d-4b26-a66c-372b9b99b386" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "171985a3-358d-4b26-a66c-372b9b99b386" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:13:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] No VIF found with MAC fa:16:3e:9f:f4:b7, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:13:02 user nova-compute[73497]: DEBUG nova.compute.manager [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:13:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:02 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:13:02 user nova-compute[73497]: INFO nova.compute.claims [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Claim successful on node user
Aug 26 23:13:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:03 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:13:03 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:13:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.369s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:03 user nova-compute[73497]: DEBUG nova.compute.manager [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:13:03 user nova-compute[73497]: DEBUG nova.compute.manager [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:13:03 user nova-compute[73497]: DEBUG nova.network.neutron [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:13:03 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:13:03 user nova-compute[73497]: DEBUG nova.compute.manager [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:13:03 user nova-compute[73497]: DEBUG nova.compute.manager [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:13:03 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:13:03 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Creating image(s)
Aug 26 23:13:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "/opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "/opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "/opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:03 user nova-compute[73497]: DEBUG nova.policy [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '935b8635557949cfba9b6528b97da95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c212cbb083450ea15ec54a96f12510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:13:03 user nova-compute[73497]: DEBUG nova.network.neutron [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Successfully updated port: 9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:13:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "refresh_cache-994093f0-e6b2-4c96-b259-c559ef2b1fbc" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:13:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquired lock "refresh_cache-994093f0-e6b2-4c96-b259-c559ef2b1fbc" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:13:03 user nova-compute[73497]: DEBUG nova.network.neutron [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:13:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.224s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.189s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk 1073741824" returned: 0 in 0.069s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:04 user nova-compute[73497]: DEBUG nova.compute.manager [req-6f7bce36-c808-4426-9d72-7c605ae0295d req-bb1c2412-f0ca-461b-acde-59074d76d3a8 service nova] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Received event network-changed-9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:13:04 user nova-compute[73497]: DEBUG nova.compute.manager [req-6f7bce36-c808-4426-9d72-7c605ae0295d req-bb1c2412-f0ca-461b-acde-59074d76d3a8 service nova] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Refreshing instance network info cache due to event network-changed-9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:13:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6f7bce36-c808-4426-9d72-7c605ae0295d req-bb1c2412-f0ca-461b-acde-59074d76d3a8 service nova] Acquiring lock "refresh_cache-994093f0-e6b2-4c96-b259-c559ef2b1fbc" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:13:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.237s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:04 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Checking if we can resize image /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:13:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:04 user nova-compute[73497]: DEBUG nova.network.neutron [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:13:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:04 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Cannot resize image /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:13:04 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:13:04 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Ensure instance console log exists: /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:13:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:04 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Successfully updated port: 400e10af-326e-4457-bf67-f7e350fd821e {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:13:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Acquiring lock "refresh_cache-926f8e5c-8d8a-4f07-bf08-e60700ce4698" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:13:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Acquired lock "refresh_cache-926f8e5c-8d8a-4f07-bf08-e60700ce4698" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:13:04 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:13:04 user nova-compute[73497]: DEBUG nova.compute.manager [req-94c42527-acd1-415d-bab4-20fcdc28fa54 req-9d5fc0c1-9eb5-400e-a68d-c3e5364b42e7 service nova] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Received event network-changed-400e10af-326e-4457-bf67-f7e350fd821e {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:13:04 user nova-compute[73497]: DEBUG nova.compute.manager [req-94c42527-acd1-415d-bab4-20fcdc28fa54 req-9d5fc0c1-9eb5-400e-a68d-c3e5364b42e7 service nova] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Refreshing instance network info cache due to event network-changed-400e10af-326e-4457-bf67-f7e350fd821e. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:13:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-94c42527-acd1-415d-bab4-20fcdc28fa54 req-9d5fc0c1-9eb5-400e-a68d-c3e5364b42e7 service nova] Acquiring lock "refresh_cache-926f8e5c-8d8a-4f07-bf08-e60700ce4698" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:13:04 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG nova.network.neutron [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Updating instance_info_cache with network_info: [{"id": "9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2", "address": "fa:16:3e:b8:5f:1d", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b0aca2b-85", "ovs_interfaceid": "9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Releasing lock "refresh_cache-994093f0-e6b2-4c96-b259-c559ef2b1fbc" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG nova.compute.manager [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Instance network_info: |[{"id": "9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2", "address": "fa:16:3e:b8:5f:1d", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b0aca2b-85", "ovs_interfaceid": "9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6f7bce36-c808-4426-9d72-7c605ae0295d req-bb1c2412-f0ca-461b-acde-59074d76d3a8 service nova] Acquired lock "refresh_cache-994093f0-e6b2-4c96-b259-c559ef2b1fbc" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG nova.network.neutron [req-6f7bce36-c808-4426-9d72-7c605ae0295d req-bb1c2412-f0ca-461b-acde-59074d76d3a8 service nova] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Refreshing network info cache for port 9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Start _get_guest_xml network_info=[{"id": "9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2", "address": "fa:16:3e:b8:5f:1d", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b0aca2b-85", "ovs_interfaceid": "9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:13:05 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:13:05 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:13:05 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-82091661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-82091661',id=3,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ee8ef1c899342b38a624c1c28309d41',ramdisk_id='',reservation_id='r-6yk75353',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1276656289',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:12:57Z,user_data=None,user_id='83005131fdc2411abe7a198157910743',uuid=994093f0-e6b2-4c96-b259-c559ef2b1fbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2", "address": "fa:16:3e:b8:5f:1d", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b0aca2b-85", "ovs_interfaceid": "9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Converting VIF {"id": "9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2", "address": "fa:16:3e:b8:5f:1d", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b0aca2b-85", "ovs_interfaceid": "9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5f:1d,bridge_name='br-int',has_traffic_filtering=True,id=9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2,network=Network(f8ba0a6b-e4fc-4236-9df3-90ffab8824fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b0aca2b-85') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG nova.objects.instance [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lazy-loading 'pci_devices' on Instance uuid 994093f0-e6b2-4c96-b259-c559ef2b1fbc {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:13:05 user nova-compute[73497]:   <uuid>994093f0-e6b2-4c96-b259-c559ef2b1fbc</uuid>
Aug 26 23:13:05 user nova-compute[73497]:   <name>instance-00000003</name>
Aug 26 23:13:05 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:13:05 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:13:05 user nova-compute[73497]:   <metadata>
Aug 26 23:13:05 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:13:05 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:13:05 user nova-compute[73497]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-82091661</nova:name>
Aug 26 23:13:05 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:13:05</nova:creationTime>
Aug 26 23:13:05 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:13:05 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:13:05 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:13:05 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:13:05 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:13:05 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:13:05 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:13:05 user nova-compute[73497]:       <nova:owner>
Aug 26 23:13:05 user nova-compute[73497]:         <nova:user uuid="83005131fdc2411abe7a198157910743">tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member</nova:user>
Aug 26 23:13:05 user nova-compute[73497]:         <nova:project uuid="3ee8ef1c899342b38a624c1c28309d41">tempest-ServerBootFromVolumeStableRescueTest-1276656289</nova:project>
Aug 26 23:13:05 user nova-compute[73497]:       </nova:owner>
Aug 26 23:13:05 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:13:05 user nova-compute[73497]:       <nova:ports>
Aug 26 23:13:05 user nova-compute[73497]:         <nova:port uuid="9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2">
Aug 26 23:13:05 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 23:13:05 user nova-compute[73497]:         </nova:port>
Aug 26 23:13:05 user nova-compute[73497]:       </nova:ports>
Aug 26 23:13:05 user nova-compute[73497]:     </nova:instance>
Aug 26 23:13:05 user nova-compute[73497]:   </metadata>
Aug 26 23:13:05 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:13:05 user nova-compute[73497]:     <system>
Aug 26 23:13:05 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:13:05 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:13:05 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:13:05 user nova-compute[73497]:       <entry name="serial">994093f0-e6b2-4c96-b259-c559ef2b1fbc</entry>
Aug 26 23:13:05 user nova-compute[73497]:       <entry name="uuid">994093f0-e6b2-4c96-b259-c559ef2b1fbc</entry>
Aug 26 23:13:05 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:13:05 user nova-compute[73497]:     </system>
Aug 26 23:13:05 user nova-compute[73497]:   </sysinfo>
Aug 26 23:13:05 user nova-compute[73497]:   <os>
Aug 26 23:13:05 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:13:05 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:13:05 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:13:05 user nova-compute[73497]:   </os>
Aug 26 23:13:05 user nova-compute[73497]:   <features>
Aug 26 23:13:05 user nova-compute[73497]:     <acpi/>
Aug 26 23:13:05 user nova-compute[73497]:     <apic/>
Aug 26 23:13:05 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:13:05 user nova-compute[73497]:   </features>
Aug 26 23:13:05 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:13:05 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:13:05 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:13:05 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:13:05 user nova-compute[73497]:   </clock>
Aug 26 23:13:05 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:13:05 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:13:05 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:13:05 user nova-compute[73497]:   </cpu>
Aug 26 23:13:05 user nova-compute[73497]:   <devices>
Aug 26 23:13:05 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:13:05 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:13:05 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk"/>
Aug 26 23:13:05 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:13:05 user nova-compute[73497]:     </disk>
Aug 26 23:13:05 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:13:05 user nova-compute[73497]:       <mac address="fa:16:3e:b8:5f:1d"/>
Aug 26 23:13:05 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:13:05 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:13:05 user nova-compute[73497]:       <target dev="tap9b0aca2b-85"/>
Aug 26 23:13:05 user nova-compute[73497]:     </interface>
Aug 26 23:13:05 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:13:05 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/console.log" append="off"/>
Aug 26 23:13:05 user nova-compute[73497]:     </serial>
Aug 26 23:13:05 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:13:05 user nova-compute[73497]:     <video>
Aug 26 23:13:05 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:13:05 user nova-compute[73497]:     </video>
Aug 26 23:13:05 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:13:05 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:13:05 user nova-compute[73497]:     </rng>
Aug 26 23:13:05 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:13:05 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:13:05 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:13:05 user nova-compute[73497]:     </memballoon>
Aug 26 23:13:05 user nova-compute[73497]:   </devices>
Aug 26 23:13:05 user nova-compute[73497]: </domain>
Aug 26 23:13:05 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-82091661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-82091661',id=3,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ee8ef1c899342b38a624c1c28309d41',ramdisk_id='',reservation_id='r-6yk75353',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1276656289',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:12:57Z,user_data=None,user_id='83005131fdc2411abe7a198157910743',uuid=994093f0-e6b2-4c96-b259-c559ef2b1fbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2", "address": "fa:16:3e:b8:5f:1d", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b0aca2b-85", "ovs_interfaceid": "9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Converting VIF {"id": "9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2", "address": "fa:16:3e:b8:5f:1d", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b0aca2b-85", "ovs_interfaceid": "9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5f:1d,bridge_name='br-int',has_traffic_filtering=True,id=9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2,network=Network(f8ba0a6b-e4fc-4236-9df3-90ffab8824fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b0aca2b-85') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG os_vif [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5f:1d,bridge_name='br-int',has_traffic_filtering=True,id=9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2,network=Network(f8ba0a6b-e4fc-4236-9df3-90ffab8824fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b0aca2b-85') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b0aca2b-85, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9b0aca2b-85, col_values=(('external_ids', {'iface-id': '9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:5f:1d', 'vm-uuid': '994093f0-e6b2-4c96-b259-c559ef2b1fbc'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:05 user nova-compute[73497]: INFO os_vif [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5f:1d,bridge_name='br-int',has_traffic_filtering=True,id=9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2,network=Network(f8ba0a6b-e4fc-4236-9df3-90ffab8824fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b0aca2b-85')
Aug 26 23:13:05 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:13:05 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] No VIF found with MAC fa:16:3e:b8:5f:1d, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.compute.manager [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091586.0446453, 94c286f8-2ef8-401a-ac64-693efb2f5f66 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:13:06 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] VM Resumed (Lifecycle Event)
Aug 26 23:13:06 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Instance spawned successfully.
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:06 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091586.0448942, 94c286f8-2ef8-401a-ac64-693efb2f5f66 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:13:06 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] VM Started (Lifecycle Event)
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:13:06 user nova-compute[73497]: INFO nova.compute.manager [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Took 14.80 seconds to spawn the instance on the hypervisor.
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.compute.manager [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:13:06 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:13:06 user nova-compute[73497]: INFO nova.compute.manager [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Took 15.67 seconds to build instance.
Aug 26 23:13:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2cee2a98-5173-45cc-9241-844a1d7b12e3 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Lock "94c286f8-2ef8-401a-ac64-693efb2f5f66" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.933s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Updating instance_info_cache with network_info: [{"id": "400e10af-326e-4457-bf67-f7e350fd821e", "address": "fa:16:3e:25:9f:76", "network": {"id": "823997b4-f108-4e9f-807b-2aa2c95f2b09", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-593185584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7402b17f71d6489c9a419ac0d73abefb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400e10af-32", "ovs_interfaceid": "400e10af-326e-4457-bf67-f7e350fd821e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Releasing lock "refresh_cache-926f8e5c-8d8a-4f07-bf08-e60700ce4698" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Instance network_info: |[{"id": "400e10af-326e-4457-bf67-f7e350fd821e", "address": "fa:16:3e:25:9f:76", "network": {"id": "823997b4-f108-4e9f-807b-2aa2c95f2b09", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-593185584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7402b17f71d6489c9a419ac0d73abefb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400e10af-32", "ovs_interfaceid": "400e10af-326e-4457-bf67-f7e350fd821e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-94c42527-acd1-415d-bab4-20fcdc28fa54 req-9d5fc0c1-9eb5-400e-a68d-c3e5364b42e7 service nova] Acquired lock "refresh_cache-926f8e5c-8d8a-4f07-bf08-e60700ce4698" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.network.neutron [req-94c42527-acd1-415d-bab4-20fcdc28fa54 req-9d5fc0c1-9eb5-400e-a68d-c3e5364b42e7 service nova] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Refreshing network info cache for port 400e10af-326e-4457-bf67-f7e350fd821e {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Start _get_guest_xml network_info=[{"id": "400e10af-326e-4457-bf67-f7e350fd821e", "address": "fa:16:3e:25:9f:76", "network": {"id": "823997b4-f108-4e9f-807b-2aa2c95f2b09", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-593185584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7402b17f71d6489c9a419ac0d73abefb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400e10af-32", "ovs_interfaceid": "400e10af-326e-4457-bf67-f7e350fd821e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:13:06 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:13:06 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:12:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-305424541',display_name='tempest-ServersNegativeTestJSON-server-305424541',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-305424541',id=2,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7402b17f71d6489c9a419ac0d73abefb',ramdisk_id='',reservation_id='r-xzn513eh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1339597493',owner_user_name='tempest-ServersNegativeTestJSON-1339597493-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:12:56Z,user_data=None,user_id='8c36bef36a3e4edf97f3715472689420',uuid=926f8e5c-8d8a-4f07-bf08-e60700ce4698,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "400e10af-326e-4457-bf67-f7e350fd821e", "address": "fa:16:3e:25:9f:76", "network": {"id": "823997b4-f108-4e9f-807b-2aa2c95f2b09", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-593185584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7402b17f71d6489c9a419ac0d73abefb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400e10af-32", "ovs_interfaceid": "400e10af-326e-4457-bf67-f7e350fd821e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Converting VIF {"id": "400e10af-326e-4457-bf67-f7e350fd821e", "address": "fa:16:3e:25:9f:76", "network": {"id": "823997b4-f108-4e9f-807b-2aa2c95f2b09", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-593185584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7402b17f71d6489c9a419ac0d73abefb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400e10af-32", "ovs_interfaceid": "400e10af-326e-4457-bf67-f7e350fd821e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:9f:76,bridge_name='br-int',has_traffic_filtering=True,id=400e10af-326e-4457-bf67-f7e350fd821e,network=Network(823997b4-f108-4e9f-807b-2aa2c95f2b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap400e10af-32') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.objects.instance [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Lazy-loading 'pci_devices' on Instance uuid 926f8e5c-8d8a-4f07-bf08-e60700ce4698 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:13:06 user nova-compute[73497]:   <uuid>926f8e5c-8d8a-4f07-bf08-e60700ce4698</uuid>
Aug 26 23:13:06 user nova-compute[73497]:   <name>instance-00000002</name>
Aug 26 23:13:06 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:13:06 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:13:06 user nova-compute[73497]:   <metadata>
Aug 26 23:13:06 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:13:06 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:13:06 user nova-compute[73497]:       <nova:name>tempest-ServersNegativeTestJSON-server-305424541</nova:name>
Aug 26 23:13:06 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:13:06</nova:creationTime>
Aug 26 23:13:06 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:13:06 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:13:06 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:13:06 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:13:06 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:13:06 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:13:06 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:13:06 user nova-compute[73497]:       <nova:owner>
Aug 26 23:13:06 user nova-compute[73497]:         <nova:user uuid="8c36bef36a3e4edf97f3715472689420">tempest-ServersNegativeTestJSON-1339597493-project-member</nova:user>
Aug 26 23:13:06 user nova-compute[73497]:         <nova:project uuid="7402b17f71d6489c9a419ac0d73abefb">tempest-ServersNegativeTestJSON-1339597493</nova:project>
Aug 26 23:13:06 user nova-compute[73497]:       </nova:owner>
Aug 26 23:13:06 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:13:06 user nova-compute[73497]:       <nova:ports>
Aug 26 23:13:06 user nova-compute[73497]:         <nova:port uuid="400e10af-326e-4457-bf67-f7e350fd821e">
Aug 26 23:13:06 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 23:13:06 user nova-compute[73497]:         </nova:port>
Aug 26 23:13:06 user nova-compute[73497]:       </nova:ports>
Aug 26 23:13:06 user nova-compute[73497]:     </nova:instance>
Aug 26 23:13:06 user nova-compute[73497]:   </metadata>
Aug 26 23:13:06 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:13:06 user nova-compute[73497]:     <system>
Aug 26 23:13:06 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:13:06 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:13:06 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:13:06 user nova-compute[73497]:       <entry name="serial">926f8e5c-8d8a-4f07-bf08-e60700ce4698</entry>
Aug 26 23:13:06 user nova-compute[73497]:       <entry name="uuid">926f8e5c-8d8a-4f07-bf08-e60700ce4698</entry>
Aug 26 23:13:06 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:13:06 user nova-compute[73497]:     </system>
Aug 26 23:13:06 user nova-compute[73497]:   </sysinfo>
Aug 26 23:13:06 user nova-compute[73497]:   <os>
Aug 26 23:13:06 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:13:06 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:13:06 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:13:06 user nova-compute[73497]:   </os>
Aug 26 23:13:06 user nova-compute[73497]:   <features>
Aug 26 23:13:06 user nova-compute[73497]:     <acpi/>
Aug 26 23:13:06 user nova-compute[73497]:     <apic/>
Aug 26 23:13:06 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:13:06 user nova-compute[73497]:   </features>
Aug 26 23:13:06 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:13:06 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:13:06 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:13:06 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:13:06 user nova-compute[73497]:   </clock>
Aug 26 23:13:06 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:13:06 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:13:06 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:13:06 user nova-compute[73497]:   </cpu>
Aug 26 23:13:06 user nova-compute[73497]:   <devices>
Aug 26 23:13:06 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:13:06 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:13:06 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk"/>
Aug 26 23:13:06 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:13:06 user nova-compute[73497]:     </disk>
Aug 26 23:13:06 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:13:06 user nova-compute[73497]:       <mac address="fa:16:3e:25:9f:76"/>
Aug 26 23:13:06 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:13:06 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:13:06 user nova-compute[73497]:       <target dev="tap400e10af-32"/>
Aug 26 23:13:06 user nova-compute[73497]:     </interface>
Aug 26 23:13:06 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:13:06 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/console.log" append="off"/>
Aug 26 23:13:06 user nova-compute[73497]:     </serial>
Aug 26 23:13:06 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:13:06 user nova-compute[73497]:     <video>
Aug 26 23:13:06 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:13:06 user nova-compute[73497]:     </video>
Aug 26 23:13:06 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:13:06 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:13:06 user nova-compute[73497]:     </rng>
Aug 26 23:13:06 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:13:06 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:13:06 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:13:06 user nova-compute[73497]:     </memballoon>
Aug 26 23:13:06 user nova-compute[73497]:   </devices>
Aug 26 23:13:06 user nova-compute[73497]: </domain>
Aug 26 23:13:06 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:12:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-305424541',display_name='tempest-ServersNegativeTestJSON-server-305424541',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-305424541',id=2,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7402b17f71d6489c9a419ac0d73abefb',ramdisk_id='',reservation_id='r-xzn513eh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1339597493',owner_user_name='tempest-ServersNegativeTestJSON-1339597493-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:12:56Z,user_data=None,user_id='8c36bef36a3e4edf97f3715472689420',uuid=926f8e5c-8d8a-4f07-bf08-e60700ce4698,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "400e10af-326e-4457-bf67-f7e350fd821e", "address": "fa:16:3e:25:9f:76", "network": {"id": "823997b4-f108-4e9f-807b-2aa2c95f2b09", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-593185584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7402b17f71d6489c9a419ac0d73abefb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400e10af-32", "ovs_interfaceid": "400e10af-326e-4457-bf67-f7e350fd821e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Converting VIF {"id": "400e10af-326e-4457-bf67-f7e350fd821e", "address": "fa:16:3e:25:9f:76", "network": {"id": "823997b4-f108-4e9f-807b-2aa2c95f2b09", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-593185584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7402b17f71d6489c9a419ac0d73abefb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400e10af-32", "ovs_interfaceid": "400e10af-326e-4457-bf67-f7e350fd821e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:9f:76,bridge_name='br-int',has_traffic_filtering=True,id=400e10af-326e-4457-bf67-f7e350fd821e,network=Network(823997b4-f108-4e9f-807b-2aa2c95f2b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap400e10af-32') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG os_vif [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:9f:76,bridge_name='br-int',has_traffic_filtering=True,id=400e10af-326e-4457-bf67-f7e350fd821e,network=Network(823997b4-f108-4e9f-807b-2aa2c95f2b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap400e10af-32') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap400e10af-32, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap400e10af-32, col_values=(('external_ids', {'iface-id': '400e10af-326e-4457-bf67-f7e350fd821e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:9f:76', 'vm-uuid': '926f8e5c-8d8a-4f07-bf08-e60700ce4698'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:13:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:06 user nova-compute[73497]: INFO os_vif [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:9f:76,bridge_name='br-int',has_traffic_filtering=True,id=400e10af-326e-4457-bf67-f7e350fd821e,network=Network(823997b4-f108-4e9f-807b-2aa2c95f2b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap400e10af-32')
Aug 26 23:13:07 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:13:07 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] No VIF found with MAC fa:16:3e:25:9f:76, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:13:07 user nova-compute[73497]: DEBUG nova.network.neutron [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Successfully created port: 1772e978-02b5-4c0b-a99c-67f6c6f91d58 {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:13:07 user nova-compute[73497]: DEBUG nova.network.neutron [req-6f7bce36-c808-4426-9d72-7c605ae0295d req-bb1c2412-f0ca-461b-acde-59074d76d3a8 service nova] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Updated VIF entry in instance network info cache for port 9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:13:07 user nova-compute[73497]: DEBUG nova.network.neutron [req-6f7bce36-c808-4426-9d72-7c605ae0295d req-bb1c2412-f0ca-461b-acde-59074d76d3a8 service nova] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Updating instance_info_cache with network_info: [{"id": "9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2", "address": "fa:16:3e:b8:5f:1d", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b0aca2b-85", "ovs_interfaceid": "9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:13:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6f7bce36-c808-4426-9d72-7c605ae0295d req-bb1c2412-f0ca-461b-acde-59074d76d3a8 service nova] Releasing lock "refresh_cache-994093f0-e6b2-4c96-b259-c559ef2b1fbc" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:13:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:09 user nova-compute[73497]: DEBUG nova.network.neutron [req-94c42527-acd1-415d-bab4-20fcdc28fa54 req-9d5fc0c1-9eb5-400e-a68d-c3e5364b42e7 service nova] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Updated VIF entry in instance network info cache for port 400e10af-326e-4457-bf67-f7e350fd821e. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:13:09 user nova-compute[73497]: DEBUG nova.network.neutron [req-94c42527-acd1-415d-bab4-20fcdc28fa54 req-9d5fc0c1-9eb5-400e-a68d-c3e5364b42e7 service nova] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Updating instance_info_cache with network_info: [{"id": "400e10af-326e-4457-bf67-f7e350fd821e", "address": "fa:16:3e:25:9f:76", "network": {"id": "823997b4-f108-4e9f-807b-2aa2c95f2b09", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-593185584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7402b17f71d6489c9a419ac0d73abefb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400e10af-32", "ovs_interfaceid": "400e10af-326e-4457-bf67-f7e350fd821e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:13:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-94c42527-acd1-415d-bab4-20fcdc28fa54 req-9d5fc0c1-9eb5-400e-a68d-c3e5364b42e7 service nova] Releasing lock "refresh_cache-926f8e5c-8d8a-4f07-bf08-e60700ce4698" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:13:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:10 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:11 user nova-compute[73497]: DEBUG nova.network.neutron [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Successfully updated port: 1772e978-02b5-4c0b-a99c-67f6c6f91d58 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:13:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "refresh_cache-171985a3-358d-4b26-a66c-372b9b99b386" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:13:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquired lock "refresh_cache-171985a3-358d-4b26-a66c-372b9b99b386" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:13:11 user nova-compute[73497]: DEBUG nova.network.neutron [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:13:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:11 user nova-compute[73497]: DEBUG nova.compute.manager [req-2f93fb13-dc0b-4a9f-9cd2-984c5a526eed req-f4b19ba0-0ed7-42d0-9b1d-a019808283e1 service nova] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Received event network-changed-1772e978-02b5-4c0b-a99c-67f6c6f91d58 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:13:11 user nova-compute[73497]: DEBUG nova.compute.manager [req-2f93fb13-dc0b-4a9f-9cd2-984c5a526eed req-f4b19ba0-0ed7-42d0-9b1d-a019808283e1 service nova] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Refreshing instance network info cache due to event network-changed-1772e978-02b5-4c0b-a99c-67f6c6f91d58. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:13:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2f93fb13-dc0b-4a9f-9cd2-984c5a526eed req-f4b19ba0-0ed7-42d0-9b1d-a019808283e1 service nova] Acquiring lock "refresh_cache-171985a3-358d-4b26-a66c-372b9b99b386" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:13:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:12 user nova-compute[73497]: DEBUG nova.network.neutron [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:13:12 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091592.1944046, 926f8e5c-8d8a-4f07-bf08-e60700ce4698 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:13:12 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] VM Resumed (Lifecycle Event)
Aug 26 23:13:12 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:13:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:13:12 user nova-compute[73497]: DEBUG nova.compute.manager [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:13:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:13:12 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Instance spawned successfully.
Aug 26 23:13:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:13:12 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Instance spawned successfully.
Aug 26 23:13:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:13:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:12 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:13:12 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:13:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:12 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:13:12 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091592.1957753, 926f8e5c-8d8a-4f07-bf08-e60700ce4698 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:13:12 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] VM Started (Lifecycle Event)
Aug 26 23:13:12 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:13:12 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:13:12 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:13:12 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091592.206212, 994093f0-e6b2-4c96-b259-c559ef2b1fbc => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:13:12 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] VM Resumed (Lifecycle Event)
Aug 26 23:13:12 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:13:12 user nova-compute[73497]: INFO nova.compute.manager [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Took 16.35 seconds to spawn the instance on the hypervisor.
Aug 26 23:13:12 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:13:12 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:13:12 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:13:12 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091592.2063143, 994093f0-e6b2-4c96-b259-c559ef2b1fbc => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:13:12 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] VM Started (Lifecycle Event)
Aug 26 23:13:12 user nova-compute[73497]: INFO nova.compute.manager [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Took 14.90 seconds to spawn the instance on the hypervisor.
Aug 26 23:13:12 user nova-compute[73497]: DEBUG nova.compute.manager [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:13:12 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:13:12 user nova-compute[73497]: INFO nova.compute.manager [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Took 17.19 seconds to build instance.
Aug 26 23:13:12 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:13:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e654f4f6-e32c-4aa9-a2bd-7910505c6042 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Lock "926f8e5c-8d8a-4f07-bf08-e60700ce4698" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.330s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:12 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:13:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Acquiring lock "1a58c5e7-b4c7-4bd5-8dd1-a98492139240" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "1a58c5e7-b4c7-4bd5-8dd1-a98492139240" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:12 user nova-compute[73497]: INFO nova.compute.manager [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Took 15.94 seconds to build instance.
Aug 26 23:13:12 user nova-compute[73497]: DEBUG nova.compute.manager [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:13:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d653fe2e-cfc9-4f28-807d-b312e3d8cf5a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "994093f0-e6b2-4c96-b259-c559ef2b1fbc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.081s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:12 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:13:12 user nova-compute[73497]: INFO nova.compute.claims [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Claim successful on node user
Aug 26 23:13:13 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG nova.network.neutron [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Updating instance_info_cache with network_info: [{"id": "1772e978-02b5-4c0b-a99c-67f6c6f91d58", "address": "fa:16:3e:a7:28:86", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1772e978-02", "ovs_interfaceid": "1772e978-02b5-4c0b-a99c-67f6c6f91d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Releasing lock "refresh_cache-171985a3-358d-4b26-a66c-372b9b99b386" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG nova.compute.manager [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Instance network_info: |[{"id": "1772e978-02b5-4c0b-a99c-67f6c6f91d58", "address": "fa:16:3e:a7:28:86", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1772e978-02", "ovs_interfaceid": "1772e978-02b5-4c0b-a99c-67f6c6f91d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2f93fb13-dc0b-4a9f-9cd2-984c5a526eed req-f4b19ba0-0ed7-42d0-9b1d-a019808283e1 service nova] Acquired lock "refresh_cache-171985a3-358d-4b26-a66c-372b9b99b386" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG nova.network.neutron [req-2f93fb13-dc0b-4a9f-9cd2-984c5a526eed req-f4b19ba0-0ed7-42d0-9b1d-a019808283e1 service nova] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Refreshing network info cache for port 1772e978-02b5-4c0b-a99c-67f6c6f91d58 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Start _get_guest_xml network_info=[{"id": "1772e978-02b5-4c0b-a99c-67f6c6f91d58", "address": "fa:16:3e:a7:28:86", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1772e978-02", "ovs_interfaceid": "1772e978-02b5-4c0b-a99c-67f6c6f91d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:13:13 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:13:13 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:13:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.779s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG nova.compute.manager [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:13:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-465587333',display_name='tempest-ServerActionsTestOtherA-server-465587333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-465587333',id=4,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkEfHl6zG9yr5sr9jutwV2XJmeMlhN65J2njpgcQb6mCyEUk0cV6s9h2VdW+/plwoOss4vho5+nme8j0/zabYBtL74xkosuFNe1bIAfxbSswJHdqiCv1/r8WNi7pn3DAQ==',key_name='tempest-keypair-1008924037',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80c212cbb083450ea15ec54a96f12510',ramdisk_id='',reservation_id='r-f3kuzytx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-81910947',owner_user_name='tempest-ServerActionsTestOtherA-81910947-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:13:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='935b8635557949cfba9b6528b97da95f',uuid=171985a3-358d-4b26-a66c-372b9b99b386,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1772e978-02b5-4c0b-a99c-67f6c6f91d58", "address": "fa:16:3e:a7:28:86", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1772e978-02", "ovs_interfaceid": "1772e978-02b5-4c0b-a99c-67f6c6f91d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Converting VIF {"id": "1772e978-02b5-4c0b-a99c-67f6c6f91d58", "address": "fa:16:3e:a7:28:86", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1772e978-02", "ovs_interfaceid": "1772e978-02b5-4c0b-a99c-67f6c6f91d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:28:86,bridge_name='br-int',has_traffic_filtering=True,id=1772e978-02b5-4c0b-a99c-67f6c6f91d58,network=Network(bf99a38a-faaf-4f1e-a161-736ce9089919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1772e978-02') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG nova.objects.instance [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lazy-loading 'pci_devices' on Instance uuid 171985a3-358d-4b26-a66c-372b9b99b386 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:13:13 user nova-compute[73497]:   <uuid>171985a3-358d-4b26-a66c-372b9b99b386</uuid>
Aug 26 23:13:13 user nova-compute[73497]:   <name>instance-00000004</name>
Aug 26 23:13:13 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:13:13 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:13:13 user nova-compute[73497]:   <metadata>
Aug 26 23:13:13 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:13:13 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:13:13 user nova-compute[73497]:       <nova:name>tempest-ServerActionsTestOtherA-server-465587333</nova:name>
Aug 26 23:13:13 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:13:13</nova:creationTime>
Aug 26 23:13:13 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:13:13 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:13:13 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:13:13 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:13:13 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:13:13 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:13:13 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:13:13 user nova-compute[73497]:       <nova:owner>
Aug 26 23:13:13 user nova-compute[73497]:         <nova:user uuid="935b8635557949cfba9b6528b97da95f">tempest-ServerActionsTestOtherA-81910947-project-member</nova:user>
Aug 26 23:13:13 user nova-compute[73497]:         <nova:project uuid="80c212cbb083450ea15ec54a96f12510">tempest-ServerActionsTestOtherA-81910947</nova:project>
Aug 26 23:13:13 user nova-compute[73497]:       </nova:owner>
Aug 26 23:13:13 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:13:13 user nova-compute[73497]:       <nova:ports>
Aug 26 23:13:13 user nova-compute[73497]:         <nova:port uuid="1772e978-02b5-4c0b-a99c-67f6c6f91d58">
Aug 26 23:13:13 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 23:13:13 user nova-compute[73497]:         </nova:port>
Aug 26 23:13:13 user nova-compute[73497]:       </nova:ports>
Aug 26 23:13:13 user nova-compute[73497]:     </nova:instance>
Aug 26 23:13:13 user nova-compute[73497]:   </metadata>
Aug 26 23:13:13 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:13:13 user nova-compute[73497]:     <system>
Aug 26 23:13:13 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:13:13 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:13:13 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:13:13 user nova-compute[73497]:       <entry name="serial">171985a3-358d-4b26-a66c-372b9b99b386</entry>
Aug 26 23:13:13 user nova-compute[73497]:       <entry name="uuid">171985a3-358d-4b26-a66c-372b9b99b386</entry>
Aug 26 23:13:13 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:13:13 user nova-compute[73497]:     </system>
Aug 26 23:13:13 user nova-compute[73497]:   </sysinfo>
Aug 26 23:13:13 user nova-compute[73497]:   <os>
Aug 26 23:13:13 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:13:13 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:13:13 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:13:13 user nova-compute[73497]:   </os>
Aug 26 23:13:13 user nova-compute[73497]:   <features>
Aug 26 23:13:13 user nova-compute[73497]:     <acpi/>
Aug 26 23:13:13 user nova-compute[73497]:     <apic/>
Aug 26 23:13:13 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:13:13 user nova-compute[73497]:   </features>
Aug 26 23:13:13 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:13:13 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:13:13 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:13:13 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:13:13 user nova-compute[73497]:   </clock>
Aug 26 23:13:13 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:13:13 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:13:13 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:13:13 user nova-compute[73497]:   </cpu>
Aug 26 23:13:13 user nova-compute[73497]:   <devices>
Aug 26 23:13:13 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:13:13 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:13:13 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk"/>
Aug 26 23:13:13 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:13:13 user nova-compute[73497]:     </disk>
Aug 26 23:13:13 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:13:13 user nova-compute[73497]:       <mac address="fa:16:3e:a7:28:86"/>
Aug 26 23:13:13 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:13:13 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:13:13 user nova-compute[73497]:       <target dev="tap1772e978-02"/>
Aug 26 23:13:13 user nova-compute[73497]:     </interface>
Aug 26 23:13:13 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:13:13 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/console.log" append="off"/>
Aug 26 23:13:13 user nova-compute[73497]:     </serial>
Aug 26 23:13:13 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:13:13 user nova-compute[73497]:     <video>
Aug 26 23:13:13 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:13:13 user nova-compute[73497]:     </video>
Aug 26 23:13:13 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:13:13 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:13:13 user nova-compute[73497]:     </rng>
Aug 26 23:13:13 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:13:13 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:13:13 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:13:13 user nova-compute[73497]:     </memballoon>
Aug 26 23:13:13 user nova-compute[73497]:   </devices>
Aug 26 23:13:13 user nova-compute[73497]: </domain>
Aug 26 23:13:13 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:13:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-465587333',display_name='tempest-ServerActionsTestOtherA-server-465587333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-465587333',id=4,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkEfHl6zG9yr5sr9jutwV2XJmeMlhN65J2njpgcQb6mCyEUk0cV6s9h2VdW+/plwoOss4vho5+nme8j0/zabYBtL74xkosuFNe1bIAfxbSswJHdqiCv1/r8WNi7pn3DAQ==',key_name='tempest-keypair-1008924037',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80c212cbb083450ea15ec54a96f12510',ramdisk_id='',reservation_id='r-f3kuzytx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-81910947',owner_user_name='tempest-ServerActionsTestOtherA-81910947-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:13:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='935b8635557949cfba9b6528b97da95f',uuid=171985a3-358d-4b26-a66c-372b9b99b386,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1772e978-02b5-4c0b-a99c-67f6c6f91d58", "address": "fa:16:3e:a7:28:86", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1772e978-02", "ovs_interfaceid": "1772e978-02b5-4c0b-a99c-67f6c6f91d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Converting VIF {"id": "1772e978-02b5-4c0b-a99c-67f6c6f91d58", "address": "fa:16:3e:a7:28:86", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1772e978-02", "ovs_interfaceid": "1772e978-02b5-4c0b-a99c-67f6c6f91d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:28:86,bridge_name='br-int',has_traffic_filtering=True,id=1772e978-02b5-4c0b-a99c-67f6c6f91d58,network=Network(bf99a38a-faaf-4f1e-a161-736ce9089919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1772e978-02') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG os_vif [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:28:86,bridge_name='br-int',has_traffic_filtering=True,id=1772e978-02b5-4c0b-a99c-67f6c6f91d58,network=Network(bf99a38a-faaf-4f1e-a161-736ce9089919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1772e978-02') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1772e978-02, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1772e978-02, col_values=(('external_ids', {'iface-id': '1772e978-02b5-4c0b-a99c-67f6c6f91d58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:28:86', 'vm-uuid': '171985a3-358d-4b26-a66c-372b9b99b386'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG nova.compute.manager [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG nova.network.neutron [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:13:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:13:13 user nova-compute[73497]: INFO os_vif [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:28:86,bridge_name='br-int',has_traffic_filtering=True,id=1772e978-02b5-4c0b-a99c-67f6c6f91d58,network=Network(bf99a38a-faaf-4f1e-a161-736ce9089919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1772e978-02')
Aug 26 23:13:13 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:13:14 user nova-compute[73497]: DEBUG nova.compute.manager [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:13:14 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:13:14 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] No VIF found with MAC fa:16:3e:a7:28:86, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:13:14 user nova-compute[73497]: DEBUG nova.compute.manager [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:13:14 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:13:14 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Creating image(s)
Aug 26 23:13:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Acquiring lock "/opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "/opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "/opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:14 user nova-compute[73497]: DEBUG nova.policy [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76e923deac454ba09eb85819527eb108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546cdb5907fc494c94ea81cfcef71a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:13:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.278s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.313s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240/disk 1073741824" returned: 0 in 0.095s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.416s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.282s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:15 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:13:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:15 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Cannot resize image /opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:13:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:13:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Ensure instance console log exists: /opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:13:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:16 user nova-compute[73497]: DEBUG nova.network.neutron [req-2f93fb13-dc0b-4a9f-9cd2-984c5a526eed req-f4b19ba0-0ed7-42d0-9b1d-a019808283e1 service nova] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Updated VIF entry in instance network info cache for port 1772e978-02b5-4c0b-a99c-67f6c6f91d58. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:13:16 user nova-compute[73497]: DEBUG nova.network.neutron [req-2f93fb13-dc0b-4a9f-9cd2-984c5a526eed req-f4b19ba0-0ed7-42d0-9b1d-a019808283e1 service nova] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Updating instance_info_cache with network_info: [{"id": "1772e978-02b5-4c0b-a99c-67f6c6f91d58", "address": "fa:16:3e:a7:28:86", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1772e978-02", "ovs_interfaceid": "1772e978-02b5-4c0b-a99c-67f6c6f91d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:13:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2f93fb13-dc0b-4a9f-9cd2-984c5a526eed req-f4b19ba0-0ed7-42d0-9b1d-a019808283e1 service nova] Releasing lock "refresh_cache-171985a3-358d-4b26-a66c-372b9b99b386" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:13:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:16 user nova-compute[73497]: DEBUG nova.network.neutron [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Successfully created port: 4ee7875d-cd17-4e1e-8b9c-962eaa271398 {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:13:18 user nova-compute[73497]: DEBUG nova.compute.manager [req-f8f54a7e-a66a-4047-b22e-c5f4e4e3b473 req-1adab288-168c-46c2-a673-c54d650dbfe2 service nova] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Received event network-vif-plugged-aecca1b3-87bd-4db1-9c2c-112129841f10 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:13:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f8f54a7e-a66a-4047-b22e-c5f4e4e3b473 req-1adab288-168c-46c2-a673-c54d650dbfe2 service nova] Acquiring lock "94c286f8-2ef8-401a-ac64-693efb2f5f66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f8f54a7e-a66a-4047-b22e-c5f4e4e3b473 req-1adab288-168c-46c2-a673-c54d650dbfe2 service nova] Lock "94c286f8-2ef8-401a-ac64-693efb2f5f66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f8f54a7e-a66a-4047-b22e-c5f4e4e3b473 req-1adab288-168c-46c2-a673-c54d650dbfe2 service nova] Lock "94c286f8-2ef8-401a-ac64-693efb2f5f66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:18 user nova-compute[73497]: DEBUG nova.compute.manager [req-f8f54a7e-a66a-4047-b22e-c5f4e4e3b473 req-1adab288-168c-46c2-a673-c54d650dbfe2 service nova] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] No waiting events found dispatching network-vif-plugged-aecca1b3-87bd-4db1-9c2c-112129841f10 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:13:18 user nova-compute[73497]: WARNING nova.compute.manager [req-f8f54a7e-a66a-4047-b22e-c5f4e4e3b473 req-1adab288-168c-46c2-a673-c54d650dbfe2 service nova] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Received unexpected event network-vif-plugged-aecca1b3-87bd-4db1-9c2c-112129841f10 for instance with vm_state active and task_state None.
Aug 26 23:13:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:18 user nova-compute[73497]: DEBUG nova.network.neutron [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Successfully updated port: 4ee7875d-cd17-4e1e-8b9c-962eaa271398 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:13:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Acquiring lock "refresh_cache-1a58c5e7-b4c7-4bd5-8dd1-a98492139240" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:13:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Acquired lock "refresh_cache-1a58c5e7-b4c7-4bd5-8dd1-a98492139240" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:13:19 user nova-compute[73497]: DEBUG nova.network.neutron [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:13:19 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091599.0194023, 171985a3-358d-4b26-a66c-372b9b99b386 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:13:19 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] VM Resumed (Lifecycle Event)
Aug 26 23:13:19 user nova-compute[73497]: DEBUG nova.compute.manager [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:13:19 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:13:19 user nova-compute[73497]: DEBUG nova.compute.manager [req-6cff2e19-b349-470d-8e34-23a98837cf5b req-93526efb-f92e-43de-a070-04d6a509c7df service nova] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Received event network-changed-4ee7875d-cd17-4e1e-8b9c-962eaa271398 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:13:19 user nova-compute[73497]: DEBUG nova.compute.manager [req-6cff2e19-b349-470d-8e34-23a98837cf5b req-93526efb-f92e-43de-a070-04d6a509c7df service nova] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Refreshing instance network info cache due to event network-changed-4ee7875d-cd17-4e1e-8b9c-962eaa271398. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:13:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6cff2e19-b349-470d-8e34-23a98837cf5b req-93526efb-f92e-43de-a070-04d6a509c7df service nova] Acquiring lock "refresh_cache-1a58c5e7-b4c7-4bd5-8dd1-a98492139240" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:13:19 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:13:19 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Instance spawned successfully.
Aug 26 23:13:19 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:13:19 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:13:19 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:13:19 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091599.0464082, 171985a3-358d-4b26-a66c-372b9b99b386 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:13:19 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] VM Started (Lifecycle Event)
Aug 26 23:13:19 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:19 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:19 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:19 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:19 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:19 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:19 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:13:19 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:13:19 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:13:19 user nova-compute[73497]: INFO nova.compute.manager [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Took 15.82 seconds to spawn the instance on the hypervisor.
Aug 26 23:13:19 user nova-compute[73497]: DEBUG nova.compute.manager [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:13:19 user nova-compute[73497]: INFO nova.compute.manager [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Took 16.72 seconds to build instance.
Aug 26 23:13:19 user nova-compute[73497]: DEBUG nova.network.neutron [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:13:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-690c4602-d19d-4dad-8827-55fd9ada2e2d tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "171985a3-358d-4b26-a66c-372b9b99b386" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.884s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG nova.compute.manager [req-65869a5d-63d3-48f4-9bc9-9821b1961e25 req-3651e3a4-b697-436e-a24f-7092b053bc40 service nova] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Received event network-vif-plugged-aecca1b3-87bd-4db1-9c2c-112129841f10 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-65869a5d-63d3-48f4-9bc9-9821b1961e25 req-3651e3a4-b697-436e-a24f-7092b053bc40 service nova] Acquiring lock "94c286f8-2ef8-401a-ac64-693efb2f5f66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-65869a5d-63d3-48f4-9bc9-9821b1961e25 req-3651e3a4-b697-436e-a24f-7092b053bc40 service nova] Lock "94c286f8-2ef8-401a-ac64-693efb2f5f66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-65869a5d-63d3-48f4-9bc9-9821b1961e25 req-3651e3a4-b697-436e-a24f-7092b053bc40 service nova] Lock "94c286f8-2ef8-401a-ac64-693efb2f5f66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG nova.compute.manager [req-65869a5d-63d3-48f4-9bc9-9821b1961e25 req-3651e3a4-b697-436e-a24f-7092b053bc40 service nova] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] No waiting events found dispatching network-vif-plugged-aecca1b3-87bd-4db1-9c2c-112129841f10 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:13:20 user nova-compute[73497]: WARNING nova.compute.manager [req-65869a5d-63d3-48f4-9bc9-9821b1961e25 req-3651e3a4-b697-436e-a24f-7092b053bc40 service nova] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Received unexpected event network-vif-plugged-aecca1b3-87bd-4db1-9c2c-112129841f10 for instance with vm_state active and task_state None.
Aug 26 23:13:20 user nova-compute[73497]: DEBUG nova.network.neutron [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Updating instance_info_cache with network_info: [{"id": "4ee7875d-cd17-4e1e-8b9c-962eaa271398", "address": "fa:16:3e:2b:48:b2", "network": {"id": "4eb3bf86-7f68-4a81-90f9-f34da6231d59", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-299898849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "546cdb5907fc494c94ea81cfcef71a28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee7875d-cd", "ovs_interfaceid": "4ee7875d-cd17-4e1e-8b9c-962eaa271398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Releasing lock "refresh_cache-1a58c5e7-b4c7-4bd5-8dd1-a98492139240" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG nova.compute.manager [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Instance network_info: |[{"id": "4ee7875d-cd17-4e1e-8b9c-962eaa271398", "address": "fa:16:3e:2b:48:b2", "network": {"id": "4eb3bf86-7f68-4a81-90f9-f34da6231d59", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-299898849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "546cdb5907fc494c94ea81cfcef71a28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee7875d-cd", "ovs_interfaceid": "4ee7875d-cd17-4e1e-8b9c-962eaa271398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6cff2e19-b349-470d-8e34-23a98837cf5b req-93526efb-f92e-43de-a070-04d6a509c7df service nova] Acquired lock "refresh_cache-1a58c5e7-b4c7-4bd5-8dd1-a98492139240" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG nova.network.neutron [req-6cff2e19-b349-470d-8e34-23a98837cf5b req-93526efb-f92e-43de-a070-04d6a509c7df service nova] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Refreshing network info cache for port 4ee7875d-cd17-4e1e-8b9c-962eaa271398 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Start _get_guest_xml network_info=[{"id": "4ee7875d-cd17-4e1e-8b9c-962eaa271398", "address": "fa:16:3e:2b:48:b2", "network": {"id": "4eb3bf86-7f68-4a81-90f9-f34da6231d59", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-299898849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "546cdb5907fc494c94ea81cfcef71a28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee7875d-cd", "ovs_interfaceid": "4ee7875d-cd17-4e1e-8b9c-962eaa271398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:13:20 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:13:20 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:13:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:13:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-146515420',display_name='tempest-VolumesAdminNegativeTest-server-146515420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-146515420',id=5,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFRVtCyeTuZ42hCRxF84QXtEtiMeOlumYosXqhUJtvmGfdYXRrOu0s7FCD6IJO5hhz41rgr2MILXHa7Oz+H2gfJQIDzivNQLznkghAqgbrDXDT0coaoJ5+THVgug5iWzQ==',key_name='tempest-keypair-1911481869',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='546cdb5907fc494c94ea81cfcef71a28',ramdisk_id='',reservation_id='r-o8012xqd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1932002621',owner_user_name='tempest-VolumesAdminNegativeTest-1932002621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:13:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76e923deac454ba09eb85819527eb108',uuid=1a58c5e7-b4c7-4bd5-8dd1-a98492139240,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ee7875d-cd17-4e1e-8b9c-962eaa271398", "address": "fa:16:3e:2b:48:b2", "network": {"id": "4eb3bf86-7f68-4a81-90f9-f34da6231d59", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-299898849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "546cdb5907fc494c94ea81cfcef71a28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee7875d-cd", "ovs_interfaceid": "4ee7875d-cd17-4e1e-8b9c-962eaa271398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Converting VIF {"id": "4ee7875d-cd17-4e1e-8b9c-962eaa271398", "address": "fa:16:3e:2b:48:b2", "network": {"id": "4eb3bf86-7f68-4a81-90f9-f34da6231d59", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-299898849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "546cdb5907fc494c94ea81cfcef71a28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee7875d-cd", "ovs_interfaceid": "4ee7875d-cd17-4e1e-8b9c-962eaa271398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:48:b2,bridge_name='br-int',has_traffic_filtering=True,id=4ee7875d-cd17-4e1e-8b9c-962eaa271398,network=Network(4eb3bf86-7f68-4a81-90f9-f34da6231d59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee7875d-cd') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG nova.objects.instance [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a58c5e7-b4c7-4bd5-8dd1-a98492139240 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:13:20 user nova-compute[73497]:   <uuid>1a58c5e7-b4c7-4bd5-8dd1-a98492139240</uuid>
Aug 26 23:13:20 user nova-compute[73497]:   <name>instance-00000005</name>
Aug 26 23:13:20 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:13:20 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:13:20 user nova-compute[73497]:   <metadata>
Aug 26 23:13:20 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:13:20 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:13:20 user nova-compute[73497]:       <nova:name>tempest-VolumesAdminNegativeTest-server-146515420</nova:name>
Aug 26 23:13:20 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:13:20</nova:creationTime>
Aug 26 23:13:20 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:13:20 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:13:20 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:13:20 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:13:20 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:13:20 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:13:20 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:13:20 user nova-compute[73497]:       <nova:owner>
Aug 26 23:13:20 user nova-compute[73497]:         <nova:user uuid="76e923deac454ba09eb85819527eb108">tempest-VolumesAdminNegativeTest-1932002621-project-member</nova:user>
Aug 26 23:13:20 user nova-compute[73497]:         <nova:project uuid="546cdb5907fc494c94ea81cfcef71a28">tempest-VolumesAdminNegativeTest-1932002621</nova:project>
Aug 26 23:13:20 user nova-compute[73497]:       </nova:owner>
Aug 26 23:13:20 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:13:20 user nova-compute[73497]:       <nova:ports>
Aug 26 23:13:20 user nova-compute[73497]:         <nova:port uuid="4ee7875d-cd17-4e1e-8b9c-962eaa271398">
Aug 26 23:13:20 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 23:13:20 user nova-compute[73497]:         </nova:port>
Aug 26 23:13:20 user nova-compute[73497]:       </nova:ports>
Aug 26 23:13:20 user nova-compute[73497]:     </nova:instance>
Aug 26 23:13:20 user nova-compute[73497]:   </metadata>
Aug 26 23:13:20 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:13:20 user nova-compute[73497]:     <system>
Aug 26 23:13:20 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:13:20 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:13:20 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:13:20 user nova-compute[73497]:       <entry name="serial">1a58c5e7-b4c7-4bd5-8dd1-a98492139240</entry>
Aug 26 23:13:20 user nova-compute[73497]:       <entry name="uuid">1a58c5e7-b4c7-4bd5-8dd1-a98492139240</entry>
Aug 26 23:13:20 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:13:20 user nova-compute[73497]:     </system>
Aug 26 23:13:20 user nova-compute[73497]:   </sysinfo>
Aug 26 23:13:20 user nova-compute[73497]:   <os>
Aug 26 23:13:20 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:13:20 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:13:20 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:13:20 user nova-compute[73497]:   </os>
Aug 26 23:13:20 user nova-compute[73497]:   <features>
Aug 26 23:13:20 user nova-compute[73497]:     <acpi/>
Aug 26 23:13:20 user nova-compute[73497]:     <apic/>
Aug 26 23:13:20 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:13:20 user nova-compute[73497]:   </features>
Aug 26 23:13:20 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:13:20 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:13:20 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:13:20 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:13:20 user nova-compute[73497]:   </clock>
Aug 26 23:13:20 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:13:20 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:13:20 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:13:20 user nova-compute[73497]:   </cpu>
Aug 26 23:13:20 user nova-compute[73497]:   <devices>
Aug 26 23:13:20 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:13:20 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:13:20 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240/disk"/>
Aug 26 23:13:20 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:13:20 user nova-compute[73497]:     </disk>
Aug 26 23:13:20 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:13:20 user nova-compute[73497]:       <mac address="fa:16:3e:2b:48:b2"/>
Aug 26 23:13:20 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:13:20 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:13:20 user nova-compute[73497]:       <target dev="tap4ee7875d-cd"/>
Aug 26 23:13:20 user nova-compute[73497]:     </interface>
Aug 26 23:13:20 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:13:20 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240/console.log" append="off"/>
Aug 26 23:13:20 user nova-compute[73497]:     </serial>
Aug 26 23:13:20 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:13:20 user nova-compute[73497]:     <video>
Aug 26 23:13:20 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:13:20 user nova-compute[73497]:     </video>
Aug 26 23:13:20 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:13:20 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:13:20 user nova-compute[73497]:     </rng>
Aug 26 23:13:20 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:13:20 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:13:20 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:13:20 user nova-compute[73497]:     </memballoon>
Aug 26 23:13:20 user nova-compute[73497]:   </devices>
Aug 26 23:13:20 user nova-compute[73497]: </domain>
Aug 26 23:13:20 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:13:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-146515420',display_name='tempest-VolumesAdminNegativeTest-server-146515420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-146515420',id=5,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFRVtCyeTuZ42hCRxF84QXtEtiMeOlumYosXqhUJtvmGfdYXRrOu0s7FCD6IJO5hhz41rgr2MILXHa7Oz+H2gfJQIDzivNQLznkghAqgbrDXDT0coaoJ5+THVgug5iWzQ==',key_name='tempest-keypair-1911481869',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='546cdb5907fc494c94ea81cfcef71a28',ramdisk_id='',reservation_id='r-o8012xqd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1932002621',owner_user_name='tempest-VolumesAdminNegativeTest-1932002621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:13:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76e923deac454ba09eb85819527eb108',uuid=1a58c5e7-b4c7-4bd5-8dd1-a98492139240,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ee7875d-cd17-4e1e-8b9c-962eaa271398", "address": "fa:16:3e:2b:48:b2", "network": {"id": "4eb3bf86-7f68-4a81-90f9-f34da6231d59", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-299898849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "546cdb5907fc494c94ea81cfcef71a28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee7875d-cd", "ovs_interfaceid": "4ee7875d-cd17-4e1e-8b9c-962eaa271398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Converting VIF {"id": "4ee7875d-cd17-4e1e-8b9c-962eaa271398", "address": "fa:16:3e:2b:48:b2", "network": {"id": "4eb3bf86-7f68-4a81-90f9-f34da6231d59", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-299898849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "546cdb5907fc494c94ea81cfcef71a28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee7875d-cd", "ovs_interfaceid": "4ee7875d-cd17-4e1e-8b9c-962eaa271398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:48:b2,bridge_name='br-int',has_traffic_filtering=True,id=4ee7875d-cd17-4e1e-8b9c-962eaa271398,network=Network(4eb3bf86-7f68-4a81-90f9-f34da6231d59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee7875d-cd') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG os_vif [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:48:b2,bridge_name='br-int',has_traffic_filtering=True,id=4ee7875d-cd17-4e1e-8b9c-962eaa271398,network=Network(4eb3bf86-7f68-4a81-90f9-f34da6231d59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee7875d-cd') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ee7875d-cd, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4ee7875d-cd, col_values=(('external_ids', {'iface-id': '4ee7875d-cd17-4e1e-8b9c-962eaa271398', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:48:b2', 'vm-uuid': '1a58c5e7-b4c7-4bd5-8dd1-a98492139240'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:13:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:20 user nova-compute[73497]: INFO os_vif [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:48:b2,bridge_name='br-int',has_traffic_filtering=True,id=4ee7875d-cd17-4e1e-8b9c-962eaa271398,network=Network(4eb3bf86-7f68-4a81-90f9-f34da6231d59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee7875d-cd')
Aug 26 23:13:21 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:13:21 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] No VIF found with MAC fa:16:3e:2b:48:b2, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:13:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:21 user nova-compute[73497]: DEBUG nova.network.neutron [req-6cff2e19-b349-470d-8e34-23a98837cf5b req-93526efb-f92e-43de-a070-04d6a509c7df service nova] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Updated VIF entry in instance network info cache for port 4ee7875d-cd17-4e1e-8b9c-962eaa271398. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:13:21 user nova-compute[73497]: DEBUG nova.network.neutron [req-6cff2e19-b349-470d-8e34-23a98837cf5b req-93526efb-f92e-43de-a070-04d6a509c7df service nova] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Updating instance_info_cache with network_info: [{"id": "4ee7875d-cd17-4e1e-8b9c-962eaa271398", "address": "fa:16:3e:2b:48:b2", "network": {"id": "4eb3bf86-7f68-4a81-90f9-f34da6231d59", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-299898849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "546cdb5907fc494c94ea81cfcef71a28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee7875d-cd", "ovs_interfaceid": "4ee7875d-cd17-4e1e-8b9c-962eaa271398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:13:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6cff2e19-b349-470d-8e34-23a98837cf5b req-93526efb-f92e-43de-a070-04d6a509c7df service nova] Releasing lock "refresh_cache-1a58c5e7-b4c7-4bd5-8dd1-a98492139240" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:13:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:23 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:23 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:23 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:23 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Acquiring lock "cfdfc81c-c44a-4e43-9053-74f1fce8ca3d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Lock "cfdfc81c-c44a-4e43-9053-74f1fce8ca3d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:24 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:13:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:24 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:13:24 user nova-compute[73497]: INFO nova.compute.claims [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Claim successful on node user
Aug 26 23:13:25 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:13:25 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:13:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:25 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:13:25 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:13:25 user nova-compute[73497]: DEBUG nova.network.neutron [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:13:25 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 26 23:13:25 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:13:25 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:13:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:13:25 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Creating image(s)
Aug 26 23:13:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Acquiring lock "/opt/stack/data/nova/instances/cfdfc81c-c44a-4e43-9053-74f1fce8ca3d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Lock "/opt/stack/data/nova/instances/cfdfc81c-c44a-4e43-9053-74f1fce8ca3d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Lock "/opt/stack/data/nova/instances/cfdfc81c-c44a-4e43-9053-74f1fce8ca3d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Acquiring lock "44b98a23174cd0776d8897282861d8e40962c11c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Lock "44b98a23174cd0776d8897282861d8e40962c11c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:25 user nova-compute[73497]: DEBUG nova.compute.manager [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:13:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:13:25 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091605.707368, 1a58c5e7-b4c7-4bd5-8dd1-a98492139240 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:13:25 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] VM Resumed (Lifecycle Event)
Aug 26 23:13:25 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Instance spawned successfully.
Aug 26 23:13:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:13:25 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:13:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44b98a23174cd0776d8897282861d8e40962c11c.part --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:26 user nova-compute[73497]: INFO nova.compute.manager [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Took 12.09 seconds to spawn the instance on the hypervisor.
Aug 26 23:13:26 user nova-compute[73497]: DEBUG nova.compute.manager [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:13:26 user nova-compute[73497]: DEBUG nova.policy [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0447b57ebab64796a1de68ed821c849a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b681bf9074b4c37b9aa9cff23838b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:13:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:13:26 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:13:26 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:13:26 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091605.7080848, 1a58c5e7-b4c7-4bd5-8dd1-a98492139240 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:13:26 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] VM Started (Lifecycle Event)
Aug 26 23:13:26 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:13:26 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:13:26 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:13:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44b98a23174cd0776d8897282861d8e40962c11c.part --force-share --output=json" returned: 0 in 0.213s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:26 user nova-compute[73497]: DEBUG nova.virt.images [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] 5cc40225-7426-4e1b-8602-a165cb52d572 was qcow2, converting to raw {{(pid=73497) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 23:13:26 user nova-compute[73497]: DEBUG nova.privsep.utils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73497) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 23:13:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/44b98a23174cd0776d8897282861d8e40962c11c.part /opt/stack/data/nova/instances/_base/44b98a23174cd0776d8897282861d8e40962c11c.converted {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:26 user nova-compute[73497]: INFO nova.compute.manager [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Took 13.75 seconds to build instance.
Aug 26 23:13:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-bf5e59d3-1751-4d94-9c36-f69dfb293fb8 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "1a58c5e7-b4c7-4bd5-8dd1-a98492139240" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.933s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/44b98a23174cd0776d8897282861d8e40962c11c.part /opt/stack/data/nova/instances/_base/44b98a23174cd0776d8897282861d8e40962c11c.converted" returned: 0 in 0.354s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44b98a23174cd0776d8897282861d8e40962c11c.converted --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44b98a23174cd0776d8897282861d8e40962c11c.converted --force-share --output=json" returned: 0 in 0.225s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Lock "44b98a23174cd0776d8897282861d8e40962c11c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.442s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44b98a23174cd0776d8897282861d8e40962c11c --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Acquiring lock "ba3de574-ae62-4e9d-87f8-434c163d9897" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lock "ba3de574-ae62-4e9d-87f8-434c163d9897" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:27 user nova-compute[73497]: DEBUG nova.compute.manager [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:13:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44b98a23174cd0776d8897282861d8e40962c11c --force-share --output=json" returned: 0 in 0.240s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Acquiring lock "44b98a23174cd0776d8897282861d8e40962c11c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Lock "44b98a23174cd0776d8897282861d8e40962c11c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44b98a23174cd0776d8897282861d8e40962c11c --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:27 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:13:27 user nova-compute[73497]: INFO nova.compute.claims [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Claim successful on node user
Aug 26 23:13:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44b98a23174cd0776d8897282861d8e40962c11c --force-share --output=json" returned: 0 in 0.276s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44b98a23174cd0776d8897282861d8e40962c11c,backing_fmt=raw /opt/stack/data/nova/instances/cfdfc81c-c44a-4e43-9053-74f1fce8ca3d/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44b98a23174cd0776d8897282861d8e40962c11c,backing_fmt=raw /opt/stack/data/nova/instances/cfdfc81c-c44a-4e43-9053-74f1fce8ca3d/disk 1073741824" returned: 0 in 0.061s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Lock "44b98a23174cd0776d8897282861d8e40962c11c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.343s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44b98a23174cd0776d8897282861d8e40962c11c --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:27 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:13:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44b98a23174cd0776d8897282861d8e40962c11c --force-share --output=json" returned: 0 in 0.275s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:27 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cfdfc81c-c44a-4e43-9053-74f1fce8ca3d/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:13:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfdfc81c-c44a-4e43-9053-74f1fce8ca3d/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:28 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:13:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.779s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:28 user nova-compute[73497]: DEBUG nova.compute.manager [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:13:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfdfc81c-c44a-4e43-9053-74f1fce8ca3d/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:28 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Cannot resize image /opt/stack/data/nova/instances/cfdfc81c-c44a-4e43-9053-74f1fce8ca3d/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:13:28 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:13:28 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Ensure instance console log exists: /opt/stack/data/nova/instances/cfdfc81c-c44a-4e43-9053-74f1fce8ca3d/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:13:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:28 user nova-compute[73497]: DEBUG nova.compute.manager [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:13:28 user nova-compute[73497]: DEBUG nova.network.neutron [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:13:28 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:13:28 user nova-compute[73497]: DEBUG nova.compute.manager [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:13:28 user nova-compute[73497]: DEBUG nova.network.neutron [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Successfully created port: 11dc5742-f487-414e-b289-90a7fddccaec {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:13:28 user nova-compute[73497]: DEBUG nova.compute.manager [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:13:28 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:13:28 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Creating image(s)
Aug 26 23:13:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Acquiring lock "/opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lock "/opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lock "/opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:28 user nova-compute[73497]: DEBUG nova.policy [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a73eb19d92254c56b126c555a94c9457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456078921734435bd38b72c5266d50e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:13:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.211s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.226s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897/disk 1073741824" returned: 0 in 0.063s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.305s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.217s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:29 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:13:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:29 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Cannot resize image /opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:13:29 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:13:29 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Ensure instance console log exists: /opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:13:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:30 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:30 user nova-compute[73497]: DEBUG nova.network.neutron [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Successfully updated port: 11dc5742-f487-414e-b289-90a7fddccaec {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:13:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Acquiring lock "ab745e33-a11e-4ee4-a442-1e7893448d27" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Lock "ab745e33-a11e-4ee4-a442-1e7893448d27" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Acquiring lock "refresh_cache-cfdfc81c-c44a-4e43-9053-74f1fce8ca3d" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:13:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Acquired lock "refresh_cache-cfdfc81c-c44a-4e43-9053-74f1fce8ca3d" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:13:30 user nova-compute[73497]: DEBUG nova.network.neutron [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:13:30 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:13:30 user nova-compute[73497]: DEBUG nova.compute.manager [req-8e1d3783-d12f-4c26-9527-063ce7db4c7a req-e37a88cf-354a-4b48-8e18-764fe2874757 service nova] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Received event network-changed-11dc5742-f487-414e-b289-90a7fddccaec {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:13:30 user nova-compute[73497]: DEBUG nova.compute.manager [req-8e1d3783-d12f-4c26-9527-063ce7db4c7a req-e37a88cf-354a-4b48-8e18-764fe2874757 service nova] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Refreshing instance network info cache due to event network-changed-11dc5742-f487-414e-b289-90a7fddccaec. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:13:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8e1d3783-d12f-4c26-9527-063ce7db4c7a req-e37a88cf-354a-4b48-8e18-764fe2874757 service nova] Acquiring lock "refresh_cache-cfdfc81c-c44a-4e43-9053-74f1fce8ca3d" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:13:30 user nova-compute[73497]: DEBUG nova.network.neutron [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Successfully created port: ca3ccf3a-86b0-492c-99ae-9cdca5df9336 {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:13:30 user nova-compute[73497]: DEBUG nova.network.neutron [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:13:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:30 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:13:30 user nova-compute[73497]: INFO nova.compute.claims [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Claim successful on node user
Aug 26 23:13:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.network.neutron [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Updating instance_info_cache with network_info: [{"id": "11dc5742-f487-414e-b289-90a7fddccaec", "address": "fa:16:3e:d9:48:94", "network": {"id": "40420587-c296-4175-9bd3-81c86df22141", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-831716329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b681bf9074b4c37b9aa9cff23838b6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11dc5742-f4", "ovs_interfaceid": "11dc5742-f487-414e-b289-90a7fddccaec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Releasing lock "refresh_cache-cfdfc81c-c44a-4e43-9053-74f1fce8ca3d" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Instance network_info: |[{"id": "11dc5742-f487-414e-b289-90a7fddccaec", "address": "fa:16:3e:d9:48:94", "network": {"id": "40420587-c296-4175-9bd3-81c86df22141", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-831716329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b681bf9074b4c37b9aa9cff23838b6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11dc5742-f4", "ovs_interfaceid": "11dc5742-f487-414e-b289-90a7fddccaec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8e1d3783-d12f-4c26-9527-063ce7db4c7a req-e37a88cf-354a-4b48-8e18-764fe2874757 service nova] Acquired lock "refresh_cache-cfdfc81c-c44a-4e43-9053-74f1fce8ca3d" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.network.neutron [req-8e1d3783-d12f-4c26-9527-063ce7db4c7a req-e37a88cf-354a-4b48-8e18-764fe2874757 service nova] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Refreshing network info cache for port 11dc5742-f487-414e-b289-90a7fddccaec {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Start _get_guest_xml network_info=[{"id": "11dc5742-f487-414e-b289-90a7fddccaec", "address": "fa:16:3e:d9:48:94", "network": {"id": "40420587-c296-4175-9bd3-81c86df22141", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-831716329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b681bf9074b4c37b9aa9cff23838b6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11dc5742-f4", "ovs_interfaceid": "11dc5742-f487-414e-b289-90a7fddccaec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:13:13Z,direct_url=<?>,disk_format='qcow2',id=5cc40225-7426-4e1b-8602-a165cb52d572,min_disk=0,min_ram=0,name='',owner='960b3031aed0492193cd70d8047a6380',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:13:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'scsi', 'encrypted': False, 'device_name': '/dev/sda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '5cc40225-7426-4e1b-8602-a165cb52d572'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.713s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:13:31 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:13:31 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:13:13Z,direct_url=<?>,disk_format='qcow2',id=5cc40225-7426-4e1b-8602-a165cb52d572,min_disk=0,min_ram=0,name='',owner='960b3031aed0492193cd70d8047a6380',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:13:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:13:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-983585510',display_name='tempest-AttachSCSIVolumeTestJSON-server-983585510',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-983585510',id=6,image_ref='5cc40225-7426-4e1b-8602-a165cb52d572',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLk97rDgp4Vn23M64FLaLbKUbeqQQljd4JroX4MgytLQ9qa78Wu+3W4JqRD6oseotciaehYpNqFIouLoq2iE8bva3W0PzmsaLLt97aT+t0xyM4OJ6OrEvCE6VXOU5e0weQ==',key_name='tempest-keypair-894659020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b681bf9074b4c37b9aa9cff23838b6b',ramdisk_id='',reservation_id='r-2r3c4hhq',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5cc40225-7426-4e1b-8602-a165cb52d572',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-994485492',owner_user_name='tempest-AttachSCSIVolumeTestJSON-994485492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:13:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0447b57ebab64796a1de68ed821c849a',uuid=cfdfc81c-c44a-4e43-9053-74f1fce8ca3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11dc5742-f487-414e-b289-90a7fddccaec", "address": "fa:16:3e:d9:48:94", "network": {"id": "40420587-c296-4175-9bd3-81c86df22141", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-831716329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b681bf9074b4c37b9aa9cff23838b6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11dc5742-f4", "ovs_interfaceid": "11dc5742-f487-414e-b289-90a7fddccaec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Converting VIF {"id": "11dc5742-f487-414e-b289-90a7fddccaec", "address": "fa:16:3e:d9:48:94", "network": {"id": "40420587-c296-4175-9bd3-81c86df22141", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-831716329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b681bf9074b4c37b9aa9cff23838b6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11dc5742-f4", "ovs_interfaceid": "11dc5742-f487-414e-b289-90a7fddccaec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:48:94,bridge_name='br-int',has_traffic_filtering=True,id=11dc5742-f487-414e-b289-90a7fddccaec,network=Network(40420587-c296-4175-9bd3-81c86df22141),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11dc5742-f4') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.objects.instance [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Lazy-loading 'pci_devices' on Instance uuid cfdfc81c-c44a-4e43-9053-74f1fce8ca3d {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.network.neutron [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:31 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:13:31 user nova-compute[73497]:   <uuid>cfdfc81c-c44a-4e43-9053-74f1fce8ca3d</uuid>
Aug 26 23:13:31 user nova-compute[73497]:   <name>instance-00000006</name>
Aug 26 23:13:31 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:13:31 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:13:31 user nova-compute[73497]:   <metadata>
Aug 26 23:13:31 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:13:31 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:13:31 user nova-compute[73497]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-983585510</nova:name>
Aug 26 23:13:31 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:13:31</nova:creationTime>
Aug 26 23:13:31 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:13:31 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:13:31 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:13:31 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:13:31 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:13:31 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:13:31 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:13:31 user nova-compute[73497]:       <nova:owner>
Aug 26 23:13:31 user nova-compute[73497]:         <nova:user uuid="0447b57ebab64796a1de68ed821c849a">tempest-AttachSCSIVolumeTestJSON-994485492-project-member</nova:user>
Aug 26 23:13:31 user nova-compute[73497]:         <nova:project uuid="4b681bf9074b4c37b9aa9cff23838b6b">tempest-AttachSCSIVolumeTestJSON-994485492</nova:project>
Aug 26 23:13:31 user nova-compute[73497]:       </nova:owner>
Aug 26 23:13:31 user nova-compute[73497]:       <nova:root type="image" uuid="5cc40225-7426-4e1b-8602-a165cb52d572"/>
Aug 26 23:13:31 user nova-compute[73497]:       <nova:ports>
Aug 26 23:13:31 user nova-compute[73497]:         <nova:port uuid="11dc5742-f487-414e-b289-90a7fddccaec">
Aug 26 23:13:31 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 23:13:31 user nova-compute[73497]:         </nova:port>
Aug 26 23:13:31 user nova-compute[73497]:       </nova:ports>
Aug 26 23:13:31 user nova-compute[73497]:     </nova:instance>
Aug 26 23:13:31 user nova-compute[73497]:   </metadata>
Aug 26 23:13:31 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:13:31 user nova-compute[73497]:     <system>
Aug 26 23:13:31 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:13:31 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:13:31 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:13:31 user nova-compute[73497]:       <entry name="serial">cfdfc81c-c44a-4e43-9053-74f1fce8ca3d</entry>
Aug 26 23:13:31 user nova-compute[73497]:       <entry name="uuid">cfdfc81c-c44a-4e43-9053-74f1fce8ca3d</entry>
Aug 26 23:13:31 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:13:31 user nova-compute[73497]:     </system>
Aug 26 23:13:31 user nova-compute[73497]:   </sysinfo>
Aug 26 23:13:31 user nova-compute[73497]:   <os>
Aug 26 23:13:31 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:13:31 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:13:31 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:13:31 user nova-compute[73497]:   </os>
Aug 26 23:13:31 user nova-compute[73497]:   <features>
Aug 26 23:13:31 user nova-compute[73497]:     <acpi/>
Aug 26 23:13:31 user nova-compute[73497]:     <apic/>
Aug 26 23:13:31 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:13:31 user nova-compute[73497]:   </features>
Aug 26 23:13:31 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:13:31 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:13:31 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:13:31 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:13:31 user nova-compute[73497]:   </clock>
Aug 26 23:13:31 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:13:31 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:13:31 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:13:31 user nova-compute[73497]:   </cpu>
Aug 26 23:13:31 user nova-compute[73497]:   <devices>
Aug 26 23:13:31 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:13:31 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:13:31 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/cfdfc81c-c44a-4e43-9053-74f1fce8ca3d/disk"/>
Aug 26 23:13:31 user nova-compute[73497]:       <target dev="sda" bus="scsi"/>
Aug 26 23:13:31 user nova-compute[73497]:       <address type="drive" controller="0" unit="0"/>
Aug 26 23:13:31 user nova-compute[73497]:     </disk>
Aug 26 23:13:31 user nova-compute[73497]:     <disk type="file" device="cdrom">
Aug 26 23:13:31 user nova-compute[73497]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 23:13:31 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/cfdfc81c-c44a-4e43-9053-74f1fce8ca3d/disk.config"/>
Aug 26 23:13:31 user nova-compute[73497]:       <target dev="sdb" bus="scsi"/>
Aug 26 23:13:31 user nova-compute[73497]:       <address type="drive" controller="0" unit="1"/>
Aug 26 23:13:31 user nova-compute[73497]:     </disk>
Aug 26 23:13:31 user nova-compute[73497]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 26 23:13:31 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:13:31 user nova-compute[73497]:       <mac address="fa:16:3e:d9:48:94"/>
Aug 26 23:13:31 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:13:31 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:13:31 user nova-compute[73497]:       <target dev="tap11dc5742-f4"/>
Aug 26 23:13:31 user nova-compute[73497]:     </interface>
Aug 26 23:13:31 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:13:31 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/cfdfc81c-c44a-4e43-9053-74f1fce8ca3d/console.log" append="off"/>
Aug 26 23:13:31 user nova-compute[73497]:     </serial>
Aug 26 23:13:31 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:13:31 user nova-compute[73497]:     <video>
Aug 26 23:13:31 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:13:31 user nova-compute[73497]:     </video>
Aug 26 23:13:31 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:13:31 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:13:31 user nova-compute[73497]:     </rng>
Aug 26 23:13:31 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:13:31 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:13:31 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:13:31 user nova-compute[73497]:     </memballoon>
Aug 26 23:13:31 user nova-compute[73497]:   </devices>
Aug 26 23:13:31 user nova-compute[73497]: </domain>
Aug 26 23:13:31 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:13:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-983585510',display_name='tempest-AttachSCSIVolumeTestJSON-server-983585510',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-983585510',id=6,image_ref='5cc40225-7426-4e1b-8602-a165cb52d572',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLk97rDgp4Vn23M64FLaLbKUbeqQQljd4JroX4MgytLQ9qa78Wu+3W4JqRD6oseotciaehYpNqFIouLoq2iE8bva3W0PzmsaLLt97aT+t0xyM4OJ6OrEvCE6VXOU5e0weQ==',key_name='tempest-keypair-894659020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b681bf9074b4c37b9aa9cff23838b6b',ramdisk_id='',reservation_id='r-2r3c4hhq',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5cc40225-7426-4e1b-8602-a165cb52d572',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-994485492',owner_user_name='tempest-AttachSCSIVolumeTestJSON-994485492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:13:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0447b57ebab64796a1de68ed821c849a',uuid=cfdfc81c-c44a-4e43-9053-74f1fce8ca3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11dc5742-f487-414e-b289-90a7fddccaec", "address": "fa:16:3e:d9:48:94", "network": {"id": "40420587-c296-4175-9bd3-81c86df22141", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-831716329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b681bf9074b4c37b9aa9cff23838b6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11dc5742-f4", "ovs_interfaceid": "11dc5742-f487-414e-b289-90a7fddccaec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Converting VIF {"id": "11dc5742-f487-414e-b289-90a7fddccaec", "address": "fa:16:3e:d9:48:94", "network": {"id": "40420587-c296-4175-9bd3-81c86df22141", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-831716329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b681bf9074b4c37b9aa9cff23838b6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11dc5742-f4", "ovs_interfaceid": "11dc5742-f487-414e-b289-90a7fddccaec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:48:94,bridge_name='br-int',has_traffic_filtering=True,id=11dc5742-f487-414e-b289-90a7fddccaec,network=Network(40420587-c296-4175-9bd3-81c86df22141),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11dc5742-f4') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG os_vif [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:48:94,bridge_name='br-int',has_traffic_filtering=True,id=11dc5742-f487-414e-b289-90a7fddccaec,network=Network(40420587-c296-4175-9bd3-81c86df22141),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11dc5742-f4') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11dc5742-f4, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap11dc5742-f4, col_values=(('external_ids', {'iface-id': '11dc5742-f487-414e-b289-90a7fddccaec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:48:94', 'vm-uuid': 'cfdfc81c-c44a-4e43-9053-74f1fce8ca3d'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:31 user nova-compute[73497]: INFO os_vif [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:48:94,bridge_name='br-int',has_traffic_filtering=True,id=11dc5742-f487-414e-b289-90a7fddccaec,network=Network(40420587-c296-4175-9bd3-81c86df22141),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11dc5742-f4')
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] No BDM found with device name sda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] No VIF found with MAC fa:16:3e:d9:48:94, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:13:31 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Using config drive
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.policy [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e4acb42d22b640f09a1090d895f78dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b86400102fe46bea973847594aeb2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:13:31 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Creating image(s)
Aug 26 23:13:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Acquiring lock "/opt/stack/data/nova/instances/ab745e33-a11e-4ee4-a442-1e7893448d27/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Lock "/opt/stack/data/nova/instances/ab745e33-a11e-4ee4-a442-1e7893448d27/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Lock "/opt/stack/data/nova/instances/ab745e33-a11e-4ee4-a442-1e7893448d27/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:32 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Creating config drive at /opt/stack/data/nova/instances/cfdfc81c-c44a-4e43-9053-74f1fce8ca3d/disk.config
Aug 26 23:13:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cfdfc81c-c44a-4e43-9053-74f1fce8ca3d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpq6amujpk {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.248s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cfdfc81c-c44a-4e43-9053-74f1fce8ca3d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpq6amujpk" returned: 0 in 0.133s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.230s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/ab745e33-a11e-4ee4-a442-1e7893448d27/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:32 user nova-compute[73497]: DEBUG nova.network.neutron [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Successfully updated port: ca3ccf3a-86b0-492c-99ae-9cdca5df9336 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:13:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/ab745e33-a11e-4ee4-a442-1e7893448d27/disk 1073741824" returned: 0 in 0.079s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.316s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Acquiring lock "refresh_cache-ba3de574-ae62-4e9d-87f8-434c163d9897" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:13:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Acquired lock "refresh_cache-ba3de574-ae62-4e9d-87f8-434c163d9897" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:13:32 user nova-compute[73497]: DEBUG nova.network.neutron [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:13:32 user nova-compute[73497]: DEBUG nova.network.neutron [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:13:32 user nova-compute[73497]: DEBUG nova.network.neutron [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Successfully created port: 227712b4-3763-41dd-ab89-b42888471e7d {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:13:32 user nova-compute[73497]: DEBUG nova.network.neutron [req-8e1d3783-d12f-4c26-9527-063ce7db4c7a req-e37a88cf-354a-4b48-8e18-764fe2874757 service nova] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Updated VIF entry in instance network info cache for port 11dc5742-f487-414e-b289-90a7fddccaec. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:13:32 user nova-compute[73497]: DEBUG nova.network.neutron [req-8e1d3783-d12f-4c26-9527-063ce7db4c7a req-e37a88cf-354a-4b48-8e18-764fe2874757 service nova] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Updating instance_info_cache with network_info: [{"id": "11dc5742-f487-414e-b289-90a7fddccaec", "address": "fa:16:3e:d9:48:94", "network": {"id": "40420587-c296-4175-9bd3-81c86df22141", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-831716329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b681bf9074b4c37b9aa9cff23838b6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11dc5742-f4", "ovs_interfaceid": "11dc5742-f487-414e-b289-90a7fddccaec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:13:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.247s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:32 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ab745e33-a11e-4ee4-a442-1e7893448d27/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:13:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab745e33-a11e-4ee4-a442-1e7893448d27/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8e1d3783-d12f-4c26-9527-063ce7db4c7a req-e37a88cf-354a-4b48-8e18-764fe2874757 service nova] Releasing lock "refresh_cache-cfdfc81c-c44a-4e43-9053-74f1fce8ca3d" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:13:32 user nova-compute[73497]: DEBUG nova.compute.manager [req-924ab0ec-344e-4b71-bb54-e9b42244bcb9 req-537ccf42-51c0-4eec-a12a-173c083e79cd service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Received event network-changed-ca3ccf3a-86b0-492c-99ae-9cdca5df9336 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:13:32 user nova-compute[73497]: DEBUG nova.compute.manager [req-924ab0ec-344e-4b71-bb54-e9b42244bcb9 req-537ccf42-51c0-4eec-a12a-173c083e79cd service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Refreshing instance network info cache due to event network-changed-ca3ccf3a-86b0-492c-99ae-9cdca5df9336. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:13:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-924ab0ec-344e-4b71-bb54-e9b42244bcb9 req-537ccf42-51c0-4eec-a12a-173c083e79cd service nova] Acquiring lock "refresh_cache-ba3de574-ae62-4e9d-87f8-434c163d9897" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab745e33-a11e-4ee4-a442-1e7893448d27/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Cannot resize image /opt/stack/data/nova/instances/ab745e33-a11e-4ee4-a442-1e7893448d27/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Ensure instance console log exists: /opt/stack/data/nova/instances/ab745e33-a11e-4ee4-a442-1e7893448d27/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG nova.network.neutron [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Updating instance_info_cache with network_info: [{"id": "ca3ccf3a-86b0-492c-99ae-9cdca5df9336", "address": "fa:16:3e:48:b6:d8", "network": {"id": "ab1acb2f-a437-49f1-a450-c4001cb8a037", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1785575264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e456078921734435bd38b72c5266d50e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3ccf3a-86", "ovs_interfaceid": "ca3ccf3a-86b0-492c-99ae-9cdca5df9336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Releasing lock "refresh_cache-ba3de574-ae62-4e9d-87f8-434c163d9897" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG nova.compute.manager [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Instance network_info: |[{"id": "ca3ccf3a-86b0-492c-99ae-9cdca5df9336", "address": "fa:16:3e:48:b6:d8", "network": {"id": "ab1acb2f-a437-49f1-a450-c4001cb8a037", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1785575264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e456078921734435bd38b72c5266d50e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3ccf3a-86", "ovs_interfaceid": "ca3ccf3a-86b0-492c-99ae-9cdca5df9336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-924ab0ec-344e-4b71-bb54-e9b42244bcb9 req-537ccf42-51c0-4eec-a12a-173c083e79cd service nova] Acquired lock "refresh_cache-ba3de574-ae62-4e9d-87f8-434c163d9897" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG nova.network.neutron [req-924ab0ec-344e-4b71-bb54-e9b42244bcb9 req-537ccf42-51c0-4eec-a12a-173c083e79cd service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Refreshing network info cache for port ca3ccf3a-86b0-492c-99ae-9cdca5df9336 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Start _get_guest_xml network_info=[{"id": "ca3ccf3a-86b0-492c-99ae-9cdca5df9336", "address": "fa:16:3e:48:b6:d8", "network": {"id": "ab1acb2f-a437-49f1-a450-c4001cb8a037", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1785575264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e456078921734435bd38b72c5266d50e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3ccf3a-86", "ovs_interfaceid": "ca3ccf3a-86b0-492c-99ae-9cdca5df9336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:13:33 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:13:33 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:13:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:13:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1306226483',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1306226483',id=7,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGe8nVo8i9dIVTRdjLRLAe5YZ0C6xyesogGuomHtses/n0zpuFh2lyzmy4UGl4SR+46J+vpwNqJeLYiNhrlPlaBcbP0iXsCzU1gcnZhT083Y39OsqxeF8liKiCYtA2+jQ==',key_name='tempest-keypair-411871039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e456078921734435bd38b72c5266d50e',ramdisk_id='',reservation_id='r-hw890ap9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-200456857',owner_user_name='tempest-TaggedAttachmentsTest-200456857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:13:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a73eb19d92254c56b126c555a94c9457',uuid=ba3de574-ae62-4e9d-87f8-434c163d9897,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca3ccf3a-86b0-492c-99ae-9cdca5df9336", "address": "fa:16:3e:48:b6:d8", "network": {"id": "ab1acb2f-a437-49f1-a450-c4001cb8a037", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1785575264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e456078921734435bd38b72c5266d50e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3ccf3a-86", "ovs_interfaceid": "ca3ccf3a-86b0-492c-99ae-9cdca5df9336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Converting VIF {"id": "ca3ccf3a-86b0-492c-99ae-9cdca5df9336", "address": "fa:16:3e:48:b6:d8", "network": {"id": "ab1acb2f-a437-49f1-a450-c4001cb8a037", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1785575264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e456078921734435bd38b72c5266d50e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3ccf3a-86", "ovs_interfaceid": "ca3ccf3a-86b0-492c-99ae-9cdca5df9336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:b6:d8,bridge_name='br-int',has_traffic_filtering=True,id=ca3ccf3a-86b0-492c-99ae-9cdca5df9336,network=Network(ab1acb2f-a437-49f1-a450-c4001cb8a037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca3ccf3a-86') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG nova.objects.instance [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lazy-loading 'pci_devices' on Instance uuid ba3de574-ae62-4e9d-87f8-434c163d9897 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:13:33 user nova-compute[73497]:   <uuid>ba3de574-ae62-4e9d-87f8-434c163d9897</uuid>
Aug 26 23:13:33 user nova-compute[73497]:   <name>instance-00000007</name>
Aug 26 23:13:33 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:13:33 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:13:33 user nova-compute[73497]:   <metadata>
Aug 26 23:13:33 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:13:33 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:13:33 user nova-compute[73497]:       <nova:name>tempest-device-tagging-server-1306226483</nova:name>
Aug 26 23:13:33 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:13:33</nova:creationTime>
Aug 26 23:13:33 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:13:33 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:13:33 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:13:33 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:13:33 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:13:33 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:13:33 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:13:33 user nova-compute[73497]:       <nova:owner>
Aug 26 23:13:33 user nova-compute[73497]:         <nova:user uuid="a73eb19d92254c56b126c555a94c9457">tempest-TaggedAttachmentsTest-200456857-project-member</nova:user>
Aug 26 23:13:33 user nova-compute[73497]:         <nova:project uuid="e456078921734435bd38b72c5266d50e">tempest-TaggedAttachmentsTest-200456857</nova:project>
Aug 26 23:13:33 user nova-compute[73497]:       </nova:owner>
Aug 26 23:13:33 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:13:33 user nova-compute[73497]:       <nova:ports>
Aug 26 23:13:33 user nova-compute[73497]:         <nova:port uuid="ca3ccf3a-86b0-492c-99ae-9cdca5df9336">
Aug 26 23:13:33 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 23:13:33 user nova-compute[73497]:         </nova:port>
Aug 26 23:13:33 user nova-compute[73497]:       </nova:ports>
Aug 26 23:13:33 user nova-compute[73497]:     </nova:instance>
Aug 26 23:13:33 user nova-compute[73497]:   </metadata>
Aug 26 23:13:33 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:13:33 user nova-compute[73497]:     <system>
Aug 26 23:13:33 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:13:33 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:13:33 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:13:33 user nova-compute[73497]:       <entry name="serial">ba3de574-ae62-4e9d-87f8-434c163d9897</entry>
Aug 26 23:13:33 user nova-compute[73497]:       <entry name="uuid">ba3de574-ae62-4e9d-87f8-434c163d9897</entry>
Aug 26 23:13:33 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:13:33 user nova-compute[73497]:     </system>
Aug 26 23:13:33 user nova-compute[73497]:   </sysinfo>
Aug 26 23:13:33 user nova-compute[73497]:   <os>
Aug 26 23:13:33 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:13:33 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:13:33 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:13:33 user nova-compute[73497]:   </os>
Aug 26 23:13:33 user nova-compute[73497]:   <features>
Aug 26 23:13:33 user nova-compute[73497]:     <acpi/>
Aug 26 23:13:33 user nova-compute[73497]:     <apic/>
Aug 26 23:13:33 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:13:33 user nova-compute[73497]:   </features>
Aug 26 23:13:33 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:13:33 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:13:33 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:13:33 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:13:33 user nova-compute[73497]:   </clock>
Aug 26 23:13:33 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:13:33 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:13:33 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:13:33 user nova-compute[73497]:   </cpu>
Aug 26 23:13:33 user nova-compute[73497]:   <devices>
Aug 26 23:13:33 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:13:33 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:13:33 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897/disk"/>
Aug 26 23:13:33 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:13:33 user nova-compute[73497]:     </disk>
Aug 26 23:13:33 user nova-compute[73497]:     <disk type="file" device="cdrom">
Aug 26 23:13:33 user nova-compute[73497]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 23:13:33 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897/disk.config"/>
Aug 26 23:13:33 user nova-compute[73497]:       <target dev="hda" bus="ide"/>
Aug 26 23:13:33 user nova-compute[73497]:     </disk>
Aug 26 23:13:33 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:13:33 user nova-compute[73497]:       <mac address="fa:16:3e:48:b6:d8"/>
Aug 26 23:13:33 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:13:33 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:13:33 user nova-compute[73497]:       <target dev="tapca3ccf3a-86"/>
Aug 26 23:13:33 user nova-compute[73497]:     </interface>
Aug 26 23:13:33 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:13:33 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897/console.log" append="off"/>
Aug 26 23:13:33 user nova-compute[73497]:     </serial>
Aug 26 23:13:33 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:13:33 user nova-compute[73497]:     <video>
Aug 26 23:13:33 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:13:33 user nova-compute[73497]:     </video>
Aug 26 23:13:33 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:13:33 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:13:33 user nova-compute[73497]:     </rng>
Aug 26 23:13:33 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:13:33 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:13:33 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:13:33 user nova-compute[73497]:     </memballoon>
Aug 26 23:13:33 user nova-compute[73497]:   </devices>
Aug 26 23:13:33 user nova-compute[73497]: </domain>
Aug 26 23:13:33 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:13:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1306226483',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1306226483',id=7,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGe8nVo8i9dIVTRdjLRLAe5YZ0C6xyesogGuomHtses/n0zpuFh2lyzmy4UGl4SR+46J+vpwNqJeLYiNhrlPlaBcbP0iXsCzU1gcnZhT083Y39OsqxeF8liKiCYtA2+jQ==',key_name='tempest-keypair-411871039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e456078921734435bd38b72c5266d50e',ramdisk_id='',reservation_id='r-hw890ap9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-200456857',owner_user_name='tempest-TaggedAttachmentsTest-200456857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:13:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a73eb19d92254c56b126c555a94c9457',uuid=ba3de574-ae62-4e9d-87f8-434c163d9897,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca3ccf3a-86b0-492c-99ae-9cdca5df9336", "address": "fa:16:3e:48:b6:d8", "network": {"id": "ab1acb2f-a437-49f1-a450-c4001cb8a037", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1785575264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e456078921734435bd38b72c5266d50e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3ccf3a-86", "ovs_interfaceid": "ca3ccf3a-86b0-492c-99ae-9cdca5df9336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Converting VIF {"id": "ca3ccf3a-86b0-492c-99ae-9cdca5df9336", "address": "fa:16:3e:48:b6:d8", "network": {"id": "ab1acb2f-a437-49f1-a450-c4001cb8a037", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1785575264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e456078921734435bd38b72c5266d50e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3ccf3a-86", "ovs_interfaceid": "ca3ccf3a-86b0-492c-99ae-9cdca5df9336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:b6:d8,bridge_name='br-int',has_traffic_filtering=True,id=ca3ccf3a-86b0-492c-99ae-9cdca5df9336,network=Network(ab1acb2f-a437-49f1-a450-c4001cb8a037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca3ccf3a-86') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG os_vif [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:b6:d8,bridge_name='br-int',has_traffic_filtering=True,id=ca3ccf3a-86b0-492c-99ae-9cdca5df9336,network=Network(ab1acb2f-a437-49f1-a450-c4001cb8a037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca3ccf3a-86') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca3ccf3a-86, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapca3ccf3a-86, col_values=(('external_ids', {'iface-id': 'ca3ccf3a-86b0-492c-99ae-9cdca5df9336', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:b6:d8', 'vm-uuid': 'ba3de574-ae62-4e9d-87f8-434c163d9897'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:33 user nova-compute[73497]: INFO os_vif [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:b6:d8,bridge_name='br-int',has_traffic_filtering=True,id=ca3ccf3a-86b0-492c-99ae-9cdca5df9336,network=Network(ab1acb2f-a437-49f1-a450-c4001cb8a037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca3ccf3a-86')
Aug 26 23:13:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] No BDM found with device name hda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] No VIF found with MAC fa:16:3e:48:b6:d8, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:13:33 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Using config drive
Aug 26 23:13:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:34 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Creating config drive at /opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897/disk.config
Aug 26 23:13:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp66_4ecgs {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp66_4ecgs" returned: 0 in 0.090s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:34 user nova-compute[73497]: DEBUG nova.network.neutron [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Successfully updated port: 227712b4-3763-41dd-ab89-b42888471e7d {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:13:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Acquiring lock "refresh_cache-ab745e33-a11e-4ee4-a442-1e7893448d27" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:13:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Acquired lock "refresh_cache-ab745e33-a11e-4ee4-a442-1e7893448d27" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:13:34 user nova-compute[73497]: DEBUG nova.network.neutron [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:13:34 user nova-compute[73497]: DEBUG nova.compute.manager [req-a1264091-4052-470e-b699-ddd88199382b req-f71fb22f-f3ba-4900-b280-a15e55051bbc service nova] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Received event network-changed-227712b4-3763-41dd-ab89-b42888471e7d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:13:34 user nova-compute[73497]: DEBUG nova.compute.manager [req-a1264091-4052-470e-b699-ddd88199382b req-f71fb22f-f3ba-4900-b280-a15e55051bbc service nova] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Refreshing instance network info cache due to event network-changed-227712b4-3763-41dd-ab89-b42888471e7d. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:13:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a1264091-4052-470e-b699-ddd88199382b req-f71fb22f-f3ba-4900-b280-a15e55051bbc service nova] Acquiring lock "refresh_cache-ab745e33-a11e-4ee4-a442-1e7893448d27" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:13:34 user nova-compute[73497]: DEBUG nova.network.neutron [req-924ab0ec-344e-4b71-bb54-e9b42244bcb9 req-537ccf42-51c0-4eec-a12a-173c083e79cd service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Updated VIF entry in instance network info cache for port ca3ccf3a-86b0-492c-99ae-9cdca5df9336. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:13:34 user nova-compute[73497]: DEBUG nova.network.neutron [req-924ab0ec-344e-4b71-bb54-e9b42244bcb9 req-537ccf42-51c0-4eec-a12a-173c083e79cd service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Updating instance_info_cache with network_info: [{"id": "ca3ccf3a-86b0-492c-99ae-9cdca5df9336", "address": "fa:16:3e:48:b6:d8", "network": {"id": "ab1acb2f-a437-49f1-a450-c4001cb8a037", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1785575264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e456078921734435bd38b72c5266d50e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3ccf3a-86", "ovs_interfaceid": "ca3ccf3a-86b0-492c-99ae-9cdca5df9336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:13:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-924ab0ec-344e-4b71-bb54-e9b42244bcb9 req-537ccf42-51c0-4eec-a12a-173c083e79cd service nova] Releasing lock "refresh_cache-ba3de574-ae62-4e9d-87f8-434c163d9897" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:13:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG nova.network.neutron [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG nova.network.neutron [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Updating instance_info_cache with network_info: [{"id": "227712b4-3763-41dd-ab89-b42888471e7d", "address": "fa:16:3e:bc:5b:4b", "network": {"id": "d4bf6de0-149b-43b1-904c-1c0bcaa629f4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1964773456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b86400102fe46bea973847594aeb2f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap227712b4-37", "ovs_interfaceid": "227712b4-3763-41dd-ab89-b42888471e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Releasing lock "refresh_cache-ab745e33-a11e-4ee4-a442-1e7893448d27" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Instance network_info: |[{"id": "227712b4-3763-41dd-ab89-b42888471e7d", "address": "fa:16:3e:bc:5b:4b", "network": {"id": "d4bf6de0-149b-43b1-904c-1c0bcaa629f4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1964773456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b86400102fe46bea973847594aeb2f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap227712b4-37", "ovs_interfaceid": "227712b4-3763-41dd-ab89-b42888471e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a1264091-4052-470e-b699-ddd88199382b req-f71fb22f-f3ba-4900-b280-a15e55051bbc service nova] Acquired lock "refresh_cache-ab745e33-a11e-4ee4-a442-1e7893448d27" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG nova.network.neutron [req-a1264091-4052-470e-b699-ddd88199382b req-f71fb22f-f3ba-4900-b280-a15e55051bbc service nova] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Refreshing network info cache for port 227712b4-3763-41dd-ab89-b42888471e7d {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Start _get_guest_xml network_info=[{"id": "227712b4-3763-41dd-ab89-b42888471e7d", "address": "fa:16:3e:bc:5b:4b", "network": {"id": "d4bf6de0-149b-43b1-904c-1c0bcaa629f4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1964773456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b86400102fe46bea973847594aeb2f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap227712b4-37", "ovs_interfaceid": "227712b4-3763-41dd-ab89-b42888471e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:13:35 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:13:35 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:13:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:13:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-920335000',display_name='tempest-TestVolumeSwap-server-920335000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-920335000',id=8,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmo/S9wbuYPbStOUG13fAoNZNonxRNeLxjpw3lZeN/u7axEJtyRoDbSWqIXHpCJvLb54/pRAaSUiG6bnxcSae/huXThCTMh68URDqByQ0AIvjhhyzwWwcxIEtyE99YWqA==',key_name='tempest-keypair-1523273356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b86400102fe46bea973847594aeb2f3',ramdisk_id='',reservation_id='r-a1ks8u97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-917824940',owner_user_name='tempest-TestVolumeSwap-917824940-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:13:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4acb42d22b640f09a1090d895f78dfc',uuid=ab745e33-a11e-4ee4-a442-1e7893448d27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "227712b4-3763-41dd-ab89-b42888471e7d", "address": "fa:16:3e:bc:5b:4b", "network": {"id": "d4bf6de0-149b-43b1-904c-1c0bcaa629f4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1964773456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b86400102fe46bea973847594aeb2f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap227712b4-37", "ovs_interfaceid": "227712b4-3763-41dd-ab89-b42888471e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Converting VIF {"id": "227712b4-3763-41dd-ab89-b42888471e7d", "address": "fa:16:3e:bc:5b:4b", "network": {"id": "d4bf6de0-149b-43b1-904c-1c0bcaa629f4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1964773456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b86400102fe46bea973847594aeb2f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap227712b4-37", "ovs_interfaceid": "227712b4-3763-41dd-ab89-b42888471e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:5b:4b,bridge_name='br-int',has_traffic_filtering=True,id=227712b4-3763-41dd-ab89-b42888471e7d,network=Network(d4bf6de0-149b-43b1-904c-1c0bcaa629f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap227712b4-37') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG nova.objects.instance [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Lazy-loading 'pci_devices' on Instance uuid ab745e33-a11e-4ee4-a442-1e7893448d27 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:13:35 user nova-compute[73497]:   <uuid>ab745e33-a11e-4ee4-a442-1e7893448d27</uuid>
Aug 26 23:13:35 user nova-compute[73497]:   <name>instance-00000008</name>
Aug 26 23:13:35 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:13:35 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:13:35 user nova-compute[73497]:   <metadata>
Aug 26 23:13:35 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:13:35 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:13:35 user nova-compute[73497]:       <nova:name>tempest-TestVolumeSwap-server-920335000</nova:name>
Aug 26 23:13:35 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:13:35</nova:creationTime>
Aug 26 23:13:35 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:13:35 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:13:35 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:13:35 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:13:35 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:13:35 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:13:35 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:13:35 user nova-compute[73497]:       <nova:owner>
Aug 26 23:13:35 user nova-compute[73497]:         <nova:user uuid="e4acb42d22b640f09a1090d895f78dfc">tempest-TestVolumeSwap-917824940-project-member</nova:user>
Aug 26 23:13:35 user nova-compute[73497]:         <nova:project uuid="2b86400102fe46bea973847594aeb2f3">tempest-TestVolumeSwap-917824940</nova:project>
Aug 26 23:13:35 user nova-compute[73497]:       </nova:owner>
Aug 26 23:13:35 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:13:35 user nova-compute[73497]:       <nova:ports>
Aug 26 23:13:35 user nova-compute[73497]:         <nova:port uuid="227712b4-3763-41dd-ab89-b42888471e7d">
Aug 26 23:13:35 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 23:13:35 user nova-compute[73497]:         </nova:port>
Aug 26 23:13:35 user nova-compute[73497]:       </nova:ports>
Aug 26 23:13:35 user nova-compute[73497]:     </nova:instance>
Aug 26 23:13:35 user nova-compute[73497]:   </metadata>
Aug 26 23:13:35 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:13:35 user nova-compute[73497]:     <system>
Aug 26 23:13:35 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:13:35 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:13:35 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:13:35 user nova-compute[73497]:       <entry name="serial">ab745e33-a11e-4ee4-a442-1e7893448d27</entry>
Aug 26 23:13:35 user nova-compute[73497]:       <entry name="uuid">ab745e33-a11e-4ee4-a442-1e7893448d27</entry>
Aug 26 23:13:35 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:13:35 user nova-compute[73497]:     </system>
Aug 26 23:13:35 user nova-compute[73497]:   </sysinfo>
Aug 26 23:13:35 user nova-compute[73497]:   <os>
Aug 26 23:13:35 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:13:35 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:13:35 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:13:35 user nova-compute[73497]:   </os>
Aug 26 23:13:35 user nova-compute[73497]:   <features>
Aug 26 23:13:35 user nova-compute[73497]:     <acpi/>
Aug 26 23:13:35 user nova-compute[73497]:     <apic/>
Aug 26 23:13:35 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:13:35 user nova-compute[73497]:   </features>
Aug 26 23:13:35 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:13:35 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:13:35 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:13:35 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:13:35 user nova-compute[73497]:   </clock>
Aug 26 23:13:35 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:13:35 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:13:35 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:13:35 user nova-compute[73497]:   </cpu>
Aug 26 23:13:35 user nova-compute[73497]:   <devices>
Aug 26 23:13:35 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:13:35 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:13:35 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/ab745e33-a11e-4ee4-a442-1e7893448d27/disk"/>
Aug 26 23:13:35 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:13:35 user nova-compute[73497]:     </disk>
Aug 26 23:13:35 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:13:35 user nova-compute[73497]:       <mac address="fa:16:3e:bc:5b:4b"/>
Aug 26 23:13:35 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:13:35 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:13:35 user nova-compute[73497]:       <target dev="tap227712b4-37"/>
Aug 26 23:13:35 user nova-compute[73497]:     </interface>
Aug 26 23:13:35 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:13:35 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/ab745e33-a11e-4ee4-a442-1e7893448d27/console.log" append="off"/>
Aug 26 23:13:35 user nova-compute[73497]:     </serial>
Aug 26 23:13:35 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:13:35 user nova-compute[73497]:     <video>
Aug 26 23:13:35 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:13:35 user nova-compute[73497]:     </video>
Aug 26 23:13:35 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:13:35 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:13:35 user nova-compute[73497]:     </rng>
Aug 26 23:13:35 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:13:35 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:13:35 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:13:35 user nova-compute[73497]:     </memballoon>
Aug 26 23:13:35 user nova-compute[73497]:   </devices>
Aug 26 23:13:35 user nova-compute[73497]: </domain>
Aug 26 23:13:35 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:13:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-920335000',display_name='tempest-TestVolumeSwap-server-920335000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-920335000',id=8,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmo/S9wbuYPbStOUG13fAoNZNonxRNeLxjpw3lZeN/u7axEJtyRoDbSWqIXHpCJvLb54/pRAaSUiG6bnxcSae/huXThCTMh68URDqByQ0AIvjhhyzwWwcxIEtyE99YWqA==',key_name='tempest-keypair-1523273356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b86400102fe46bea973847594aeb2f3',ramdisk_id='',reservation_id='r-a1ks8u97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-917824940',owner_user_name='tempest-TestVolumeSwap-917824940-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:13:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4acb42d22b640f09a1090d895f78dfc',uuid=ab745e33-a11e-4ee4-a442-1e7893448d27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "227712b4-3763-41dd-ab89-b42888471e7d", "address": "fa:16:3e:bc:5b:4b", "network": {"id": "d4bf6de0-149b-43b1-904c-1c0bcaa629f4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1964773456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b86400102fe46bea973847594aeb2f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap227712b4-37", "ovs_interfaceid": "227712b4-3763-41dd-ab89-b42888471e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Converting VIF {"id": "227712b4-3763-41dd-ab89-b42888471e7d", "address": "fa:16:3e:bc:5b:4b", "network": {"id": "d4bf6de0-149b-43b1-904c-1c0bcaa629f4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1964773456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b86400102fe46bea973847594aeb2f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap227712b4-37", "ovs_interfaceid": "227712b4-3763-41dd-ab89-b42888471e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:5b:4b,bridge_name='br-int',has_traffic_filtering=True,id=227712b4-3763-41dd-ab89-b42888471e7d,network=Network(d4bf6de0-149b-43b1-904c-1c0bcaa629f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap227712b4-37') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG os_vif [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:5b:4b,bridge_name='br-int',has_traffic_filtering=True,id=227712b4-3763-41dd-ab89-b42888471e7d,network=Network(d4bf6de0-149b-43b1-904c-1c0bcaa629f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap227712b4-37') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap227712b4-37, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap227712b4-37, col_values=(('external_ids', {'iface-id': '227712b4-3763-41dd-ab89-b42888471e7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:5b:4b', 'vm-uuid': 'ab745e33-a11e-4ee4-a442-1e7893448d27'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:13:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:35 user nova-compute[73497]: INFO os_vif [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:5b:4b,bridge_name='br-int',has_traffic_filtering=True,id=227712b4-3763-41dd-ab89-b42888471e7d,network=Network(d4bf6de0-149b-43b1-904c-1c0bcaa629f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap227712b4-37')
Aug 26 23:13:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:13:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] No VIF found with MAC fa:16:3e:bc:5b:4b, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:13:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:36 user nova-compute[73497]: DEBUG nova.network.neutron [req-a1264091-4052-470e-b699-ddd88199382b req-f71fb22f-f3ba-4900-b280-a15e55051bbc service nova] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Updated VIF entry in instance network info cache for port 227712b4-3763-41dd-ab89-b42888471e7d. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:13:36 user nova-compute[73497]: DEBUG nova.network.neutron [req-a1264091-4052-470e-b699-ddd88199382b req-f71fb22f-f3ba-4900-b280-a15e55051bbc service nova] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Updating instance_info_cache with network_info: [{"id": "227712b4-3763-41dd-ab89-b42888471e7d", "address": "fa:16:3e:bc:5b:4b", "network": {"id": "d4bf6de0-149b-43b1-904c-1c0bcaa629f4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1964773456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b86400102fe46bea973847594aeb2f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap227712b4-37", "ovs_interfaceid": "227712b4-3763-41dd-ab89-b42888471e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:13:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a1264091-4052-470e-b699-ddd88199382b req-f71fb22f-f3ba-4900-b280-a15e55051bbc service nova] Releasing lock "refresh_cache-ab745e33-a11e-4ee4-a442-1e7893448d27" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:13:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:37 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091617.3624961, cfdfc81c-c44a-4e43-9053-74f1fce8ca3d => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:13:37 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] VM Resumed (Lifecycle Event)
Aug 26 23:13:37 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:13:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:13:37 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Instance spawned successfully.
Aug 26 23:13:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:13:37 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:13:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:37 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:13:37 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:13:37 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091617.3673673, cfdfc81c-c44a-4e43-9053-74f1fce8ca3d => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:13:37 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] VM Started (Lifecycle Event)
Aug 26 23:13:37 user nova-compute[73497]: INFO nova.compute.manager [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Took 11.88 seconds to spawn the instance on the hypervisor.
Aug 26 23:13:37 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:13:37 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:13:37 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:13:37 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:13:37 user nova-compute[73497]: INFO nova.compute.manager [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Took 13.03 seconds to build instance.
Aug 26 23:13:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4cc015b9-f367-4872-b518-65dca3bf29af tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Lock "cfdfc81c-c44a-4e43-9053-74f1fce8ca3d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.232s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:40 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091620.357313, ba3de574-ae62-4e9d-87f8-434c163d9897 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:13:40 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] VM Resumed (Lifecycle Event)
Aug 26 23:13:40 user nova-compute[73497]: DEBUG nova.compute.manager [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:13:40 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:13:40 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:13:40 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Instance spawned successfully.
Aug 26 23:13:40 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:13:40 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:13:40 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:13:40 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091620.3704944, ba3de574-ae62-4e9d-87f8-434c163d9897 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:13:40 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] VM Started (Lifecycle Event)
Aug 26 23:13:40 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:13:40 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:40 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:40 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:40 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:40 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:40 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:40 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:13:40 user nova-compute[73497]: DEBUG nova.compute.manager [req-f738fc39-9a63-4738-b111-2dac7f685832 req-a50bb45c-ab4b-4e42-9882-9fb68b506b5b service nova] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Received event network-vif-plugged-1772e978-02b5-4c0b-a99c-67f6c6f91d58 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:13:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f738fc39-9a63-4738-b111-2dac7f685832 req-a50bb45c-ab4b-4e42-9882-9fb68b506b5b service nova] Acquiring lock "171985a3-358d-4b26-a66c-372b9b99b386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f738fc39-9a63-4738-b111-2dac7f685832 req-a50bb45c-ab4b-4e42-9882-9fb68b506b5b service nova] Lock "171985a3-358d-4b26-a66c-372b9b99b386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f738fc39-9a63-4738-b111-2dac7f685832 req-a50bb45c-ab4b-4e42-9882-9fb68b506b5b service nova] Lock "171985a3-358d-4b26-a66c-372b9b99b386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:40 user nova-compute[73497]: DEBUG nova.compute.manager [req-f738fc39-9a63-4738-b111-2dac7f685832 req-a50bb45c-ab4b-4e42-9882-9fb68b506b5b service nova] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] No waiting events found dispatching network-vif-plugged-1772e978-02b5-4c0b-a99c-67f6c6f91d58 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:13:40 user nova-compute[73497]: WARNING nova.compute.manager [req-f738fc39-9a63-4738-b111-2dac7f685832 req-a50bb45c-ab4b-4e42-9882-9fb68b506b5b service nova] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Received unexpected event network-vif-plugged-1772e978-02b5-4c0b-a99c-67f6c6f91d58 for instance with vm_state active and task_state None.
Aug 26 23:13:40 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:13:40 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091620.660483, ab745e33-a11e-4ee4-a442-1e7893448d27 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:13:40 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] VM Resumed (Lifecycle Event)
Aug 26 23:13:40 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:13:40 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:13:40 user nova-compute[73497]: INFO nova.compute.manager [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Took 12.15 seconds to spawn the instance on the hypervisor.
Aug 26 23:13:40 user nova-compute[73497]: DEBUG nova.compute.manager [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:13:40 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:13:40 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Instance spawned successfully.
Aug 26 23:13:40 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:13:40 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:13:40 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:40 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:40 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:40 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:40 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:40 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:40 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:13:40 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091620.674386, ab745e33-a11e-4ee4-a442-1e7893448d27 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:13:40 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] VM Started (Lifecycle Event)
Aug 26 23:13:40 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:13:40 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:13:40 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:40 user nova-compute[73497]: INFO nova.compute.manager [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Took 13.58 seconds to build instance.
Aug 26 23:13:40 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:13:40 user nova-compute[73497]: INFO nova.compute.manager [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Took 8.98 seconds to spawn the instance on the hypervisor.
Aug 26 23:13:40 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:13:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d4a8a866-c1e2-4e15-8e36-48ae2cf31e55 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lock "ba3de574-ae62-4e9d-87f8-434c163d9897" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.786s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:41 user nova-compute[73497]: INFO nova.compute.manager [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Took 10.29 seconds to build instance.
Aug 26 23:13:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4b6b3199-30fd-41b6-9808-adf955a78e43 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Lock "ab745e33-a11e-4ee4-a442-1e7893448d27" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.477s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:42 user nova-compute[73497]: DEBUG nova.compute.manager [req-c4e2edd2-8466-472f-a8e3-f2998e9bbce0 req-50877504-db57-4336-8076-d5b378b5a319 service nova] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Received event network-vif-plugged-1772e978-02b5-4c0b-a99c-67f6c6f91d58 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:13:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c4e2edd2-8466-472f-a8e3-f2998e9bbce0 req-50877504-db57-4336-8076-d5b378b5a319 service nova] Acquiring lock "171985a3-358d-4b26-a66c-372b9b99b386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c4e2edd2-8466-472f-a8e3-f2998e9bbce0 req-50877504-db57-4336-8076-d5b378b5a319 service nova] Lock "171985a3-358d-4b26-a66c-372b9b99b386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c4e2edd2-8466-472f-a8e3-f2998e9bbce0 req-50877504-db57-4336-8076-d5b378b5a319 service nova] Lock "171985a3-358d-4b26-a66c-372b9b99b386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:42 user nova-compute[73497]: DEBUG nova.compute.manager [req-c4e2edd2-8466-472f-a8e3-f2998e9bbce0 req-50877504-db57-4336-8076-d5b378b5a319 service nova] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] No waiting events found dispatching network-vif-plugged-1772e978-02b5-4c0b-a99c-67f6c6f91d58 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:13:42 user nova-compute[73497]: WARNING nova.compute.manager [req-c4e2edd2-8466-472f-a8e3-f2998e9bbce0 req-50877504-db57-4336-8076-d5b378b5a319 service nova] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Received unexpected event network-vif-plugged-1772e978-02b5-4c0b-a99c-67f6c6f91d58 for instance with vm_state active and task_state None.
Aug 26 23:13:42 user nova-compute[73497]: DEBUG nova.compute.manager [req-c4e2edd2-8466-472f-a8e3-f2998e9bbce0 req-50877504-db57-4336-8076-d5b378b5a319 service nova] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Received event network-vif-plugged-4ee7875d-cd17-4e1e-8b9c-962eaa271398 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:13:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c4e2edd2-8466-472f-a8e3-f2998e9bbce0 req-50877504-db57-4336-8076-d5b378b5a319 service nova] Acquiring lock "1a58c5e7-b4c7-4bd5-8dd1-a98492139240-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c4e2edd2-8466-472f-a8e3-f2998e9bbce0 req-50877504-db57-4336-8076-d5b378b5a319 service nova] Lock "1a58c5e7-b4c7-4bd5-8dd1-a98492139240-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c4e2edd2-8466-472f-a8e3-f2998e9bbce0 req-50877504-db57-4336-8076-d5b378b5a319 service nova] Lock "1a58c5e7-b4c7-4bd5-8dd1-a98492139240-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:42 user nova-compute[73497]: DEBUG nova.compute.manager [req-c4e2edd2-8466-472f-a8e3-f2998e9bbce0 req-50877504-db57-4336-8076-d5b378b5a319 service nova] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] No waiting events found dispatching network-vif-plugged-4ee7875d-cd17-4e1e-8b9c-962eaa271398 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:13:42 user nova-compute[73497]: WARNING nova.compute.manager [req-c4e2edd2-8466-472f-a8e3-f2998e9bbce0 req-50877504-db57-4336-8076-d5b378b5a319 service nova] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Received unexpected event network-vif-plugged-4ee7875d-cd17-4e1e-8b9c-962eaa271398 for instance with vm_state active and task_state None.
Aug 26 23:13:42 user nova-compute[73497]: DEBUG nova.compute.manager [req-c4e2edd2-8466-472f-a8e3-f2998e9bbce0 req-50877504-db57-4336-8076-d5b378b5a319 service nova] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Received event network-vif-plugged-4ee7875d-cd17-4e1e-8b9c-962eaa271398 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:13:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c4e2edd2-8466-472f-a8e3-f2998e9bbce0 req-50877504-db57-4336-8076-d5b378b5a319 service nova] Acquiring lock "1a58c5e7-b4c7-4bd5-8dd1-a98492139240-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c4e2edd2-8466-472f-a8e3-f2998e9bbce0 req-50877504-db57-4336-8076-d5b378b5a319 service nova] Lock "1a58c5e7-b4c7-4bd5-8dd1-a98492139240-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c4e2edd2-8466-472f-a8e3-f2998e9bbce0 req-50877504-db57-4336-8076-d5b378b5a319 service nova] Lock "1a58c5e7-b4c7-4bd5-8dd1-a98492139240-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:42 user nova-compute[73497]: DEBUG nova.compute.manager [req-c4e2edd2-8466-472f-a8e3-f2998e9bbce0 req-50877504-db57-4336-8076-d5b378b5a319 service nova] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] No waiting events found dispatching network-vif-plugged-4ee7875d-cd17-4e1e-8b9c-962eaa271398 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:13:42 user nova-compute[73497]: WARNING nova.compute.manager [req-c4e2edd2-8466-472f-a8e3-f2998e9bbce0 req-50877504-db57-4336-8076-d5b378b5a319 service nova] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Received unexpected event network-vif-plugged-4ee7875d-cd17-4e1e-8b9c-962eaa271398 for instance with vm_state active and task_state None.
Aug 26 23:13:42 user nova-compute[73497]: DEBUG nova.compute.manager [req-c4e2edd2-8466-472f-a8e3-f2998e9bbce0 req-50877504-db57-4336-8076-d5b378b5a319 service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Received event network-vif-plugged-ca3ccf3a-86b0-492c-99ae-9cdca5df9336 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:13:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c4e2edd2-8466-472f-a8e3-f2998e9bbce0 req-50877504-db57-4336-8076-d5b378b5a319 service nova] Acquiring lock "ba3de574-ae62-4e9d-87f8-434c163d9897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c4e2edd2-8466-472f-a8e3-f2998e9bbce0 req-50877504-db57-4336-8076-d5b378b5a319 service nova] Lock "ba3de574-ae62-4e9d-87f8-434c163d9897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c4e2edd2-8466-472f-a8e3-f2998e9bbce0 req-50877504-db57-4336-8076-d5b378b5a319 service nova] Lock "ba3de574-ae62-4e9d-87f8-434c163d9897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:42 user nova-compute[73497]: DEBUG nova.compute.manager [req-c4e2edd2-8466-472f-a8e3-f2998e9bbce0 req-50877504-db57-4336-8076-d5b378b5a319 service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] No waiting events found dispatching network-vif-plugged-ca3ccf3a-86b0-492c-99ae-9cdca5df9336 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:13:42 user nova-compute[73497]: WARNING nova.compute.manager [req-c4e2edd2-8466-472f-a8e3-f2998e9bbce0 req-50877504-db57-4336-8076-d5b378b5a319 service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Received unexpected event network-vif-plugged-ca3ccf3a-86b0-492c-99ae-9cdca5df9336 for instance with vm_state active and task_state None.
Aug 26 23:13:42 user nova-compute[73497]: DEBUG nova.compute.manager [req-c4e2edd2-8466-472f-a8e3-f2998e9bbce0 req-50877504-db57-4336-8076-d5b378b5a319 service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Received event network-vif-plugged-ca3ccf3a-86b0-492c-99ae-9cdca5df9336 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:13:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c4e2edd2-8466-472f-a8e3-f2998e9bbce0 req-50877504-db57-4336-8076-d5b378b5a319 service nova] Acquiring lock "ba3de574-ae62-4e9d-87f8-434c163d9897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c4e2edd2-8466-472f-a8e3-f2998e9bbce0 req-50877504-db57-4336-8076-d5b378b5a319 service nova] Lock "ba3de574-ae62-4e9d-87f8-434c163d9897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c4e2edd2-8466-472f-a8e3-f2998e9bbce0 req-50877504-db57-4336-8076-d5b378b5a319 service nova] Lock "ba3de574-ae62-4e9d-87f8-434c163d9897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:42 user nova-compute[73497]: DEBUG nova.compute.manager [req-c4e2edd2-8466-472f-a8e3-f2998e9bbce0 req-50877504-db57-4336-8076-d5b378b5a319 service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] No waiting events found dispatching network-vif-plugged-ca3ccf3a-86b0-492c-99ae-9cdca5df9336 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:13:42 user nova-compute[73497]: WARNING nova.compute.manager [req-c4e2edd2-8466-472f-a8e3-f2998e9bbce0 req-50877504-db57-4336-8076-d5b378b5a319 service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Received unexpected event network-vif-plugged-ca3ccf3a-86b0-492c-99ae-9cdca5df9336 for instance with vm_state active and task_state None.
Aug 26 23:13:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Acquiring lock "865d6369-32ac-46ac-b6df-37d8fa4bf440" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Lock "865d6369-32ac-46ac-b6df-37d8fa4bf440" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:42 user nova-compute[73497]: DEBUG nova.compute.manager [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:13:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.006s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:43 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:13:43 user nova-compute[73497]: INFO nova.compute.claims [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Claim successful on node user
Aug 26 23:13:43 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:13:43 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Cleaning up deleted instances {{(pid=73497) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 23:13:43 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] There are 0 instances to clean {{(pid=73497) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 23:13:43 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:13:43 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Cleaning up deleted instances with incomplete migration  {{(pid=73497) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 23:13:43 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:13:43 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:13:43 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:13:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.553s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:43 user nova-compute[73497]: DEBUG nova.compute.manager [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:13:43 user nova-compute[73497]: DEBUG nova.compute.manager [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:13:43 user nova-compute[73497]: DEBUG nova.network.neutron [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:13:43 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:13:43 user nova-compute[73497]: DEBUG nova.compute.manager [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:13:43 user nova-compute[73497]: DEBUG nova.policy [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4e76a569cfcf40aeb6d07818a6cd8401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79abf19d9b1457bb5cb22c1072526d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:13:43 user nova-compute[73497]: DEBUG nova.compute.manager [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:13:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:13:43 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Creating image(s)
Aug 26 23:13:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Acquiring lock "/opt/stack/data/nova/instances/865d6369-32ac-46ac-b6df-37d8fa4bf440/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Lock "/opt/stack/data/nova/instances/865d6369-32ac-46ac-b6df-37d8fa4bf440/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Lock "/opt/stack/data/nova/instances/865d6369-32ac-46ac-b6df-37d8fa4bf440/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.257s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:44 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:13:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:44 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:13:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.313s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/865d6369-32ac-46ac-b6df-37d8fa4bf440/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/865d6369-32ac-46ac-b6df-37d8fa4bf440/disk 1073741824" returned: 0 in 0.073s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.394s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.234s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:44 user nova-compute[73497]: DEBUG nova.network.neutron [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Successfully created port: 1aecc224-deb4-4bb2-90e4-21471146ebf4 {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:13:44 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Checking if we can resize image /opt/stack/data/nova/instances/865d6369-32ac-46ac-b6df-37d8fa4bf440/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:13:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865d6369-32ac-46ac-b6df-37d8fa4bf440/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:44 user nova-compute[73497]: DEBUG nova.compute.manager [req-0cb69345-0076-4fd7-8561-82247b36d8ef req-73c29b62-5342-4757-9f05-3df1e4c0716e service nova] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Received event network-vif-plugged-227712b4-3763-41dd-ab89-b42888471e7d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:13:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0cb69345-0076-4fd7-8561-82247b36d8ef req-73c29b62-5342-4757-9f05-3df1e4c0716e service nova] Acquiring lock "ab745e33-a11e-4ee4-a442-1e7893448d27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0cb69345-0076-4fd7-8561-82247b36d8ef req-73c29b62-5342-4757-9f05-3df1e4c0716e service nova] Lock "ab745e33-a11e-4ee4-a442-1e7893448d27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0cb69345-0076-4fd7-8561-82247b36d8ef req-73c29b62-5342-4757-9f05-3df1e4c0716e service nova] Lock "ab745e33-a11e-4ee4-a442-1e7893448d27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:44 user nova-compute[73497]: DEBUG nova.compute.manager [req-0cb69345-0076-4fd7-8561-82247b36d8ef req-73c29b62-5342-4757-9f05-3df1e4c0716e service nova] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] No waiting events found dispatching network-vif-plugged-227712b4-3763-41dd-ab89-b42888471e7d {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:13:44 user nova-compute[73497]: WARNING nova.compute.manager [req-0cb69345-0076-4fd7-8561-82247b36d8ef req-73c29b62-5342-4757-9f05-3df1e4c0716e service nova] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Received unexpected event network-vif-plugged-227712b4-3763-41dd-ab89-b42888471e7d for instance with vm_state active and task_state None.
Aug 26 23:13:44 user nova-compute[73497]: DEBUG nova.compute.manager [req-0cb69345-0076-4fd7-8561-82247b36d8ef req-73c29b62-5342-4757-9f05-3df1e4c0716e service nova] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Received event network-vif-plugged-227712b4-3763-41dd-ab89-b42888471e7d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:13:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0cb69345-0076-4fd7-8561-82247b36d8ef req-73c29b62-5342-4757-9f05-3df1e4c0716e service nova] Acquiring lock "ab745e33-a11e-4ee4-a442-1e7893448d27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0cb69345-0076-4fd7-8561-82247b36d8ef req-73c29b62-5342-4757-9f05-3df1e4c0716e service nova] Lock "ab745e33-a11e-4ee4-a442-1e7893448d27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0cb69345-0076-4fd7-8561-82247b36d8ef req-73c29b62-5342-4757-9f05-3df1e4c0716e service nova] Lock "ab745e33-a11e-4ee4-a442-1e7893448d27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:44 user nova-compute[73497]: DEBUG nova.compute.manager [req-0cb69345-0076-4fd7-8561-82247b36d8ef req-73c29b62-5342-4757-9f05-3df1e4c0716e service nova] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] No waiting events found dispatching network-vif-plugged-227712b4-3763-41dd-ab89-b42888471e7d {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:13:44 user nova-compute[73497]: WARNING nova.compute.manager [req-0cb69345-0076-4fd7-8561-82247b36d8ef req-73c29b62-5342-4757-9f05-3df1e4c0716e service nova] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Received unexpected event network-vif-plugged-227712b4-3763-41dd-ab89-b42888471e7d for instance with vm_state active and task_state None.
Aug 26 23:13:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865d6369-32ac-46ac-b6df-37d8fa4bf440/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:44 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Cannot resize image /opt/stack/data/nova/instances/865d6369-32ac-46ac-b6df-37d8fa4bf440/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:13:44 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:13:44 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Ensure instance console log exists: /opt/stack/data/nova/instances/865d6369-32ac-46ac-b6df-37d8fa4bf440/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:13:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94c286f8-2ef8-401a-ac64-693efb2f5f66/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94c286f8-2ef8-401a-ac64-693efb2f5f66/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94c286f8-2ef8-401a-ac64-693efb2f5f66/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94c286f8-2ef8-401a-ac64-693efb2f5f66/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab745e33-a11e-4ee4-a442-1e7893448d27/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:45 user nova-compute[73497]: DEBUG nova.network.neutron [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Successfully updated port: 1aecc224-deb4-4bb2-90e4-21471146ebf4 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:13:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Acquiring lock "refresh_cache-865d6369-32ac-46ac-b6df-37d8fa4bf440" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:13:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Acquired lock "refresh_cache-865d6369-32ac-46ac-b6df-37d8fa4bf440" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:13:45 user nova-compute[73497]: DEBUG nova.network.neutron [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:13:45 user nova-compute[73497]: DEBUG nova.compute.manager [req-b6adc409-3fab-4723-b264-7e7547ae525c req-8f64f765-a4aa-4696-afea-f94cb3a3a5ee service nova] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Received event network-changed-1aecc224-deb4-4bb2-90e4-21471146ebf4 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:13:45 user nova-compute[73497]: DEBUG nova.compute.manager [req-b6adc409-3fab-4723-b264-7e7547ae525c req-8f64f765-a4aa-4696-afea-f94cb3a3a5ee service nova] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Refreshing instance network info cache due to event network-changed-1aecc224-deb4-4bb2-90e4-21471146ebf4. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:13:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b6adc409-3fab-4723-b264-7e7547ae525c req-8f64f765-a4aa-4696-afea-f94cb3a3a5ee service nova] Acquiring lock "refresh_cache-865d6369-32ac-46ac-b6df-37d8fa4bf440" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:13:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab745e33-a11e-4ee4-a442-1e7893448d27/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab745e33-a11e-4ee4-a442-1e7893448d27/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:45 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:45 user nova-compute[73497]: DEBUG nova.network.neutron [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab745e33-a11e-4ee4-a442-1e7893448d27/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG nova.network.neutron [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Updating instance_info_cache with network_info: [{"id": "1aecc224-deb4-4bb2-90e4-21471146ebf4", "address": "fa:16:3e:4a:4b:6c", "network": {"id": "3aab5362-39c3-4ee6-9e1d-13e88d7dfa0b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-8435068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c79abf19d9b1457bb5cb22c1072526d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aecc224-de", "ovs_interfaceid": "1aecc224-deb4-4bb2-90e4-21471146ebf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Releasing lock "refresh_cache-865d6369-32ac-46ac-b6df-37d8fa4bf440" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG nova.compute.manager [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Instance network_info: |[{"id": "1aecc224-deb4-4bb2-90e4-21471146ebf4", "address": "fa:16:3e:4a:4b:6c", "network": {"id": "3aab5362-39c3-4ee6-9e1d-13e88d7dfa0b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-8435068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c79abf19d9b1457bb5cb22c1072526d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aecc224-de", "ovs_interfaceid": "1aecc224-deb4-4bb2-90e4-21471146ebf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b6adc409-3fab-4723-b264-7e7547ae525c req-8f64f765-a4aa-4696-afea-f94cb3a3a5ee service nova] Acquired lock "refresh_cache-865d6369-32ac-46ac-b6df-37d8fa4bf440" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG nova.network.neutron [req-b6adc409-3fab-4723-b264-7e7547ae525c req-8f64f765-a4aa-4696-afea-f94cb3a3a5ee service nova] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Refreshing network info cache for port 1aecc224-deb4-4bb2-90e4-21471146ebf4 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Start _get_guest_xml network_info=[{"id": "1aecc224-deb4-4bb2-90e4-21471146ebf4", "address": "fa:16:3e:4a:4b:6c", "network": {"id": "3aab5362-39c3-4ee6-9e1d-13e88d7dfa0b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-8435068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c79abf19d9b1457bb5cb22c1072526d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aecc224-de", "ovs_interfaceid": "1aecc224-deb4-4bb2-90e4-21471146ebf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:13:46 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:13:46 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:13:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1241197533',display_name='tempest-VolumesAssistedSnapshotsTest-server-1241197533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1241197533',id=9,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQja4DpaIKnp1nqOP0IgYa2V1RBUkZDhXbt+e0ISMPoh6h903YMqf7oYMfAqXUSWdteNxRkONCSi1YFfeCcrtEC14xwytXJyfapALGlIbKVCJ+xUtl4ZxduTS+6Xk8WqA==',key_name='tempest-keypair-264287436',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c79abf19d9b1457bb5cb22c1072526d4',ramdisk_id='',reservation_id='r-nl7lci7t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1703564551',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1703564551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:13:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e76a569cfcf40aeb6d07818a6cd8401',uuid=865d6369-32ac-46ac-b6df-37d8fa4bf440,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1aecc224-deb4-4bb2-90e4-21471146ebf4", "address": "fa:16:3e:4a:4b:6c", "network": {"id": "3aab5362-39c3-4ee6-9e1d-13e88d7dfa0b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-8435068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c79abf19d9b1457bb5cb22c1072526d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aecc224-de", "ovs_interfaceid": "1aecc224-deb4-4bb2-90e4-21471146ebf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Converting VIF {"id": "1aecc224-deb4-4bb2-90e4-21471146ebf4", "address": "fa:16:3e:4a:4b:6c", "network": {"id": "3aab5362-39c3-4ee6-9e1d-13e88d7dfa0b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-8435068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c79abf19d9b1457bb5cb22c1072526d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aecc224-de", "ovs_interfaceid": "1aecc224-deb4-4bb2-90e4-21471146ebf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:4b:6c,bridge_name='br-int',has_traffic_filtering=True,id=1aecc224-deb4-4bb2-90e4-21471146ebf4,network=Network(3aab5362-39c3-4ee6-9e1d-13e88d7dfa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aecc224-de') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG nova.objects.instance [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Lazy-loading 'pci_devices' on Instance uuid 865d6369-32ac-46ac-b6df-37d8fa4bf440 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:13:46 user nova-compute[73497]:   <uuid>865d6369-32ac-46ac-b6df-37d8fa4bf440</uuid>
Aug 26 23:13:46 user nova-compute[73497]:   <name>instance-00000009</name>
Aug 26 23:13:46 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:13:46 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:13:46 user nova-compute[73497]:   <metadata>
Aug 26 23:13:46 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:13:46 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:13:46 user nova-compute[73497]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1241197533</nova:name>
Aug 26 23:13:46 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:13:46</nova:creationTime>
Aug 26 23:13:46 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:13:46 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:13:46 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:13:46 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:13:46 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:13:46 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:13:46 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:13:46 user nova-compute[73497]:       <nova:owner>
Aug 26 23:13:46 user nova-compute[73497]:         <nova:user uuid="4e76a569cfcf40aeb6d07818a6cd8401">tempest-VolumesAssistedSnapshotsTest-1703564551-project-member</nova:user>
Aug 26 23:13:46 user nova-compute[73497]:         <nova:project uuid="c79abf19d9b1457bb5cb22c1072526d4">tempest-VolumesAssistedSnapshotsTest-1703564551</nova:project>
Aug 26 23:13:46 user nova-compute[73497]:       </nova:owner>
Aug 26 23:13:46 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:13:46 user nova-compute[73497]:       <nova:ports>
Aug 26 23:13:46 user nova-compute[73497]:         <nova:port uuid="1aecc224-deb4-4bb2-90e4-21471146ebf4">
Aug 26 23:13:46 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 23:13:46 user nova-compute[73497]:         </nova:port>
Aug 26 23:13:46 user nova-compute[73497]:       </nova:ports>
Aug 26 23:13:46 user nova-compute[73497]:     </nova:instance>
Aug 26 23:13:46 user nova-compute[73497]:   </metadata>
Aug 26 23:13:46 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:13:46 user nova-compute[73497]:     <system>
Aug 26 23:13:46 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:13:46 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:13:46 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:13:46 user nova-compute[73497]:       <entry name="serial">865d6369-32ac-46ac-b6df-37d8fa4bf440</entry>
Aug 26 23:13:46 user nova-compute[73497]:       <entry name="uuid">865d6369-32ac-46ac-b6df-37d8fa4bf440</entry>
Aug 26 23:13:46 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:13:46 user nova-compute[73497]:     </system>
Aug 26 23:13:46 user nova-compute[73497]:   </sysinfo>
Aug 26 23:13:46 user nova-compute[73497]:   <os>
Aug 26 23:13:46 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:13:46 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:13:46 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:13:46 user nova-compute[73497]:   </os>
Aug 26 23:13:46 user nova-compute[73497]:   <features>
Aug 26 23:13:46 user nova-compute[73497]:     <acpi/>
Aug 26 23:13:46 user nova-compute[73497]:     <apic/>
Aug 26 23:13:46 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:13:46 user nova-compute[73497]:   </features>
Aug 26 23:13:46 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:13:46 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:13:46 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:13:46 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:13:46 user nova-compute[73497]:   </clock>
Aug 26 23:13:46 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:13:46 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:13:46 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:13:46 user nova-compute[73497]:   </cpu>
Aug 26 23:13:46 user nova-compute[73497]:   <devices>
Aug 26 23:13:46 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:13:46 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:13:46 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/865d6369-32ac-46ac-b6df-37d8fa4bf440/disk"/>
Aug 26 23:13:46 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:13:46 user nova-compute[73497]:     </disk>
Aug 26 23:13:46 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:13:46 user nova-compute[73497]:       <mac address="fa:16:3e:4a:4b:6c"/>
Aug 26 23:13:46 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:13:46 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:13:46 user nova-compute[73497]:       <target dev="tap1aecc224-de"/>
Aug 26 23:13:46 user nova-compute[73497]:     </interface>
Aug 26 23:13:46 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:13:46 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/865d6369-32ac-46ac-b6df-37d8fa4bf440/console.log" append="off"/>
Aug 26 23:13:46 user nova-compute[73497]:     </serial>
Aug 26 23:13:46 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:13:46 user nova-compute[73497]:     <video>
Aug 26 23:13:46 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:13:46 user nova-compute[73497]:     </video>
Aug 26 23:13:46 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:13:46 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:13:46 user nova-compute[73497]:     </rng>
Aug 26 23:13:46 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:13:46 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:13:46 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:13:46 user nova-compute[73497]:     </memballoon>
Aug 26 23:13:46 user nova-compute[73497]:   </devices>
Aug 26 23:13:46 user nova-compute[73497]: </domain>
Aug 26 23:13:46 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1241197533',display_name='tempest-VolumesAssistedSnapshotsTest-server-1241197533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1241197533',id=9,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQja4DpaIKnp1nqOP0IgYa2V1RBUkZDhXbt+e0ISMPoh6h903YMqf7oYMfAqXUSWdteNxRkONCSi1YFfeCcrtEC14xwytXJyfapALGlIbKVCJ+xUtl4ZxduTS+6Xk8WqA==',key_name='tempest-keypair-264287436',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c79abf19d9b1457bb5cb22c1072526d4',ramdisk_id='',reservation_id='r-nl7lci7t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1703564551',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1703564551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:13:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e76a569cfcf40aeb6d07818a6cd8401',uuid=865d6369-32ac-46ac-b6df-37d8fa4bf440,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1aecc224-deb4-4bb2-90e4-21471146ebf4", "address": "fa:16:3e:4a:4b:6c", "network": {"id": "3aab5362-39c3-4ee6-9e1d-13e88d7dfa0b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-8435068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c79abf19d9b1457bb5cb22c1072526d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aecc224-de", "ovs_interfaceid": "1aecc224-deb4-4bb2-90e4-21471146ebf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Converting VIF {"id": "1aecc224-deb4-4bb2-90e4-21471146ebf4", "address": "fa:16:3e:4a:4b:6c", "network": {"id": "3aab5362-39c3-4ee6-9e1d-13e88d7dfa0b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-8435068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c79abf19d9b1457bb5cb22c1072526d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aecc224-de", "ovs_interfaceid": "1aecc224-deb4-4bb2-90e4-21471146ebf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:4b:6c,bridge_name='br-int',has_traffic_filtering=True,id=1aecc224-deb4-4bb2-90e4-21471146ebf4,network=Network(3aab5362-39c3-4ee6-9e1d-13e88d7dfa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aecc224-de') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG os_vif [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:4b:6c,bridge_name='br-int',has_traffic_filtering=True,id=1aecc224-deb4-4bb2-90e4-21471146ebf4,network=Network(3aab5362-39c3-4ee6-9e1d-13e88d7dfa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aecc224-de') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1aecc224-de, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1aecc224-de, col_values=(('external_ids', {'iface-id': '1aecc224-deb4-4bb2-90e4-21471146ebf4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:4b:6c', 'vm-uuid': '865d6369-32ac-46ac-b6df-37d8fa4bf440'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:46 user nova-compute[73497]: INFO os_vif [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:4b:6c,bridge_name='br-int',has_traffic_filtering=True,id=1aecc224-deb4-4bb2-90e4-21471146ebf4,network=Network(3aab5362-39c3-4ee6-9e1d-13e88d7dfa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aecc224-de')
Aug 26 23:13:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240/disk --force-share --output=json" returned: 0 in 0.305s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfdfc81c-c44a-4e43-9053-74f1fce8ca3d/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] No VIF found with MAC fa:16:3e:4a:4b:6c, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfdfc81c-c44a-4e43-9053-74f1fce8ca3d/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfdfc81c-c44a-4e43-9053-74f1fce8ca3d/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfdfc81c-c44a-4e43-9053-74f1fce8ca3d/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:47 user nova-compute[73497]: DEBUG nova.network.neutron [req-b6adc409-3fab-4723-b264-7e7547ae525c req-8f64f765-a4aa-4696-afea-f94cb3a3a5ee service nova] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Updated VIF entry in instance network info cache for port 1aecc224-deb4-4bb2-90e4-21471146ebf4. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:13:47 user nova-compute[73497]: DEBUG nova.network.neutron [req-b6adc409-3fab-4723-b264-7e7547ae525c req-8f64f765-a4aa-4696-afea-f94cb3a3a5ee service nova] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Updating instance_info_cache with network_info: [{"id": "1aecc224-deb4-4bb2-90e4-21471146ebf4", "address": "fa:16:3e:4a:4b:6c", "network": {"id": "3aab5362-39c3-4ee6-9e1d-13e88d7dfa0b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-8435068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c79abf19d9b1457bb5cb22c1072526d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aecc224-de", "ovs_interfaceid": "1aecc224-deb4-4bb2-90e4-21471146ebf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:13:47 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b6adc409-3fab-4723-b264-7e7547ae525c req-8f64f765-a4aa-4696-afea-f94cb3a3a5ee service nova] Releasing lock "refresh_cache-865d6369-32ac-46ac-b6df-37d8fa4bf440" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:13:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:48 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:48 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:48 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:13:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:13:48 user nova-compute[73497]: DEBUG nova.compute.manager [req-c97e25a9-a2eb-4aac-9936-785b2132e5b5 req-27757f92-5ce5-4393-b5a1-0b4cf7d35d9e service nova] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Received event network-vif-plugged-1aecc224-deb4-4bb2-90e4-21471146ebf4 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:13:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c97e25a9-a2eb-4aac-9936-785b2132e5b5 req-27757f92-5ce5-4393-b5a1-0b4cf7d35d9e service nova] Acquiring lock "865d6369-32ac-46ac-b6df-37d8fa4bf440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c97e25a9-a2eb-4aac-9936-785b2132e5b5 req-27757f92-5ce5-4393-b5a1-0b4cf7d35d9e service nova] Lock "865d6369-32ac-46ac-b6df-37d8fa4bf440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c97e25a9-a2eb-4aac-9936-785b2132e5b5 req-27757f92-5ce5-4393-b5a1-0b4cf7d35d9e service nova] Lock "865d6369-32ac-46ac-b6df-37d8fa4bf440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:48 user nova-compute[73497]: DEBUG nova.compute.manager [req-c97e25a9-a2eb-4aac-9936-785b2132e5b5 req-27757f92-5ce5-4393-b5a1-0b4cf7d35d9e service nova] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] No waiting events found dispatching network-vif-plugged-1aecc224-deb4-4bb2-90e4-21471146ebf4 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:13:48 user nova-compute[73497]: WARNING nova.compute.manager [req-c97e25a9-a2eb-4aac-9936-785b2132e5b5 req-27757f92-5ce5-4393-b5a1-0b4cf7d35d9e service nova] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Received unexpected event network-vif-plugged-1aecc224-deb4-4bb2-90e4-21471146ebf4 for instance with vm_state building and task_state spawning.
Aug 26 23:13:51 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091630.649107, 865d6369-32ac-46ac-b6df-37d8fa4bf440 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:13:51 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] VM Resumed (Lifecycle Event)
Aug 26 23:13:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:51 user nova-compute[73497]: DEBUG nova.compute.manager [req-b82e0696-40be-4252-8646-4c023c8ffb4d req-ec56aee1-20d1-4934-b2ad-4ef9617f944f service nova] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Received event network-vif-plugged-1aecc224-deb4-4bb2-90e4-21471146ebf4 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:13:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b82e0696-40be-4252-8646-4c023c8ffb4d req-ec56aee1-20d1-4934-b2ad-4ef9617f944f service nova] Acquiring lock "865d6369-32ac-46ac-b6df-37d8fa4bf440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b82e0696-40be-4252-8646-4c023c8ffb4d req-ec56aee1-20d1-4934-b2ad-4ef9617f944f service nova] Lock "865d6369-32ac-46ac-b6df-37d8fa4bf440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b82e0696-40be-4252-8646-4c023c8ffb4d req-ec56aee1-20d1-4934-b2ad-4ef9617f944f service nova] Lock "865d6369-32ac-46ac-b6df-37d8fa4bf440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:51 user nova-compute[73497]: DEBUG nova.compute.manager [req-b82e0696-40be-4252-8646-4c023c8ffb4d req-ec56aee1-20d1-4934-b2ad-4ef9617f944f service nova] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] No waiting events found dispatching network-vif-plugged-1aecc224-deb4-4bb2-90e4-21471146ebf4 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:13:51 user nova-compute[73497]: WARNING nova.compute.manager [req-b82e0696-40be-4252-8646-4c023c8ffb4d req-ec56aee1-20d1-4934-b2ad-4ef9617f944f service nova] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Received unexpected event network-vif-plugged-1aecc224-deb4-4bb2-90e4-21471146ebf4 for instance with vm_state building and task_state spawning.
Aug 26 23:13:51 user nova-compute[73497]: DEBUG nova.compute.manager [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:13:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:13:51 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:13:51 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:13:51 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:13:51 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:13:51 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=7778MB free_disk=25.632919311523438GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:13:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:51 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Instance spawned successfully.
Aug 26 23:13:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:13:51 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:13:51 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091630.6503725, 865d6369-32ac-46ac-b6df-37d8fa4bf440 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:13:51 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] VM Started (Lifecycle Event)
Aug 26 23:13:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:13:51 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:13:51 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:13:51 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:13:51 user nova-compute[73497]: INFO nova.compute.manager [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Took 7.54 seconds to spawn the instance on the hypervisor.
Aug 26 23:13:51 user nova-compute[73497]: DEBUG nova.compute.manager [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:13:51 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 94c286f8-2ef8-401a-ac64-693efb2f5f66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:13:51 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 926f8e5c-8d8a-4f07-bf08-e60700ce4698 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:13:51 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 994093f0-e6b2-4c96-b259-c559ef2b1fbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:13:51 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 171985a3-358d-4b26-a66c-372b9b99b386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:13:51 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 1a58c5e7-b4c7-4bd5-8dd1-a98492139240 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:13:51 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance cfdfc81c-c44a-4e43-9053-74f1fce8ca3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:13:51 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance ba3de574-ae62-4e9d-87f8-434c163d9897 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:13:51 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance ab745e33-a11e-4ee4-a442-1e7893448d27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:13:51 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 865d6369-32ac-46ac-b6df-37d8fa4bf440 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:13:51 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:13:51 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:13:51 user nova-compute[73497]: INFO nova.compute.manager [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Took 8.55 seconds to build instance.
Aug 26 23:13:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f6047c4f-6b42-4dfd-b8a9-ccfc153b1787 tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Lock "865d6369-32ac-46ac-b6df-37d8fa4bf440" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.705s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:51 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:13:51 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:13:51 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:13:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.575s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:52 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:13:52 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:13:52 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:13:52 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Rebuilding the list of instances to heal {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 23:13:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-94c286f8-2ef8-401a-ac64-693efb2f5f66" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:13:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-94c286f8-2ef8-401a-ac64-693efb2f5f66" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:13:52 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:13:52 user nova-compute[73497]: DEBUG nova.objects.instance [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lazy-loading 'info_cache' on Instance uuid 94c286f8-2ef8-401a-ac64-693efb2f5f66 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:13:52 user nova-compute[73497]: DEBUG nova.compute.manager [req-04cf3dd1-dc83-4ab8-b0df-98d0edccc7f5 req-025c272b-f860-4901-b656-73a5fb5960a5 service nova] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Received event network-vif-plugged-9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:13:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-04cf3dd1-dc83-4ab8-b0df-98d0edccc7f5 req-025c272b-f860-4901-b656-73a5fb5960a5 service nova] Acquiring lock "994093f0-e6b2-4c96-b259-c559ef2b1fbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-04cf3dd1-dc83-4ab8-b0df-98d0edccc7f5 req-025c272b-f860-4901-b656-73a5fb5960a5 service nova] Lock "994093f0-e6b2-4c96-b259-c559ef2b1fbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-04cf3dd1-dc83-4ab8-b0df-98d0edccc7f5 req-025c272b-f860-4901-b656-73a5fb5960a5 service nova] Lock "994093f0-e6b2-4c96-b259-c559ef2b1fbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:52 user nova-compute[73497]: DEBUG nova.compute.manager [req-04cf3dd1-dc83-4ab8-b0df-98d0edccc7f5 req-025c272b-f860-4901-b656-73a5fb5960a5 service nova] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] No waiting events found dispatching network-vif-plugged-9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:13:52 user nova-compute[73497]: WARNING nova.compute.manager [req-04cf3dd1-dc83-4ab8-b0df-98d0edccc7f5 req-025c272b-f860-4901-b656-73a5fb5960a5 service nova] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Received unexpected event network-vif-plugged-9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2 for instance with vm_state active and task_state None.
Aug 26 23:13:53 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Updating instance_info_cache with network_info: [{"id": "aecca1b3-87bd-4db1-9c2c-112129841f10", "address": "fa:16:3e:9f:f4:b7", "network": {"id": "ea7e0883-053d-42f8-9749-efc1d858f673", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2049683477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dfec25f4b56484bb2deeaeafa30ee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaecca1b3-87", "ovs_interfaceid": "aecca1b3-87bd-4db1-9c2c-112129841f10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:13:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-94c286f8-2ef8-401a-ac64-693efb2f5f66" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:13:54 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:13:54 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:13:54 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:13:54 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:13:54 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:13:54 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:13:54 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:13:54 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:13:55 user nova-compute[73497]: DEBUG nova.compute.manager [req-16d5d880-21e0-44f1-bed3-3b0a34570935 req-43003c75-741d-4296-bfbe-20b9fa4be794 service nova] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Received event network-vif-plugged-9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:13:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-16d5d880-21e0-44f1-bed3-3b0a34570935 req-43003c75-741d-4296-bfbe-20b9fa4be794 service nova] Acquiring lock "994093f0-e6b2-4c96-b259-c559ef2b1fbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-16d5d880-21e0-44f1-bed3-3b0a34570935 req-43003c75-741d-4296-bfbe-20b9fa4be794 service nova] Lock "994093f0-e6b2-4c96-b259-c559ef2b1fbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-16d5d880-21e0-44f1-bed3-3b0a34570935 req-43003c75-741d-4296-bfbe-20b9fa4be794 service nova] Lock "994093f0-e6b2-4c96-b259-c559ef2b1fbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:55 user nova-compute[73497]: DEBUG nova.compute.manager [req-16d5d880-21e0-44f1-bed3-3b0a34570935 req-43003c75-741d-4296-bfbe-20b9fa4be794 service nova] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] No waiting events found dispatching network-vif-plugged-9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:13:55 user nova-compute[73497]: WARNING nova.compute.manager [req-16d5d880-21e0-44f1-bed3-3b0a34570935 req-43003c75-741d-4296-bfbe-20b9fa4be794 service nova] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Received unexpected event network-vif-plugged-9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2 for instance with vm_state active and task_state None.
Aug 26 23:13:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:13:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Acquiring lock "62f841d2-09e7-448b-8c1c-26c824c473ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Lock "62f841d2-09e7-448b-8c1c-26c824c473ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:13:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:58 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:13:58 user nova-compute[73497]: INFO nova.compute.claims [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Claim successful on node user
Aug 26 23:13:58 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Refreshing inventories for resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 23:13:58 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Updating ProviderTree inventory for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 23:13:58 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Updating inventory in ProviderTree for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 23:13:58 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Refreshing aggregate associations for resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1, aggregates: None {{(pid=73497) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 23:13:58 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Refreshing trait associations for resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING {{(pid=73497) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 23:13:58 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:13:58 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:13:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.556s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:58 user nova-compute[73497]: DEBUG nova.compute.manager [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:13:58 user nova-compute[73497]: DEBUG nova.compute.manager [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:13:58 user nova-compute[73497]: DEBUG nova.network.neutron [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:13:58 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:13:58 user nova-compute[73497]: DEBUG nova.compute.manager [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:13:58 user nova-compute[73497]: INFO nova.virt.block_device [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Booting with volume 2fb2814e-8af9-455e-aaba-faa885d49a3a at /dev/vda
Aug 26 23:13:58 user nova-compute[73497]: DEBUG nova.policy [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c6bce6dad6f4c1092286fa122e6ed74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6bf8d596b4695a60e15661fd18352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:13:58 user nova-compute[73497]: DEBUG os_brick.utils [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:13:58 user nova-compute[73497]: INFO oslo.privsep.daemon [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpx67hd9hl/privsep.sock']
Aug 26 23:13:58 user sudo[84564]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpx67hd9hl/privsep.sock
Aug 26 23:13:58 user sudo[84564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 26 23:13:59 user nova-compute[73497]: DEBUG nova.compute.manager [req-74cf75a7-279d-4e1e-ba68-7b2f390df794 req-7d28d5e2-9f02-4a6d-bb9b-ff77266d96c6 service nova] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Received event network-vif-plugged-400e10af-326e-4457-bf67-f7e350fd821e {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:13:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-74cf75a7-279d-4e1e-ba68-7b2f390df794 req-7d28d5e2-9f02-4a6d-bb9b-ff77266d96c6 service nova] Acquiring lock "926f8e5c-8d8a-4f07-bf08-e60700ce4698-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:13:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-74cf75a7-279d-4e1e-ba68-7b2f390df794 req-7d28d5e2-9f02-4a6d-bb9b-ff77266d96c6 service nova] Lock "926f8e5c-8d8a-4f07-bf08-e60700ce4698-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:13:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-74cf75a7-279d-4e1e-ba68-7b2f390df794 req-7d28d5e2-9f02-4a6d-bb9b-ff77266d96c6 service nova] Lock "926f8e5c-8d8a-4f07-bf08-e60700ce4698-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:13:59 user nova-compute[73497]: DEBUG nova.compute.manager [req-74cf75a7-279d-4e1e-ba68-7b2f390df794 req-7d28d5e2-9f02-4a6d-bb9b-ff77266d96c6 service nova] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] No waiting events found dispatching network-vif-plugged-400e10af-326e-4457-bf67-f7e350fd821e {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:13:59 user nova-compute[73497]: WARNING nova.compute.manager [req-74cf75a7-279d-4e1e-ba68-7b2f390df794 req-7d28d5e2-9f02-4a6d-bb9b-ff77266d96c6 service nova] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Received unexpected event network-vif-plugged-400e10af-326e-4457-bf67-f7e350fd821e for instance with vm_state active and task_state None.
Aug 26 23:13:59 user nova-compute[73497]: DEBUG nova.network.neutron [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Successfully created port: ea0c8f3c-1937-4d8c-968a-21a620ff5f7d {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:14:00 user sudo[84564]: pam_unix(sudo:session): session closed for user root
Aug 26 23:14:00 user nova-compute[73497]: INFO oslo.privsep.daemon [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Spawned new privsep daemon via rootwrap
Aug 26 23:14:00 user nova-compute[73497]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 26 23:14:00 user nova-compute[73497]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 26 23:14:00 user nova-compute[73497]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 26 23:14:00 user nova-compute[73497]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84617
Aug 26 23:14:00 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d227028c-c702-4a00-a4b6-c7ad61beca7b]: (2,) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:14:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:00 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[100911d7-38e9-42dd-90b0-bfffab2ee96b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:14:00 user nova-compute[73497]: WARNING os_brick.initiator.connectors.nvmeof [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 26 23:14:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:01 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2fae5d-5049-43ed-9622-45480cb98856]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:14:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:01 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[608a5b15-476f-4106-b77d-c173c31592f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:14:01 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91eb867-b6cc-4dab-82f7-552375501d41]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:14:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:14:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:14:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:14:01 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:14:01 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d58b3d-f5c5-434f-abe5-a4fdaeda5e9c]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:14:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:14:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:14:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:14:01 user nova-compute[73497]: DEBUG os_brick.utils [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] <== get_connector_properties: return (2146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:14:01 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Updating existing volume attachment record: eec54a95-ca1c-40b8-b2b3-49ac48f81a5a {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:14:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:01 user nova-compute[73497]: DEBUG nova.network.neutron [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Successfully updated port: ea0c8f3c-1937-4d8c-968a-21a620ff5f7d {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:14:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Acquiring lock "refresh_cache-62f841d2-09e7-448b-8c1c-26c824c473ba" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:14:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Acquired lock "refresh_cache-62f841d2-09e7-448b-8c1c-26c824c473ba" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:14:01 user nova-compute[73497]: DEBUG nova.network.neutron [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:14:01 user nova-compute[73497]: DEBUG nova.network.neutron [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:14:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:01 user nova-compute[73497]: DEBUG nova.network.neutron [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Updating instance_info_cache with network_info: [{"id": "ea0c8f3c-1937-4d8c-968a-21a620ff5f7d", "address": "fa:16:3e:34:77:60", "network": {"id": "52dfb1fe-f560-4f40-8594-3b13d3ff06d9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2040079808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a6bf8d596b4695a60e15661fd18352", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0c8f3c-19", "ovs_interfaceid": "ea0c8f3c-1937-4d8c-968a-21a620ff5f7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:14:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Releasing lock "refresh_cache-62f841d2-09e7-448b-8c1c-26c824c473ba" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:14:01 user nova-compute[73497]: DEBUG nova.compute.manager [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Instance network_info: |[{"id": "ea0c8f3c-1937-4d8c-968a-21a620ff5f7d", "address": "fa:16:3e:34:77:60", "network": {"id": "52dfb1fe-f560-4f40-8594-3b13d3ff06d9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2040079808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a6bf8d596b4695a60e15661fd18352", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0c8f3c-19", "ovs_interfaceid": "ea0c8f3c-1937-4d8c-968a-21a620ff5f7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:14:01 user nova-compute[73497]: DEBUG nova.compute.manager [req-9a053f07-2a3a-4115-8e39-b8fff4c389c0 req-2a11fa77-cc0b-450a-b0e5-bc762b8f8feb service nova] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Received event network-vif-plugged-400e10af-326e-4457-bf67-f7e350fd821e {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:14:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9a053f07-2a3a-4115-8e39-b8fff4c389c0 req-2a11fa77-cc0b-450a-b0e5-bc762b8f8feb service nova] Acquiring lock "926f8e5c-8d8a-4f07-bf08-e60700ce4698-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:14:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9a053f07-2a3a-4115-8e39-b8fff4c389c0 req-2a11fa77-cc0b-450a-b0e5-bc762b8f8feb service nova] Lock "926f8e5c-8d8a-4f07-bf08-e60700ce4698-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:14:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9a053f07-2a3a-4115-8e39-b8fff4c389c0 req-2a11fa77-cc0b-450a-b0e5-bc762b8f8feb service nova] Lock "926f8e5c-8d8a-4f07-bf08-e60700ce4698-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:14:01 user nova-compute[73497]: DEBUG nova.compute.manager [req-9a053f07-2a3a-4115-8e39-b8fff4c389c0 req-2a11fa77-cc0b-450a-b0e5-bc762b8f8feb service nova] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] No waiting events found dispatching network-vif-plugged-400e10af-326e-4457-bf67-f7e350fd821e {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:14:01 user nova-compute[73497]: WARNING nova.compute.manager [req-9a053f07-2a3a-4115-8e39-b8fff4c389c0 req-2a11fa77-cc0b-450a-b0e5-bc762b8f8feb service nova] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Received unexpected event network-vif-plugged-400e10af-326e-4457-bf67-f7e350fd821e for instance with vm_state active and task_state None.
Aug 26 23:14:01 user nova-compute[73497]: DEBUG nova.compute.manager [req-9a053f07-2a3a-4115-8e39-b8fff4c389c0 req-2a11fa77-cc0b-450a-b0e5-bc762b8f8feb service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Received event network-changed-ea0c8f3c-1937-4d8c-968a-21a620ff5f7d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:14:01 user nova-compute[73497]: DEBUG nova.compute.manager [req-9a053f07-2a3a-4115-8e39-b8fff4c389c0 req-2a11fa77-cc0b-450a-b0e5-bc762b8f8feb service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Refreshing instance network info cache due to event network-changed-ea0c8f3c-1937-4d8c-968a-21a620ff5f7d. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:14:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9a053f07-2a3a-4115-8e39-b8fff4c389c0 req-2a11fa77-cc0b-450a-b0e5-bc762b8f8feb service nova] Acquiring lock "refresh_cache-62f841d2-09e7-448b-8c1c-26c824c473ba" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:14:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9a053f07-2a3a-4115-8e39-b8fff4c389c0 req-2a11fa77-cc0b-450a-b0e5-bc762b8f8feb service nova] Acquired lock "refresh_cache-62f841d2-09e7-448b-8c1c-26c824c473ba" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:14:01 user nova-compute[73497]: DEBUG nova.network.neutron [req-9a053f07-2a3a-4115-8e39-b8fff4c389c0 req-2a11fa77-cc0b-450a-b0e5-bc762b8f8feb service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Refreshing network info cache for port ea0c8f3c-1937-4d8c-968a-21a620ff5f7d {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:14:02 user nova-compute[73497]: DEBUG nova.network.neutron [req-9a053f07-2a3a-4115-8e39-b8fff4c389c0 req-2a11fa77-cc0b-450a-b0e5-bc762b8f8feb service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Updated VIF entry in instance network info cache for port ea0c8f3c-1937-4d8c-968a-21a620ff5f7d. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:14:02 user nova-compute[73497]: DEBUG nova.network.neutron [req-9a053f07-2a3a-4115-8e39-b8fff4c389c0 req-2a11fa77-cc0b-450a-b0e5-bc762b8f8feb service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Updating instance_info_cache with network_info: [{"id": "ea0c8f3c-1937-4d8c-968a-21a620ff5f7d", "address": "fa:16:3e:34:77:60", "network": {"id": "52dfb1fe-f560-4f40-8594-3b13d3ff06d9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2040079808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a6bf8d596b4695a60e15661fd18352", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0c8f3c-19", "ovs_interfaceid": "ea0c8f3c-1937-4d8c-968a-21a620ff5f7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:14:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9a053f07-2a3a-4115-8e39-b8fff4c389c0 req-2a11fa77-cc0b-450a-b0e5-bc762b8f8feb service nova] Releasing lock "refresh_cache-62f841d2-09e7-448b-8c1c-26c824c473ba" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:14:06 user nova-compute[73497]: DEBUG nova.compute.manager [req-fbf77865-d7a0-442b-bb11-699b75d26da5 req-3005f484-7562-4fa0-a3ea-a09050935d8b service nova] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Received event network-vif-plugged-11dc5742-f487-414e-b289-90a7fddccaec {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:14:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-fbf77865-d7a0-442b-bb11-699b75d26da5 req-3005f484-7562-4fa0-a3ea-a09050935d8b service nova] Acquiring lock "cfdfc81c-c44a-4e43-9053-74f1fce8ca3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:14:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-fbf77865-d7a0-442b-bb11-699b75d26da5 req-3005f484-7562-4fa0-a3ea-a09050935d8b service nova] Lock "cfdfc81c-c44a-4e43-9053-74f1fce8ca3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:14:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-fbf77865-d7a0-442b-bb11-699b75d26da5 req-3005f484-7562-4fa0-a3ea-a09050935d8b service nova] Lock "cfdfc81c-c44a-4e43-9053-74f1fce8ca3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:14:06 user nova-compute[73497]: DEBUG nova.compute.manager [req-fbf77865-d7a0-442b-bb11-699b75d26da5 req-3005f484-7562-4fa0-a3ea-a09050935d8b service nova] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] No waiting events found dispatching network-vif-plugged-11dc5742-f487-414e-b289-90a7fddccaec {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:14:06 user nova-compute[73497]: WARNING nova.compute.manager [req-fbf77865-d7a0-442b-bb11-699b75d26da5 req-3005f484-7562-4fa0-a3ea-a09050935d8b service nova] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Received unexpected event network-vif-plugged-11dc5742-f487-414e-b289-90a7fddccaec for instance with vm_state active and task_state None.
Aug 26 23:14:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:08 user nova-compute[73497]: DEBUG nova.compute.manager [req-c97500c7-d39c-412a-a5e1-4095db7f0eec req-01bb4ae5-f2fc-4d4a-866a-48fe5f69bb7d service nova] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Received event network-vif-plugged-11dc5742-f487-414e-b289-90a7fddccaec {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:14:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c97500c7-d39c-412a-a5e1-4095db7f0eec req-01bb4ae5-f2fc-4d4a-866a-48fe5f69bb7d service nova] Acquiring lock "cfdfc81c-c44a-4e43-9053-74f1fce8ca3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:14:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c97500c7-d39c-412a-a5e1-4095db7f0eec req-01bb4ae5-f2fc-4d4a-866a-48fe5f69bb7d service nova] Lock "cfdfc81c-c44a-4e43-9053-74f1fce8ca3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:14:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c97500c7-d39c-412a-a5e1-4095db7f0eec req-01bb4ae5-f2fc-4d4a-866a-48fe5f69bb7d service nova] Lock "cfdfc81c-c44a-4e43-9053-74f1fce8ca3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:14:08 user nova-compute[73497]: DEBUG nova.compute.manager [req-c97500c7-d39c-412a-a5e1-4095db7f0eec req-01bb4ae5-f2fc-4d4a-866a-48fe5f69bb7d service nova] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] No waiting events found dispatching network-vif-plugged-11dc5742-f487-414e-b289-90a7fddccaec {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:14:08 user nova-compute[73497]: WARNING nova.compute.manager [req-c97500c7-d39c-412a-a5e1-4095db7f0eec req-01bb4ae5-f2fc-4d4a-866a-48fe5f69bb7d service nova] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Received unexpected event network-vif-plugged-11dc5742-f487-414e-b289-90a7fddccaec for instance with vm_state active and task_state None.
Aug 26 23:14:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG nova.compute.manager [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:14:12 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Creating image(s)
Aug 26 23:14:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Did not create local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Ensure instance console log exists: /opt/stack/data/nova/instances/62f841d2-09e7-448b-8c1c-26c824c473ba/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Start _get_guest_xml network_info=[{"id": "ea0c8f3c-1937-4d8c-968a-21a620ff5f7d", "address": "fa:16:3e:34:77:60", "network": {"id": "52dfb1fe-f560-4f40-8594-3b13d3ff06d9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2040079808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a6bf8d596b4695a60e15661fd18352", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0c8f3c-19", "ovs_interfaceid": "ea0c8f3c-1937-4d8c-968a-21a620ff5f7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'eec54a95-ca1c-40b8-b2b3-49ac48f81a5a', 'guest_format': None, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ONHTIbKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '62f841d2-09e7-448b-8c1c-26c824c473ba', 'attached_at': '', 'detached_at': '', 'volume_id': '2fb2814e-8af9-455e-aaba-faa885d49a3a', 'serial': '2fb2814e-8af9-455e-aaba-faa885d49a3a'}, 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:14:12 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:14:12 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:14:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG os_brick.initiator.connector [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Factory for ISCSI on None {{(pid=73497) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ONHTIbKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:14:12 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:14:12 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:14:12 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:14:12 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:14:12 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[58808611-d173-4d64-a2ea-2875e4979184]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:14:12 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc72425f-e894-48a4-9f20-837904aff423]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a] added
Aug 26 23:14:12 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7a77e9-c409-4821-ab82-4b2c97168f0d]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f3a253-093c-4b66-b00c-05a1625cf85f]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ONHTIbKk {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ONHTIbKk" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbddc1b-abaa-43db-ad0d-ba5295475d70]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ONHTIbKk'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4019938-164f-4273-924b-7f10591ad9df]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[468b7466-fa32-4d96-a862-dffbe443766e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 23:14:12 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 23:14:12 user nova-compute[73497]:  {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:14:12 user nova-compute[73497]: WARNING os_brick.initiator.connectors.iscsi [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 23:14:12 user nova-compute[73497]: 
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a286f06e-f488-4974-b6a2-ddb5fbcab1da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a, portal: 172.16.0.220,3260]
Aug 26 23:14:12 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a, portal: 172.16.0.220,3260] successful.
Aug 26 23:14:12 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af07c45-d4e4-4bd9-ba71-dc6705b1c181]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd36f8dd-d577-4b06-b78a-6ba612f09469]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:14:12 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:14:12 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[af72c7d3-ee26-43ac-8049-45fe4addee75]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:14:12 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ONHTIbKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:14:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:14:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23239343032323433', 'path': '/dev/sdb'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:14:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239343032323433', 'path': '/dev/sdb'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:14:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:13:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-474747102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-474747102',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByjF8J1FTf4Yf+f0bhNilYywxbVc7jA9buhoEIOCxGzdOlcDHyYAz+iC83msNEYmiVpBnhhT5cv+65/WSDDw63y6W9k4x8IST6h+KDUrN39XmHZzLFbe/p/7dgfn+8+iA==',key_name='tempest-keypair-1496592320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02a6bf8d596b4695a60e15661fd18352',ramdisk_id='',reservation_id='r-lyo5f7oa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1814198428',owner_user_name='tempest-ServerActionsV293TestJSON-1814198428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:13:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c6bce6dad6f4c1092286fa122e6ed74',uuid=62f841d2-09e7-448b-8c1c-26c824c473ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea0c8f3c-1937-4d8c-968a-21a620ff5f7d", "address": "fa:16:3e:34:77:60", "network": {"id": "52dfb1fe-f560-4f40-8594-3b13d3ff06d9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2040079808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a6bf8d596b4695a60e15661fd18352", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0c8f3c-19", "ovs_interfaceid": "ea0c8f3c-1937-4d8c-968a-21a620ff5f7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:14:13 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Converting VIF {"id": "ea0c8f3c-1937-4d8c-968a-21a620ff5f7d", "address": "fa:16:3e:34:77:60", "network": {"id": "52dfb1fe-f560-4f40-8594-3b13d3ff06d9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2040079808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a6bf8d596b4695a60e15661fd18352", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0c8f3c-19", "ovs_interfaceid": "ea0c8f3c-1937-4d8c-968a-21a620ff5f7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:14:13 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:77:60,bridge_name='br-int',has_traffic_filtering=True,id=ea0c8f3c-1937-4d8c-968a-21a620ff5f7d,network=Network(52dfb1fe-f560-4f40-8594-3b13d3ff06d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0c8f3c-19') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:14:13 user nova-compute[73497]: DEBUG nova.objects.instance [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Lazy-loading 'pci_devices' on Instance uuid 62f841d2-09e7-448b-8c1c-26c824c473ba {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:14:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:14:13 user nova-compute[73497]:   <uuid>62f841d2-09e7-448b-8c1c-26c824c473ba</uuid>
Aug 26 23:14:13 user nova-compute[73497]:   <name>instance-0000000a</name>
Aug 26 23:14:13 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:14:13 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:14:13 user nova-compute[73497]:   <metadata>
Aug 26 23:14:13 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:14:13 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:14:13 user nova-compute[73497]:       <nova:name>tempest-ServerActionsV293TestJSON-server-474747102</nova:name>
Aug 26 23:14:13 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:14:12</nova:creationTime>
Aug 26 23:14:13 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:14:13 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:14:13 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:14:13 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:14:13 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:14:13 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:14:13 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:14:13 user nova-compute[73497]:       <nova:owner>
Aug 26 23:14:13 user nova-compute[73497]:         <nova:user uuid="0c6bce6dad6f4c1092286fa122e6ed74">tempest-ServerActionsV293TestJSON-1814198428-project-member</nova:user>
Aug 26 23:14:13 user nova-compute[73497]:         <nova:project uuid="02a6bf8d596b4695a60e15661fd18352">tempest-ServerActionsV293TestJSON-1814198428</nova:project>
Aug 26 23:14:13 user nova-compute[73497]:       </nova:owner>
Aug 26 23:14:13 user nova-compute[73497]:       <nova:ports>
Aug 26 23:14:13 user nova-compute[73497]:         <nova:port uuid="ea0c8f3c-1937-4d8c-968a-21a620ff5f7d">
Aug 26 23:14:13 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 23:14:13 user nova-compute[73497]:         </nova:port>
Aug 26 23:14:13 user nova-compute[73497]:       </nova:ports>
Aug 26 23:14:13 user nova-compute[73497]:     </nova:instance>
Aug 26 23:14:13 user nova-compute[73497]:   </metadata>
Aug 26 23:14:13 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:14:13 user nova-compute[73497]:     <system>
Aug 26 23:14:13 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:14:13 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:14:13 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:14:13 user nova-compute[73497]:       <entry name="serial">62f841d2-09e7-448b-8c1c-26c824c473ba</entry>
Aug 26 23:14:13 user nova-compute[73497]:       <entry name="uuid">62f841d2-09e7-448b-8c1c-26c824c473ba</entry>
Aug 26 23:14:13 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:14:13 user nova-compute[73497]:     </system>
Aug 26 23:14:13 user nova-compute[73497]:   </sysinfo>
Aug 26 23:14:13 user nova-compute[73497]:   <os>
Aug 26 23:14:13 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:14:13 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:14:13 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:14:13 user nova-compute[73497]:   </os>
Aug 26 23:14:13 user nova-compute[73497]:   <features>
Aug 26 23:14:13 user nova-compute[73497]:     <acpi/>
Aug 26 23:14:13 user nova-compute[73497]:     <apic/>
Aug 26 23:14:13 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:14:13 user nova-compute[73497]:   </features>
Aug 26 23:14:13 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:14:13 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:14:13 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:14:13 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:14:13 user nova-compute[73497]:   </clock>
Aug 26 23:14:13 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:14:13 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:14:13 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:14:13 user nova-compute[73497]:   </cpu>
Aug 26 23:14:13 user nova-compute[73497]:   <devices>
Aug 26 23:14:13 user nova-compute[73497]:     <disk type="block" device="disk">
Aug 26 23:14:13 user nova-compute[73497]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:14:13 user nova-compute[73497]:       <source dev="/dev/sdb"/>
Aug 26 23:14:13 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:14:13 user nova-compute[73497]:       <serial>2fb2814e-8af9-455e-aaba-faa885d49a3a</serial>
Aug 26 23:14:13 user nova-compute[73497]:     </disk>
Aug 26 23:14:13 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:14:13 user nova-compute[73497]:       <mac address="fa:16:3e:34:77:60"/>
Aug 26 23:14:13 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:14:13 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:14:13 user nova-compute[73497]:       <target dev="tapea0c8f3c-19"/>
Aug 26 23:14:13 user nova-compute[73497]:     </interface>
Aug 26 23:14:13 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:14:13 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/62f841d2-09e7-448b-8c1c-26c824c473ba/console.log" append="off"/>
Aug 26 23:14:13 user nova-compute[73497]:     </serial>
Aug 26 23:14:13 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:14:13 user nova-compute[73497]:     <video>
Aug 26 23:14:13 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:14:13 user nova-compute[73497]:     </video>
Aug 26 23:14:13 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:14:13 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:14:13 user nova-compute[73497]:     </rng>
Aug 26 23:14:13 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:14:13 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:14:13 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:14:13 user nova-compute[73497]:     </memballoon>
Aug 26 23:14:13 user nova-compute[73497]:   </devices>
Aug 26 23:14:13 user nova-compute[73497]: </domain>
Aug 26 23:14:13 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:14:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:13:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-474747102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-474747102',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByjF8J1FTf4Yf+f0bhNilYywxbVc7jA9buhoEIOCxGzdOlcDHyYAz+iC83msNEYmiVpBnhhT5cv+65/WSDDw63y6W9k4x8IST6h+KDUrN39XmHZzLFbe/p/7dgfn+8+iA==',key_name='tempest-keypair-1496592320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02a6bf8d596b4695a60e15661fd18352',ramdisk_id='',reservation_id='r-lyo5f7oa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1814198428',owner_user_name='tempest-ServerActionsV293TestJSON-1814198428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:13:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c6bce6dad6f4c1092286fa122e6ed74',uuid=62f841d2-09e7-448b-8c1c-26c824c473ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea0c8f3c-1937-4d8c-968a-21a620ff5f7d", "address": "fa:16:3e:34:77:60", "network": {"id": "52dfb1fe-f560-4f40-8594-3b13d3ff06d9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2040079808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a6bf8d596b4695a60e15661fd18352", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0c8f3c-19", "ovs_interfaceid": "ea0c8f3c-1937-4d8c-968a-21a620ff5f7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:14:13 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Converting VIF {"id": "ea0c8f3c-1937-4d8c-968a-21a620ff5f7d", "address": "fa:16:3e:34:77:60", "network": {"id": "52dfb1fe-f560-4f40-8594-3b13d3ff06d9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2040079808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a6bf8d596b4695a60e15661fd18352", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0c8f3c-19", "ovs_interfaceid": "ea0c8f3c-1937-4d8c-968a-21a620ff5f7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:14:13 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:77:60,bridge_name='br-int',has_traffic_filtering=True,id=ea0c8f3c-1937-4d8c-968a-21a620ff5f7d,network=Network(52dfb1fe-f560-4f40-8594-3b13d3ff06d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0c8f3c-19') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:14:13 user nova-compute[73497]: DEBUG os_vif [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:77:60,bridge_name='br-int',has_traffic_filtering=True,id=ea0c8f3c-1937-4d8c-968a-21a620ff5f7d,network=Network(52dfb1fe-f560-4f40-8594-3b13d3ff06d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0c8f3c-19') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:14:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:14:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:14:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea0c8f3c-19, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:14:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapea0c8f3c-19, col_values=(('external_ids', {'iface-id': 'ea0c8f3c-1937-4d8c-968a-21a620ff5f7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:77:60', 'vm-uuid': '62f841d2-09e7-448b-8c1c-26c824c473ba'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:14:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:14:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:13 user nova-compute[73497]: INFO os_vif [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:77:60,bridge_name='br-int',has_traffic_filtering=True,id=ea0c8f3c-1937-4d8c-968a-21a620ff5f7d,network=Network(52dfb1fe-f560-4f40-8594-3b13d3ff06d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0c8f3c-19')
Aug 26 23:14:14 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:14:14 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] No VIF found with MAC fa:16:3e:34:77:60, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:14:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:15 user nova-compute[73497]: DEBUG nova.compute.manager [req-959b5f17-fcb0-477e-a956-4809f54648ae req-68153c95-a7bd-4d94-acf4-8bd062ebb994 service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Received event network-vif-plugged-ea0c8f3c-1937-4d8c-968a-21a620ff5f7d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:14:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-959b5f17-fcb0-477e-a956-4809f54648ae req-68153c95-a7bd-4d94-acf4-8bd062ebb994 service nova] Acquiring lock "62f841d2-09e7-448b-8c1c-26c824c473ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:14:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-959b5f17-fcb0-477e-a956-4809f54648ae req-68153c95-a7bd-4d94-acf4-8bd062ebb994 service nova] Lock "62f841d2-09e7-448b-8c1c-26c824c473ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:14:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-959b5f17-fcb0-477e-a956-4809f54648ae req-68153c95-a7bd-4d94-acf4-8bd062ebb994 service nova] Lock "62f841d2-09e7-448b-8c1c-26c824c473ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:14:15 user nova-compute[73497]: DEBUG nova.compute.manager [req-959b5f17-fcb0-477e-a956-4809f54648ae req-68153c95-a7bd-4d94-acf4-8bd062ebb994 service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] No waiting events found dispatching network-vif-plugged-ea0c8f3c-1937-4d8c-968a-21a620ff5f7d {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:14:15 user nova-compute[73497]: WARNING nova.compute.manager [req-959b5f17-fcb0-477e-a956-4809f54648ae req-68153c95-a7bd-4d94-acf4-8bd062ebb994 service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Received unexpected event network-vif-plugged-ea0c8f3c-1937-4d8c-968a-21a620ff5f7d for instance with vm_state building and task_state spawning.
Aug 26 23:14:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:17 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091657.4815602, 62f841d2-09e7-448b-8c1c-26c824c473ba => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:14:17 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] VM Resumed (Lifecycle Event)
Aug 26 23:14:17 user nova-compute[73497]: DEBUG nova.compute.manager [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:14:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:14:17 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Instance spawned successfully.
Aug 26 23:14:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:14:17 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:14:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:14:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:14:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:14:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:14:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:14:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:14:17 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:14:17 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:14:17 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091657.481883, 62f841d2-09e7-448b-8c1c-26c824c473ba => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:14:17 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] VM Started (Lifecycle Event)
Aug 26 23:14:17 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:14:17 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:14:17 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:14:17 user nova-compute[73497]: DEBUG nova.compute.manager [req-3ca74055-7d21-4677-8df3-71e8f835993d req-e7b08275-6af3-49ed-b332-944e2a5377e0 service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Received event network-vif-plugged-ea0c8f3c-1937-4d8c-968a-21a620ff5f7d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:14:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3ca74055-7d21-4677-8df3-71e8f835993d req-e7b08275-6af3-49ed-b332-944e2a5377e0 service nova] Acquiring lock "62f841d2-09e7-448b-8c1c-26c824c473ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:14:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3ca74055-7d21-4677-8df3-71e8f835993d req-e7b08275-6af3-49ed-b332-944e2a5377e0 service nova] Lock "62f841d2-09e7-448b-8c1c-26c824c473ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:14:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3ca74055-7d21-4677-8df3-71e8f835993d req-e7b08275-6af3-49ed-b332-944e2a5377e0 service nova] Lock "62f841d2-09e7-448b-8c1c-26c824c473ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:14:17 user nova-compute[73497]: DEBUG nova.compute.manager [req-3ca74055-7d21-4677-8df3-71e8f835993d req-e7b08275-6af3-49ed-b332-944e2a5377e0 service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] No waiting events found dispatching network-vif-plugged-ea0c8f3c-1937-4d8c-968a-21a620ff5f7d {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:14:17 user nova-compute[73497]: WARNING nova.compute.manager [req-3ca74055-7d21-4677-8df3-71e8f835993d req-e7b08275-6af3-49ed-b332-944e2a5377e0 service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Received unexpected event network-vif-plugged-ea0c8f3c-1937-4d8c-968a-21a620ff5f7d for instance with vm_state building and task_state spawning.
Aug 26 23:14:17 user nova-compute[73497]: INFO nova.compute.manager [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Took 5.08 seconds to spawn the instance on the hypervisor.
Aug 26 23:14:17 user nova-compute[73497]: DEBUG nova.compute.manager [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:14:17 user nova-compute[73497]: INFO nova.compute.manager [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Took 19.83 seconds to build instance.
Aug 26 23:14:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ad4e4e52-04ba-4ca2-baa0-204ddc65d257 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Lock "62f841d2-09e7-448b-8c1c-26c824c473ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.930s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:14:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:23 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:14:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:14:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:14:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:14:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:14:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:14:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:14:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:14:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Acquiring lock "94c286f8-2ef8-401a-ac64-693efb2f5f66" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:14:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Lock "94c286f8-2ef8-401a-ac64-693efb2f5f66" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:14:45 user nova-compute[73497]: DEBUG nova.objects.instance [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Lazy-loading 'flavor' on Instance uuid 94c286f8-2ef8-401a-ac64-693efb2f5f66 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:14:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Lock "94c286f8-2ef8-401a-ac64-693efb2f5f66" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Acquiring lock "94c286f8-2ef8-401a-ac64-693efb2f5f66" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Lock "94c286f8-2ef8-401a-ac64-693efb2f5f66" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:14:46 user nova-compute[73497]: INFO nova.compute.manager [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Attaching volume dd4859b9-25d1-4927-b29f-49dd0c4392f6 to /dev/vdb
Aug 26 23:14:46 user nova-compute[73497]: DEBUG os_brick.utils [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cac74e-b044-458d-a9bf-a4d697b1d9a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[baaaaba8-b29b-4160-b362-66afd85d3a3e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99c56de-23a2-4516-9a7d-564186dbe086]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7b30fb-100d-4211-b1f7-89ac23bb06c2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:14:46 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:14:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[882ddc78-f044-41b5-83d3-8afb3c03ea95]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG os_brick.utils [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Updating existing volume attachment record: 93b9d6db-ddc1-4a91-b5b1-d343035ff007 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Acquiring lock "79d00f46-3843-4297-ba47-33557b11d489" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Lock "79d00f46-3843-4297-ba47-33557b11d489" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG nova.compute.manager [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:46 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:14:46 user nova-compute[73497]: INFO nova.compute.claims [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Claim successful on node user
Aug 26 23:14:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865d6369-32ac-46ac-b6df-37d8fa4bf440/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865d6369-32ac-46ac-b6df-37d8fa4bf440/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865d6369-32ac-46ac-b6df-37d8fa4bf440/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865d6369-32ac-46ac-b6df-37d8fa4bf440/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94c286f8-2ef8-401a-ac64-693efb2f5f66/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:47 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:14:47 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:14:47 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.628s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:14:47 user nova-compute[73497]: DEBUG nova.compute.manager [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:14:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94c286f8-2ef8-401a-ac64-693efb2f5f66/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94c286f8-2ef8-401a-ac64-693efb2f5f66/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:47 user nova-compute[73497]: DEBUG nova.compute.manager [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:14:47 user nova-compute[73497]: DEBUG nova.network.neutron [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 79d00f46-3843-4297-ba47-33557b11d489] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:14:47 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:14:47 user nova-compute[73497]: DEBUG nova.compute.manager [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:14:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94c286f8-2ef8-401a-ac64-693efb2f5f66/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:47 user nova-compute[73497]: DEBUG nova.policy [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c36bef36a3e4edf97f3715472689420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7402b17f71d6489c9a419ac0d73abefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:14:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab745e33-a11e-4ee4-a442-1e7893448d27/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:47 user nova-compute[73497]: DEBUG nova.compute.manager [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:14:47 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:14:47 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Creating image(s)
Aug 26 23:14:47 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Acquiring lock "/opt/stack/data/nova/instances/79d00f46-3843-4297-ba47-33557b11d489/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:14:47 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Lock "/opt/stack/data/nova/instances/79d00f46-3843-4297-ba47-33557b11d489/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:14:47 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Lock "/opt/stack/data/nova/instances/79d00f46-3843-4297-ba47-33557b11d489/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:14:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab745e33-a11e-4ee4-a442-1e7893448d27/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab745e33-a11e-4ee4-a442-1e7893448d27/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.223s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:14:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:14:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:48 user nova-compute[73497]: DEBUG nova.compute.manager [None req-2bc2e01f-bba6-4d1b-9be7-2e65756bac6b tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:14:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab745e33-a11e-4ee4-a442-1e7893448d27/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:48 user nova-compute[73497]: INFO nova.compute.manager [None req-2bc2e01f-bba6-4d1b-9be7-2e65756bac6b tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] instance snapshotting
Aug 26 23:14:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.218s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/79d00f46-3843-4297-ba47-33557b11d489/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/79d00f46-3843-4297-ba47-33557b11d489/disk 1073741824" returned: 0 in 0.069s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:14:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:48 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:48 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-2bc2e01f-bba6-4d1b-9be7-2e65756bac6b tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Beginning live snapshot process
Aug 26 23:14:48 user nova-compute[73497]: DEBUG nova.network.neutron [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Successfully created port: d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:14:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.193s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:48 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Checking if we can resize image /opt/stack/data/nova/instances/79d00f46-3843-4297-ba47-33557b11d489/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:14:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79d00f46-3843-4297-ba47-33557b11d489/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:48 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:14:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfdfc81c-c44a-4e43-9053-74f1fce8ca3d/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2bc2e01f-bba6-4d1b-9be7-2e65756bac6b tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json -f qcow2 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79d00f46-3843-4297-ba47-33557b11d489/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:48 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Cannot resize image /opt/stack/data/nova/instances/79d00f46-3843-4297-ba47-33557b11d489/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:14:48 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:14:48 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Ensure instance console log exists: /opt/stack/data/nova/instances/79d00f46-3843-4297-ba47-33557b11d489/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:14:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:14:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:14:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:14:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfdfc81c-c44a-4e43-9053-74f1fce8ca3d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfdfc81c-c44a-4e43-9053-74f1fce8ca3d/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2bc2e01f-bba6-4d1b-9be7-2e65756bac6b tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2bc2e01f-bba6-4d1b-9be7-2e65756bac6b tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json -f qcow2 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfdfc81c-c44a-4e43-9053-74f1fce8ca3d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2bc2e01f-bba6-4d1b-9be7-2e65756bac6b tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json -f qcow2" returned: 0 in 0.222s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2bc2e01f-bba6-4d1b-9be7-2e65756bac6b tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2bc2e01f-bba6-4d1b-9be7-2e65756bac6b tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.218s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2bc2e01f-bba6-4d1b-9be7-2e65756bac6b tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpx3o8aqvt/b01357105d75435c98a024a6567e9686.delta 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:49 user nova-compute[73497]: DEBUG nova.network.neutron [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Successfully updated port: d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:14:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2bc2e01f-bba6-4d1b-9be7-2e65756bac6b tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpx3o8aqvt/b01357105d75435c98a024a6567e9686.delta 1073741824" returned: 0 in 0.064s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:49 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-2bc2e01f-bba6-4d1b-9be7-2e65756bac6b tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 23:14:49 user nova-compute[73497]: DEBUG nova.compute.manager [req-b6a5b84b-016e-4bb9-8def-656ba5ea0b69 req-41e7316d-c03a-4fc1-8a75-d3996057dfc8 service nova] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Received event network-changed-d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:14:49 user nova-compute[73497]: DEBUG nova.compute.manager [req-b6a5b84b-016e-4bb9-8def-656ba5ea0b69 req-41e7316d-c03a-4fc1-8a75-d3996057dfc8 service nova] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Refreshing instance network info cache due to event network-changed-d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:14:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b6a5b84b-016e-4bb9-8def-656ba5ea0b69 req-41e7316d-c03a-4fc1-8a75-d3996057dfc8 service nova] Acquiring lock "refresh_cache-79d00f46-3843-4297-ba47-33557b11d489" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:14:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b6a5b84b-016e-4bb9-8def-656ba5ea0b69 req-41e7316d-c03a-4fc1-8a75-d3996057dfc8 service nova] Acquired lock "refresh_cache-79d00f46-3843-4297-ba47-33557b11d489" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:14:49 user nova-compute[73497]: DEBUG nova.network.neutron [req-b6a5b84b-016e-4bb9-8def-656ba5ea0b69 req-41e7316d-c03a-4fc1-8a75-d3996057dfc8 service nova] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Refreshing network info cache for port d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:14:49 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-2bc2e01f-bba6-4d1b-9be7-2e65756bac6b tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Checking UEFI support for host arch (x86_64) {{(pid=73497) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 26 23:14:49 user nova-compute[73497]: INFO nova.virt.libvirt.host [None req-2bc2e01f-bba6-4d1b-9be7-2e65756bac6b tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] UEFI support detected
Aug 26 23:14:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Acquiring lock "refresh_cache-79d00f46-3843-4297-ba47-33557b11d489" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:14:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:49 user nova-compute[73497]: DEBUG nova.network.neutron [req-b6a5b84b-016e-4bb9-8def-656ba5ea0b69 req-41e7316d-c03a-4fc1-8a75-d3996057dfc8 service nova] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:14:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:50 user nova-compute[73497]: DEBUG nova.network.neutron [req-b6a5b84b-016e-4bb9-8def-656ba5ea0b69 req-41e7316d-c03a-4fc1-8a75-d3996057dfc8 service nova] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:14:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b6a5b84b-016e-4bb9-8def-656ba5ea0b69 req-41e7316d-c03a-4fc1-8a75-d3996057dfc8 service nova] Releasing lock "refresh_cache-79d00f46-3843-4297-ba47-33557b11d489" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:14:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Acquired lock "refresh_cache-79d00f46-3843-4297-ba47-33557b11d489" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:14:50 user nova-compute[73497]: DEBUG nova.network.neutron [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:14:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:50 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-2bc2e01f-bba6-4d1b-9be7-2e65756bac6b tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] COPY block job progress, current cursor: 1900544 final cursor: 75497472 {{(pid=73497) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 23:14:50 user nova-compute[73497]: DEBUG nova.network.neutron [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:14:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.network.neutron [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Updating instance_info_cache with network_info: [{"id": "d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a", "address": "fa:16:3e:3d:59:dd", "network": {"id": "823997b4-f108-4e9f-807b-2aa2c95f2b09", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-593185584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7402b17f71d6489c9a419ac0d73abefb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e1e0c2-da", "ovs_interfaceid": "d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-2bc2e01f-bba6-4d1b-9be7-2e65756bac6b tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73497) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 23:14:51 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-2bc2e01f-bba6-4d1b-9be7-2e65756bac6b tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 23:14:51 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:14:51 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=6860MB free_disk=25.532791137695312GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Releasing lock "refresh_cache-79d00f46-3843-4297-ba47-33557b11d489" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.compute.manager [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Instance network_info: |[{"id": "d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a", "address": "fa:16:3e:3d:59:dd", "network": {"id": "823997b4-f108-4e9f-807b-2aa2c95f2b09", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-593185584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7402b17f71d6489c9a419ac0d73abefb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e1e0c2-da", "ovs_interfaceid": "d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Start _get_guest_xml network_info=[{"id": "d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a", "address": "fa:16:3e:3d:59:dd", "network": {"id": "823997b4-f108-4e9f-807b-2aa2c95f2b09", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-593185584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7402b17f71d6489c9a419ac0d73abefb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e1e0c2-da", "ovs_interfaceid": "d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:14:51 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:14:51 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:14:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-465188363',display_name='tempest-ServersNegativeTestJSON-server-465188363',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-465188363',id=11,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7402b17f71d6489c9a419ac0d73abefb',ramdisk_id='',reservation_id='r-yevg8hk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1339597493',owner_user_name='tempest-ServersNegativeTestJSON-1339597493-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:14:48Z,user_data=None,user_id='8c36bef36a3e4edf97f3715472689420',uuid=79d00f46-3843-4297-ba47-33557b11d489,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a", "address": "fa:16:3e:3d:59:dd", "network": {"id": "823997b4-f108-4e9f-807b-2aa2c95f2b09", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-593185584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7402b17f71d6489c9a419ac0d73abefb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e1e0c2-da", "ovs_interfaceid": "d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Converting VIF {"id": "d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a", "address": "fa:16:3e:3d:59:dd", "network": {"id": "823997b4-f108-4e9f-807b-2aa2c95f2b09", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-593185584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7402b17f71d6489c9a419ac0d73abefb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e1e0c2-da", "ovs_interfaceid": "d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:59:dd,bridge_name='br-int',has_traffic_filtering=True,id=d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a,network=Network(823997b4-f108-4e9f-807b-2aa2c95f2b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3e1e0c2-da') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.objects.instance [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Lazy-loading 'pci_devices' on Instance uuid 79d00f46-3843-4297-ba47-33557b11d489 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 79d00f46-3843-4297-ba47-33557b11d489] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:14:51 user nova-compute[73497]:   <uuid>79d00f46-3843-4297-ba47-33557b11d489</uuid>
Aug 26 23:14:51 user nova-compute[73497]:   <name>instance-0000000b</name>
Aug 26 23:14:51 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:14:51 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:14:51 user nova-compute[73497]:   <metadata>
Aug 26 23:14:51 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:14:51 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:14:51 user nova-compute[73497]:       <nova:name>tempest-ServersNegativeTestJSON-server-465188363</nova:name>
Aug 26 23:14:51 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:14:51</nova:creationTime>
Aug 26 23:14:51 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:14:51 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:14:51 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:14:51 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:14:51 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:14:51 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:14:51 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:14:51 user nova-compute[73497]:       <nova:owner>
Aug 26 23:14:51 user nova-compute[73497]:         <nova:user uuid="8c36bef36a3e4edf97f3715472689420">tempest-ServersNegativeTestJSON-1339597493-project-member</nova:user>
Aug 26 23:14:51 user nova-compute[73497]:         <nova:project uuid="7402b17f71d6489c9a419ac0d73abefb">tempest-ServersNegativeTestJSON-1339597493</nova:project>
Aug 26 23:14:51 user nova-compute[73497]:       </nova:owner>
Aug 26 23:14:51 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:14:51 user nova-compute[73497]:       <nova:ports>
Aug 26 23:14:51 user nova-compute[73497]:         <nova:port uuid="d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a">
Aug 26 23:14:51 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 23:14:51 user nova-compute[73497]:         </nova:port>
Aug 26 23:14:51 user nova-compute[73497]:       </nova:ports>
Aug 26 23:14:51 user nova-compute[73497]:     </nova:instance>
Aug 26 23:14:51 user nova-compute[73497]:   </metadata>
Aug 26 23:14:51 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:14:51 user nova-compute[73497]:     <system>
Aug 26 23:14:51 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:14:51 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:14:51 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:14:51 user nova-compute[73497]:       <entry name="serial">79d00f46-3843-4297-ba47-33557b11d489</entry>
Aug 26 23:14:51 user nova-compute[73497]:       <entry name="uuid">79d00f46-3843-4297-ba47-33557b11d489</entry>
Aug 26 23:14:51 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:14:51 user nova-compute[73497]:     </system>
Aug 26 23:14:51 user nova-compute[73497]:   </sysinfo>
Aug 26 23:14:51 user nova-compute[73497]:   <os>
Aug 26 23:14:51 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:14:51 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:14:51 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:14:51 user nova-compute[73497]:   </os>
Aug 26 23:14:51 user nova-compute[73497]:   <features>
Aug 26 23:14:51 user nova-compute[73497]:     <acpi/>
Aug 26 23:14:51 user nova-compute[73497]:     <apic/>
Aug 26 23:14:51 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:14:51 user nova-compute[73497]:   </features>
Aug 26 23:14:51 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:14:51 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:14:51 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:14:51 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:14:51 user nova-compute[73497]:   </clock>
Aug 26 23:14:51 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:14:51 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:14:51 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:14:51 user nova-compute[73497]:   </cpu>
Aug 26 23:14:51 user nova-compute[73497]:   <devices>
Aug 26 23:14:51 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:14:51 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:14:51 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/79d00f46-3843-4297-ba47-33557b11d489/disk"/>
Aug 26 23:14:51 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:14:51 user nova-compute[73497]:     </disk>
Aug 26 23:14:51 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:14:51 user nova-compute[73497]:       <mac address="fa:16:3e:3d:59:dd"/>
Aug 26 23:14:51 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:14:51 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:14:51 user nova-compute[73497]:       <target dev="tapd3e1e0c2-da"/>
Aug 26 23:14:51 user nova-compute[73497]:     </interface>
Aug 26 23:14:51 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:14:51 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/79d00f46-3843-4297-ba47-33557b11d489/console.log" append="off"/>
Aug 26 23:14:51 user nova-compute[73497]:     </serial>
Aug 26 23:14:51 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:14:51 user nova-compute[73497]:     <video>
Aug 26 23:14:51 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:14:51 user nova-compute[73497]:     </video>
Aug 26 23:14:51 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:14:51 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:14:51 user nova-compute[73497]:     </rng>
Aug 26 23:14:51 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:14:51 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:14:51 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:14:51 user nova-compute[73497]:     </memballoon>
Aug 26 23:14:51 user nova-compute[73497]:   </devices>
Aug 26 23:14:51 user nova-compute[73497]: </domain>
Aug 26 23:14:51 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:14:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-465188363',display_name='tempest-ServersNegativeTestJSON-server-465188363',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-465188363',id=11,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7402b17f71d6489c9a419ac0d73abefb',ramdisk_id='',reservation_id='r-yevg8hk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1339597493',owner_user_name='tempest-ServersNegativeTestJSON-1339597493-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:14:48Z,user_data=None,user_id='8c36bef36a3e4edf97f3715472689420',uuid=79d00f46-3843-4297-ba47-33557b11d489,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a", "address": "fa:16:3e:3d:59:dd", "network": {"id": "823997b4-f108-4e9f-807b-2aa2c95f2b09", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-593185584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7402b17f71d6489c9a419ac0d73abefb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e1e0c2-da", "ovs_interfaceid": "d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Converting VIF {"id": "d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a", "address": "fa:16:3e:3d:59:dd", "network": {"id": "823997b4-f108-4e9f-807b-2aa2c95f2b09", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-593185584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7402b17f71d6489c9a419ac0d73abefb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e1e0c2-da", "ovs_interfaceid": "d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:59:dd,bridge_name='br-int',has_traffic_filtering=True,id=d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a,network=Network(823997b4-f108-4e9f-807b-2aa2c95f2b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3e1e0c2-da') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG os_vif [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:59:dd,bridge_name='br-int',has_traffic_filtering=True,id=d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a,network=Network(823997b4-f108-4e9f-807b-2aa2c95f2b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3e1e0c2-da') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.privsep.utils [None req-2bc2e01f-bba6-4d1b-9be7-2e65756bac6b tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73497) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2bc2e01f-bba6-4d1b-9be7-2e65756bac6b tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpx3o8aqvt/b01357105d75435c98a024a6567e9686.delta /opt/stack/data/nova/instances/snapshots/tmpx3o8aqvt/b01357105d75435c98a024a6567e9686 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3e1e0c2-da, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd3e1e0c2-da, col_values=(('external_ids', {'iface-id': 'd3e1e0c2-daf5-4e6e-bd6b-8f790b33529a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:59:dd', 'vm-uuid': '79d00f46-3843-4297-ba47-33557b11d489'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:51 user nova-compute[73497]: INFO os_vif [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:59:dd,bridge_name='br-int',has_traffic_filtering=True,id=d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a,network=Network(823997b4-f108-4e9f-807b-2aa2c95f2b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3e1e0c2-da')
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 94c286f8-2ef8-401a-ac64-693efb2f5f66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 926f8e5c-8d8a-4f07-bf08-e60700ce4698 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 994093f0-e6b2-4c96-b259-c559ef2b1fbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 171985a3-358d-4b26-a66c-372b9b99b386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 1a58c5e7-b4c7-4bd5-8dd1-a98492139240 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance cfdfc81c-c44a-4e43-9053-74f1fce8ca3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance ba3de574-ae62-4e9d-87f8-434c163d9897 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance ab745e33-a11e-4ee4-a442-1e7893448d27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 865d6369-32ac-46ac-b6df-37d8fa4bf440 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 62f841d2-09e7-448b-8c1c-26c824c473ba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 79d00f46-3843-4297-ba47-33557b11d489 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] No VIF found with MAC fa:16:3e:3d:59:dd, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2bc2e01f-bba6-4d1b-9be7-2e65756bac6b tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpx3o8aqvt/b01357105d75435c98a024a6567e9686.delta /opt/stack/data/nova/instances/snapshots/tmpx3o8aqvt/b01357105d75435c98a024a6567e9686" returned: 0 in 0.421s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:51 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-2bc2e01f-bba6-4d1b-9be7-2e65756bac6b tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Snapshot extracted, beginning image upload
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:14:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.734s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:14:52 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:14:52 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:14:52 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:14:52 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:14:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-926f8e5c-8d8a-4f07-bf08-e60700ce4698" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:14:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-926f8e5c-8d8a-4f07-bf08-e60700ce4698" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:14:52 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:14:53 user nova-compute[73497]: DEBUG nova.compute.manager [req-ebacd89b-0b6a-4d33-aca1-a7a30c136d3a req-0d8b5421-84e8-40e6-bdca-8474802f5706 service nova] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Received event network-vif-plugged-d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:14:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ebacd89b-0b6a-4d33-aca1-a7a30c136d3a req-0d8b5421-84e8-40e6-bdca-8474802f5706 service nova] Acquiring lock "79d00f46-3843-4297-ba47-33557b11d489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:14:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ebacd89b-0b6a-4d33-aca1-a7a30c136d3a req-0d8b5421-84e8-40e6-bdca-8474802f5706 service nova] Lock "79d00f46-3843-4297-ba47-33557b11d489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:14:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ebacd89b-0b6a-4d33-aca1-a7a30c136d3a req-0d8b5421-84e8-40e6-bdca-8474802f5706 service nova] Lock "79d00f46-3843-4297-ba47-33557b11d489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:14:53 user nova-compute[73497]: DEBUG nova.compute.manager [req-ebacd89b-0b6a-4d33-aca1-a7a30c136d3a req-0d8b5421-84e8-40e6-bdca-8474802f5706 service nova] [instance: 79d00f46-3843-4297-ba47-33557b11d489] No waiting events found dispatching network-vif-plugged-d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:14:53 user nova-compute[73497]: WARNING nova.compute.manager [req-ebacd89b-0b6a-4d33-aca1-a7a30c136d3a req-0d8b5421-84e8-40e6-bdca-8474802f5706 service nova] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Received unexpected event network-vif-plugged-d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a for instance with vm_state building and task_state spawning.
Aug 26 23:14:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:53 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Updating instance_info_cache with network_info: [{"id": "400e10af-326e-4457-bf67-f7e350fd821e", "address": "fa:16:3e:25:9f:76", "network": {"id": "823997b4-f108-4e9f-807b-2aa2c95f2b09", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-593185584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7402b17f71d6489c9a419ac0d73abefb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400e10af-32", "ovs_interfaceid": "400e10af-326e-4457-bf67-f7e350fd821e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:14:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-926f8e5c-8d8a-4f07-bf08-e60700ce4698" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:14:53 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:14:53 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:14:53 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:14:53 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:14:53 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:14:53 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:14:53 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:14:53 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:14:54 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-2bc2e01f-bba6-4d1b-9be7-2e65756bac6b tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Snapshot image upload complete
Aug 26 23:14:54 user nova-compute[73497]: INFO nova.compute.manager [None req-2bc2e01f-bba6-4d1b-9be7-2e65756bac6b tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Took 6.47 seconds to snapshot the instance on the hypervisor.
Aug 26 23:14:55 user nova-compute[73497]: DEBUG nova.compute.manager [req-06e4242c-856e-4ad5-aa4d-a4c0aea72adb req-79a9b876-cdab-4723-8cde-2947679a30c5 service nova] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Received event network-vif-plugged-d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:14:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-06e4242c-856e-4ad5-aa4d-a4c0aea72adb req-79a9b876-cdab-4723-8cde-2947679a30c5 service nova] Acquiring lock "79d00f46-3843-4297-ba47-33557b11d489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:14:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-06e4242c-856e-4ad5-aa4d-a4c0aea72adb req-79a9b876-cdab-4723-8cde-2947679a30c5 service nova] Lock "79d00f46-3843-4297-ba47-33557b11d489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:14:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-06e4242c-856e-4ad5-aa4d-a4c0aea72adb req-79a9b876-cdab-4723-8cde-2947679a30c5 service nova] Lock "79d00f46-3843-4297-ba47-33557b11d489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:14:55 user nova-compute[73497]: DEBUG nova.compute.manager [req-06e4242c-856e-4ad5-aa4d-a4c0aea72adb req-79a9b876-cdab-4723-8cde-2947679a30c5 service nova] [instance: 79d00f46-3843-4297-ba47-33557b11d489] No waiting events found dispatching network-vif-plugged-d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:14:55 user nova-compute[73497]: WARNING nova.compute.manager [req-06e4242c-856e-4ad5-aa4d-a4c0aea72adb req-79a9b876-cdab-4723-8cde-2947679a30c5 service nova] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Received unexpected event network-vif-plugged-d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a for instance with vm_state building and task_state spawning.
Aug 26 23:14:55 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091695.328745, 79d00f46-3843-4297-ba47-33557b11d489 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:14:55 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 79d00f46-3843-4297-ba47-33557b11d489] VM Resumed (Lifecycle Event)
Aug 26 23:14:55 user nova-compute[73497]: DEBUG nova.compute.manager [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:14:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:14:55 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Instance spawned successfully.
Aug 26 23:14:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:14:55 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:14:55 user nova-compute[73497]: DEBUG nova.compute.manager [req-84ea7279-18f1-4a7a-b24d-f25f44e48d28 req-5498135b-4f74-4db8-b3ef-a42122bd90ff service nova] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Received event network-changed-1772e978-02b5-4c0b-a99c-67f6c6f91d58 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:14:55 user nova-compute[73497]: DEBUG nova.compute.manager [req-84ea7279-18f1-4a7a-b24d-f25f44e48d28 req-5498135b-4f74-4db8-b3ef-a42122bd90ff service nova] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Refreshing instance network info cache due to event network-changed-1772e978-02b5-4c0b-a99c-67f6c6f91d58. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:14:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-84ea7279-18f1-4a7a-b24d-f25f44e48d28 req-5498135b-4f74-4db8-b3ef-a42122bd90ff service nova] Acquiring lock "refresh_cache-171985a3-358d-4b26-a66c-372b9b99b386" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:14:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-84ea7279-18f1-4a7a-b24d-f25f44e48d28 req-5498135b-4f74-4db8-b3ef-a42122bd90ff service nova] Acquired lock "refresh_cache-171985a3-358d-4b26-a66c-372b9b99b386" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:14:55 user nova-compute[73497]: DEBUG nova.network.neutron [req-84ea7279-18f1-4a7a-b24d-f25f44e48d28 req-5498135b-4f74-4db8-b3ef-a42122bd90ff service nova] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Refreshing network info cache for port 1772e978-02b5-4c0b-a99c-67f6c6f91d58 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:14:55 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:14:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:14:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:14:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:14:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:14:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:14:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:14:55 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 79d00f46-3843-4297-ba47-33557b11d489] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:14:55 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091695.3301685, 79d00f46-3843-4297-ba47-33557b11d489 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:14:55 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 79d00f46-3843-4297-ba47-33557b11d489] VM Started (Lifecycle Event)
Aug 26 23:14:55 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:14:55 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:14:55 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 79d00f46-3843-4297-ba47-33557b11d489] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:14:55 user nova-compute[73497]: INFO nova.compute.manager [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Took 7.65 seconds to spawn the instance on the hypervisor.
Aug 26 23:14:55 user nova-compute[73497]: DEBUG nova.compute.manager [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:14:55 user nova-compute[73497]: INFO nova.compute.manager [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Took 8.78 seconds to build instance.
Aug 26 23:14:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-842521fe-b6e7-472f-a7df-7c739fc28939 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Lock "79d00f46-3843-4297-ba47-33557b11d489" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.901s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:14:56 user nova-compute[73497]: DEBUG nova.network.neutron [req-84ea7279-18f1-4a7a-b24d-f25f44e48d28 req-5498135b-4f74-4db8-b3ef-a42122bd90ff service nova] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Updated VIF entry in instance network info cache for port 1772e978-02b5-4c0b-a99c-67f6c6f91d58. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:14:56 user nova-compute[73497]: DEBUG nova.network.neutron [req-84ea7279-18f1-4a7a-b24d-f25f44e48d28 req-5498135b-4f74-4db8-b3ef-a42122bd90ff service nova] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Updating instance_info_cache with network_info: [{"id": "1772e978-02b5-4c0b-a99c-67f6c6f91d58", "address": "fa:16:3e:a7:28:86", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1772e978-02", "ovs_interfaceid": "1772e978-02b5-4c0b-a99c-67f6c6f91d58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:14:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-84ea7279-18f1-4a7a-b24d-f25f44e48d28 req-5498135b-4f74-4db8-b3ef-a42122bd90ff service nova] Releasing lock "refresh_cache-171985a3-358d-4b26-a66c-372b9b99b386" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:14:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hQXqRapC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:14:59 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:14:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:14:59 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:14:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:14:59 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:14:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff54f82-da5b-429c-9680-ae25ae017028]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:14:59 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[91dd76a7-0652-4b0b-8ce6-d1d91c422056]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6] added
Aug 26 23:14:59 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c66fa6e-b517-4535-bcaa-ceb22a946ecb]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d63988f-bb5a-4274-99fe-43bc3c9cbd05]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hQXqRapC {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hQXqRapC" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[086a87f5-bb1d-4a70-b8f4-ea1a6dd1c186]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hQXqRapC'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b330993d-649c-468a-bd17-0e8b4d87ebad]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[31de9f59-bd95-4ed4-9d49-986234cadfd9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:14:59 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:14:59 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[281c46c4-aed6-445e-83b7-67e5626859bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6, portal: 172.16.0.220,3260]
Aug 26 23:14:59 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6, portal: 172.16.0.220,3260] successful.
Aug 26 23:14:59 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7f04b5-75a4-408c-b6f9-df58db1d8906]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[486fe9e4-99c9-4f60-aa35-0ff175eb8a15]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:14:59 user nova-compute[73497]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6 (non-flash)
Aug 26 23:14:59 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:14:59 user nova-compute[73497]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6 (non-flash)
Aug 26 23:14:59 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b387c29-3e97-4996-badb-b5a2ed4ad8f6]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:14:59 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:15:00 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:15:00 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hQXqRapC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:15:00 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:15:00 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23062353866353532', 'path': '/dev/sdc'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:15:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062353866353532', 'path': '/dev/sdc'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:15:00 user nova-compute[73497]: DEBUG nova.objects.instance [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Lazy-loading 'flavor' on Instance uuid 94c286f8-2ef8-401a-ac64-693efb2f5f66 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:15:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 23:15:00 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:15:00 user nova-compute[73497]:   <source dev="/dev/sdc"/>
Aug 26 23:15:00 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:15:00 user nova-compute[73497]:   <serial>dd4859b9-25d1-4927-b29f-49dd0c4392f6</serial>
Aug 26 23:15:00 user nova-compute[73497]: </disk>
Aug 26 23:15:00 user nova-compute[73497]:  {{(pid=73497) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 23:15:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:15:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:15:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] No VIF found with MAC fa:16:3e:9f:f4:b7, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:15:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0684dc06-2553-4e91-8a25-b41af63790d2 tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Lock "94c286f8-2ef8-401a-ac64-693efb2f5f66" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.102s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:15:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Acquiring lock "94c286f8-2ef8-401a-ac64-693efb2f5f66" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Lock "94c286f8-2ef8-401a-ac64-693efb2f5f66" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Acquiring lock "94c286f8-2ef8-401a-ac64-693efb2f5f66-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Lock "94c286f8-2ef8-401a-ac64-693efb2f5f66-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Lock "94c286f8-2ef8-401a-ac64-693efb2f5f66-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:15:01 user nova-compute[73497]: INFO nova.compute.manager [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Terminating instance
Aug 26 23:15:01 user nova-compute[73497]: DEBUG nova.compute.manager [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:15:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:01 user nova-compute[73497]: DEBUG nova.compute.manager [req-f90cb56c-ec06-44a8-9384-3e649928fb4b req-c6b438ea-7fa0-445c-a13e-dc03e1cb5964 service nova] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Received event network-vif-unplugged-aecca1b3-87bd-4db1-9c2c-112129841f10 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:15:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f90cb56c-ec06-44a8-9384-3e649928fb4b req-c6b438ea-7fa0-445c-a13e-dc03e1cb5964 service nova] Acquiring lock "94c286f8-2ef8-401a-ac64-693efb2f5f66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f90cb56c-ec06-44a8-9384-3e649928fb4b req-c6b438ea-7fa0-445c-a13e-dc03e1cb5964 service nova] Lock "94c286f8-2ef8-401a-ac64-693efb2f5f66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f90cb56c-ec06-44a8-9384-3e649928fb4b req-c6b438ea-7fa0-445c-a13e-dc03e1cb5964 service nova] Lock "94c286f8-2ef8-401a-ac64-693efb2f5f66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:15:01 user nova-compute[73497]: DEBUG nova.compute.manager [req-f90cb56c-ec06-44a8-9384-3e649928fb4b req-c6b438ea-7fa0-445c-a13e-dc03e1cb5964 service nova] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] No waiting events found dispatching network-vif-unplugged-aecca1b3-87bd-4db1-9c2c-112129841f10 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:15:01 user nova-compute[73497]: DEBUG nova.compute.manager [req-f90cb56c-ec06-44a8-9384-3e649928fb4b req-c6b438ea-7fa0-445c-a13e-dc03e1cb5964 service nova] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Received event network-vif-unplugged-aecca1b3-87bd-4db1-9c2c-112129841f10 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:15:02 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Instance destroyed successfully.
Aug 26 23:15:02 user nova-compute[73497]: DEBUG nova.objects.instance [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Lazy-loading 'resources' on Instance uuid 94c286f8-2ef8-401a-ac64-693efb2f5f66 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:12:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1847347160',display_name='tempest-DeleteServersTestJSON-server-1847347160',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1847347160',id=1,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:13:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5dfec25f4b56484bb2deeaeafa30ee2d',ramdisk_id='',reservation_id='r-6zvygd0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-613311809',owner_user_name='tempest-DeleteServersTestJSON-613311809-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:13:06Z,user_data=None,user_id='7d9e06ee23ac4e22bd881530dd7ad36f',uuid=94c286f8-2ef8-401a-ac64-693efb2f5f66,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aecca1b3-87bd-4db1-9c2c-112129841f10", "address": "fa:16:3e:9f:f4:b7", "network": {"id": "ea7e0883-053d-42f8-9749-efc1d858f673", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2049683477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dfec25f4b56484bb2deeaeafa30ee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaecca1b3-87", "ovs_interfaceid": "aecca1b3-87bd-4db1-9c2c-112129841f10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Converting VIF {"id": "aecca1b3-87bd-4db1-9c2c-112129841f10", "address": "fa:16:3e:9f:f4:b7", "network": {"id": "ea7e0883-053d-42f8-9749-efc1d858f673", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2049683477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dfec25f4b56484bb2deeaeafa30ee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaecca1b3-87", "ovs_interfaceid": "aecca1b3-87bd-4db1-9c2c-112129841f10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:f4:b7,bridge_name='br-int',has_traffic_filtering=True,id=aecca1b3-87bd-4db1-9c2c-112129841f10,network=Network(ea7e0883-053d-42f8-9749-efc1d858f673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaecca1b3-87') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG os_vif [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:f4:b7,bridge_name='br-int',has_traffic_filtering=True,id=aecca1b3-87bd-4db1-9c2c-112129841f10,network=Network(ea7e0883-053d-42f8-9749-efc1d858f673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaecca1b3-87') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaecca1b3-87, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:15:02 user nova-compute[73497]: INFO os_vif [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:f4:b7,bridge_name='br-int',has_traffic_filtering=True,id=aecca1b3-87bd-4db1-9c2c-112129841f10,network=Network(ea7e0883-053d-42f8-9749-efc1d858f673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaecca1b3-87')
Aug 26 23:15:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hQXqRapC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:15:02 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:15:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0d6188-286a-464c-8af3-8a571fd2567f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0de4d5-ccb5-413b-86a9-09eb483232a7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:15:02 user nova-compute[73497]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6 (non-flash)
Aug 26 23:15:02 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:15:02 user nova-compute[73497]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6 (non-flash)
Aug 26 23:15:02 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282c3c3a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6'): ({'sdc'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Removing single pathed devices sdc {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1ec531-fe0a-4175-830f-534bb724b86b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d2335f-2e76-45b1-b2a5-f78722086573]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Flushing IO for device /dev/sdc {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18a59a7-6dc5-48d9-a6ec-bda435cf2ce4]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2926c25-3fc9-459a-8dd3-3c96514022df]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] SCSI volumes sdc have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[af089f6a-9298-4a94-976e-b949b4b07780]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef8c49d-e725-41b2-80c6-66de03090204]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6, portal: 172.16.0.220,3260]
Aug 26 23:15:02 user nova-compute[73497]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6, portal: 172.16.0.220,3260] successful.
Aug 26 23:15:02 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd4859b9-25d1-4927-b29f-49dd0c4392f6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3053d513-9bdb-4685-9e24-bb145a632996]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] <== disconnect_volume: return (316ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:15:02 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Deleting instance files /opt/stack/data/nova/instances/94c286f8-2ef8-401a-ac64-693efb2f5f66_del
Aug 26 23:15:02 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Deletion of /opt/stack/data/nova/instances/94c286f8-2ef8-401a-ac64-693efb2f5f66_del complete
Aug 26 23:15:02 user nova-compute[73497]: INFO nova.compute.manager [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Took 1.34 seconds to destroy the instance on the hypervisor.
Aug 26 23:15:02 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:15:02 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:15:03 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:15:03 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Took 0.78 seconds to deallocate network for instance.
Aug 26 23:15:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-3719a2f0-0dfb-4fe2-9da1-773c3f77757a req-c176f558-4478-471e-b14f-b577ab1f7121 service nova] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Received event network-vif-deleted-aecca1b3-87bd-4db1-9c2c-112129841f10 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:15:03 user nova-compute[73497]: INFO nova.compute.manager [req-3719a2f0-0dfb-4fe2-9da1-773c3f77757a req-c176f558-4478-471e-b14f-b577ab1f7121 service nova] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Neutron deleted interface aecca1b3-87bd-4db1-9c2c-112129841f10; detaching it from the instance and deleting it from the info cache
Aug 26 23:15:03 user nova-compute[73497]: DEBUG nova.network.neutron [req-3719a2f0-0dfb-4fe2-9da1-773c3f77757a req-c176f558-4478-471e-b14f-b577ab1f7121 service nova] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:15:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-3719a2f0-0dfb-4fe2-9da1-773c3f77757a req-c176f558-4478-471e-b14f-b577ab1f7121 service nova] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Detach interface failed, port_id=aecca1b3-87bd-4db1-9c2c-112129841f10, reason: Instance 94c286f8-2ef8-401a-ac64-693efb2f5f66 could not be found. {{(pid=73497) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 23:15:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-86fefa51-8ac1-4d5d-b880-72e7bf11f6dd req-0a6aaccf-d89d-4d38-ac92-8e5572d63de3 service nova] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Received event network-changed-4ee7875d-cd17-4e1e-8b9c-962eaa271398 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:15:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-86fefa51-8ac1-4d5d-b880-72e7bf11f6dd req-0a6aaccf-d89d-4d38-ac92-8e5572d63de3 service nova] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Refreshing instance network info cache due to event network-changed-4ee7875d-cd17-4e1e-8b9c-962eaa271398. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:15:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-86fefa51-8ac1-4d5d-b880-72e7bf11f6dd req-0a6aaccf-d89d-4d38-ac92-8e5572d63de3 service nova] Acquiring lock "refresh_cache-1a58c5e7-b4c7-4bd5-8dd1-a98492139240" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:15:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-86fefa51-8ac1-4d5d-b880-72e7bf11f6dd req-0a6aaccf-d89d-4d38-ac92-8e5572d63de3 service nova] Acquired lock "refresh_cache-1a58c5e7-b4c7-4bd5-8dd1-a98492139240" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:15:03 user nova-compute[73497]: DEBUG nova.network.neutron [req-86fefa51-8ac1-4d5d-b880-72e7bf11f6dd req-0a6aaccf-d89d-4d38-ac92-8e5572d63de3 service nova] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Refreshing network info cache for port 4ee7875d-cd17-4e1e-8b9c-962eaa271398 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:15:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-371f627a-e234-4745-a191-c443ad56f6bb req-f91a4ec5-7901-47c6-ad9a-bd9b416837c7 service nova] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Received event network-vif-plugged-aecca1b3-87bd-4db1-9c2c-112129841f10 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:15:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-371f627a-e234-4745-a191-c443ad56f6bb req-f91a4ec5-7901-47c6-ad9a-bd9b416837c7 service nova] Acquiring lock "94c286f8-2ef8-401a-ac64-693efb2f5f66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-371f627a-e234-4745-a191-c443ad56f6bb req-f91a4ec5-7901-47c6-ad9a-bd9b416837c7 service nova] Lock "94c286f8-2ef8-401a-ac64-693efb2f5f66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-371f627a-e234-4745-a191-c443ad56f6bb req-f91a4ec5-7901-47c6-ad9a-bd9b416837c7 service nova] Lock "94c286f8-2ef8-401a-ac64-693efb2f5f66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:15:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-371f627a-e234-4745-a191-c443ad56f6bb req-f91a4ec5-7901-47c6-ad9a-bd9b416837c7 service nova] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] No waiting events found dispatching network-vif-plugged-aecca1b3-87bd-4db1-9c2c-112129841f10 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:15:03 user nova-compute[73497]: WARNING nova.compute.manager [req-371f627a-e234-4745-a191-c443ad56f6bb req-f91a4ec5-7901-47c6-ad9a-bd9b416837c7 service nova] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Received unexpected event network-vif-plugged-aecca1b3-87bd-4db1-9c2c-112129841f10 for instance with vm_state active and task_state deleting.
Aug 26 23:15:04 user nova-compute[73497]: DEBUG nova.network.neutron [req-86fefa51-8ac1-4d5d-b880-72e7bf11f6dd req-0a6aaccf-d89d-4d38-ac92-8e5572d63de3 service nova] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Updated VIF entry in instance network info cache for port 4ee7875d-cd17-4e1e-8b9c-962eaa271398. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:15:04 user nova-compute[73497]: DEBUG nova.network.neutron [req-86fefa51-8ac1-4d5d-b880-72e7bf11f6dd req-0a6aaccf-d89d-4d38-ac92-8e5572d63de3 service nova] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Updating instance_info_cache with network_info: [{"id": "4ee7875d-cd17-4e1e-8b9c-962eaa271398", "address": "fa:16:3e:2b:48:b2", "network": {"id": "4eb3bf86-7f68-4a81-90f9-f34da6231d59", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-299898849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "546cdb5907fc494c94ea81cfcef71a28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee7875d-cd", "ovs_interfaceid": "4ee7875d-cd17-4e1e-8b9c-962eaa271398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:15:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-86fefa51-8ac1-4d5d-b880-72e7bf11f6dd req-0a6aaccf-d89d-4d38-ac92-8e5572d63de3 service nova] Releasing lock "refresh_cache-1a58c5e7-b4c7-4bd5-8dd1-a98492139240" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:15:04 user nova-compute[73497]: INFO nova.compute.manager [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Took 1.11 seconds to detach 1 volumes for instance.
Aug 26 23:15:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:05 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:15:05 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:15:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.526s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:15:05 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Deleted allocations for instance 94c286f8-2ef8-401a-ac64-693efb2f5f66
Aug 26 23:15:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8a7ff814-c00b-4fee-b32f-e3c22fc8801c tempest-DeleteServersTestJSON-613311809 tempest-DeleteServersTestJSON-613311809-project-member] Lock "94c286f8-2ef8-401a-ac64-693efb2f5f66" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.059s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:15:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Acquiring lock "1a58c5e7-b4c7-4bd5-8dd1-a98492139240" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "1a58c5e7-b4c7-4bd5-8dd1-a98492139240" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:08 user nova-compute[73497]: DEBUG nova.objects.instance [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lazy-loading 'flavor' on Instance uuid 1a58c5e7-b4c7-4bd5-8dd1-a98492139240 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:15:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "1a58c5e7-b4c7-4bd5-8dd1-a98492139240" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:15:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Acquiring lock "1a58c5e7-b4c7-4bd5-8dd1-a98492139240" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "1a58c5e7-b4c7-4bd5-8dd1-a98492139240" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:09 user nova-compute[73497]: INFO nova.compute.manager [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Attaching volume d4078384-8f2b-4a03-b874-a9fbbac505c9 to /dev/vdb
Aug 26 23:15:09 user nova-compute[73497]: DEBUG os_brick.utils [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:15:09 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:09 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:09 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[391f34ed-9faa-44bc-9923-d92b00d9fe2d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:09 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:09 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:09 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[262697df-0f32-4e44-a000-4806bc83f80b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:09 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:09 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:09 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[208b817e-53f5-4287-bba1-1dca9d7d08f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:09 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d246285-f700-4d68-8bf5-6430a54037aa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:09 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:09 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:15:09 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:15:09 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:09 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:15:09 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:15:09 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ce4a68-aca9-436c-a1f7-a30dcd0f5ca4]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:09 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:15:09 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:15:09 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:15:09 user nova-compute[73497]: DEBUG os_brick.utils [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:15:09 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Updating existing volume attachment record: eabd4450-5888-4112-aa71-6fe5d2066da9 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:15:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:15 user nova-compute[73497]: DEBUG nova.compute.manager [req-689cb570-e52e-4478-b121-8ed1a1c6899d req-d6f5b9bd-8239-469c-b2ee-8806798554b6 service nova] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Received event network-changed-11dc5742-f487-414e-b289-90a7fddccaec {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:15:15 user nova-compute[73497]: DEBUG nova.compute.manager [req-689cb570-e52e-4478-b121-8ed1a1c6899d req-d6f5b9bd-8239-469c-b2ee-8806798554b6 service nova] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Refreshing instance network info cache due to event network-changed-11dc5742-f487-414e-b289-90a7fddccaec. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:15:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-689cb570-e52e-4478-b121-8ed1a1c6899d req-d6f5b9bd-8239-469c-b2ee-8806798554b6 service nova] Acquiring lock "refresh_cache-cfdfc81c-c44a-4e43-9053-74f1fce8ca3d" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:15:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-689cb570-e52e-4478-b121-8ed1a1c6899d req-d6f5b9bd-8239-469c-b2ee-8806798554b6 service nova] Acquired lock "refresh_cache-cfdfc81c-c44a-4e43-9053-74f1fce8ca3d" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:15:15 user nova-compute[73497]: DEBUG nova.network.neutron [req-689cb570-e52e-4478-b121-8ed1a1c6899d req-d6f5b9bd-8239-469c-b2ee-8806798554b6 service nova] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Refreshing network info cache for port 11dc5742-f487-414e-b289-90a7fddccaec {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:15:16 user nova-compute[73497]: DEBUG nova.network.neutron [req-689cb570-e52e-4478-b121-8ed1a1c6899d req-d6f5b9bd-8239-469c-b2ee-8806798554b6 service nova] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Updated VIF entry in instance network info cache for port 11dc5742-f487-414e-b289-90a7fddccaec. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:15:16 user nova-compute[73497]: DEBUG nova.network.neutron [req-689cb570-e52e-4478-b121-8ed1a1c6899d req-d6f5b9bd-8239-469c-b2ee-8806798554b6 service nova] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Updating instance_info_cache with network_info: [{"id": "11dc5742-f487-414e-b289-90a7fddccaec", "address": "fa:16:3e:d9:48:94", "network": {"id": "40420587-c296-4175-9bd3-81c86df22141", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-831716329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b681bf9074b4c37b9aa9cff23838b6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11dc5742-f4", "ovs_interfaceid": "11dc5742-f487-414e-b289-90a7fddccaec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:15:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-689cb570-e52e-4478-b121-8ed1a1c6899d req-d6f5b9bd-8239-469c-b2ee-8806798554b6 service nova] Releasing lock "refresh_cache-cfdfc81c-c44a-4e43-9053-74f1fce8ca3d" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:15:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:17 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693091702.4067836, 94c286f8-2ef8-401a-ac64-693efb2f5f66 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:15:17 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] VM Stopped (Lifecycle Event)
Aug 26 23:15:17 user nova-compute[73497]: DEBUG nova.compute.manager [None req-ac8482b7-a0fe-4a22-9bdc-70e75b1cb19f None None] [instance: 94c286f8-2ef8-401a-ac64-693efb2f5f66] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:15:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:18 user nova-compute[73497]: DEBUG nova.compute.manager [req-88a86834-28cd-4259-8a23-4d2b22beeb5c req-9300b5bb-7b02-480c-b526-97c8ef3653c2 service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Received event network-changed-ca3ccf3a-86b0-492c-99ae-9cdca5df9336 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:15:18 user nova-compute[73497]: DEBUG nova.compute.manager [req-88a86834-28cd-4259-8a23-4d2b22beeb5c req-9300b5bb-7b02-480c-b526-97c8ef3653c2 service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Refreshing instance network info cache due to event network-changed-ca3ccf3a-86b0-492c-99ae-9cdca5df9336. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:15:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-88a86834-28cd-4259-8a23-4d2b22beeb5c req-9300b5bb-7b02-480c-b526-97c8ef3653c2 service nova] Acquiring lock "refresh_cache-ba3de574-ae62-4e9d-87f8-434c163d9897" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:15:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-88a86834-28cd-4259-8a23-4d2b22beeb5c req-9300b5bb-7b02-480c-b526-97c8ef3653c2 service nova] Acquired lock "refresh_cache-ba3de574-ae62-4e9d-87f8-434c163d9897" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:15:18 user nova-compute[73497]: DEBUG nova.network.neutron [req-88a86834-28cd-4259-8a23-4d2b22beeb5c req-9300b5bb-7b02-480c-b526-97c8ef3653c2 service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Refreshing network info cache for port ca3ccf3a-86b0-492c-99ae-9cdca5df9336 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:15:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e99c7986-d772-45d3-9cb0-672714ba6bb8 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Acquiring lock "interface-ba3de574-ae62-4e9d-87f8-434c163d9897-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e99c7986-d772-45d3-9cb0-672714ba6bb8 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lock "interface-ba3de574-ae62-4e9d-87f8-434c163d9897-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:18 user nova-compute[73497]: DEBUG nova.objects.instance [None req-e99c7986-d772-45d3-9cb0-672714ba6bb8 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lazy-loading 'flavor' on Instance uuid ba3de574-ae62-4e9d-87f8-434c163d9897 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:15:18 user nova-compute[73497]: DEBUG nova.objects.instance [None req-e99c7986-d772-45d3-9cb0-672714ba6bb8 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lazy-loading 'pci_requests' on Instance uuid ba3de574-ae62-4e9d-87f8-434c163d9897 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:15:18 user nova-compute[73497]: DEBUG nova.objects.base [None req-e99c7986-d772-45d3-9cb0-672714ba6bb8 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Object Instance<ba3de574-ae62-4e9d-87f8-434c163d9897> lazy-loaded attributes: flavor,pci_requests {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:15:18 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e99c7986-d772-45d3-9cb0-672714ba6bb8 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:15:18 user nova-compute[73497]: DEBUG nova.network.neutron [req-88a86834-28cd-4259-8a23-4d2b22beeb5c req-9300b5bb-7b02-480c-b526-97c8ef3653c2 service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Updated VIF entry in instance network info cache for port ca3ccf3a-86b0-492c-99ae-9cdca5df9336. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:15:18 user nova-compute[73497]: DEBUG nova.network.neutron [req-88a86834-28cd-4259-8a23-4d2b22beeb5c req-9300b5bb-7b02-480c-b526-97c8ef3653c2 service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Updating instance_info_cache with network_info: [{"id": "ca3ccf3a-86b0-492c-99ae-9cdca5df9336", "address": "fa:16:3e:48:b6:d8", "network": {"id": "ab1acb2f-a437-49f1-a450-c4001cb8a037", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1785575264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e456078921734435bd38b72c5266d50e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3ccf3a-86", "ovs_interfaceid": "ca3ccf3a-86b0-492c-99ae-9cdca5df9336", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:15:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-88a86834-28cd-4259-8a23-4d2b22beeb5c req-9300b5bb-7b02-480c-b526-97c8ef3653c2 service nova] Releasing lock "refresh_cache-ba3de574-ae62-4e9d-87f8-434c163d9897" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:15:19 user nova-compute[73497]: DEBUG nova.policy [None req-e99c7986-d772-45d3-9cb0-672714ba6bb8 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a73eb19d92254c56b126c555a94c9457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456078921734435bd38b72c5266d50e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:15:19 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e99c7986-d772-45d3-9cb0-672714ba6bb8 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Successfully created port: aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:15:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Acquiring lock "cfdfc81c-c44a-4e43-9053-74f1fce8ca3d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Lock "cfdfc81c-c44a-4e43-9053-74f1fce8ca3d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:20 user nova-compute[73497]: DEBUG nova.objects.instance [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Lazy-loading 'flavor' on Instance uuid cfdfc81c-c44a-4e43-9053-74f1fce8ca3d {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:15:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Lock "cfdfc81c-c44a-4e43-9053-74f1fce8ca3d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:15:20 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e99c7986-d772-45d3-9cb0-672714ba6bb8 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Successfully updated port: aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:15:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e99c7986-d772-45d3-9cb0-672714ba6bb8 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Acquiring lock "refresh_cache-ba3de574-ae62-4e9d-87f8-434c163d9897" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:15:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e99c7986-d772-45d3-9cb0-672714ba6bb8 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Acquired lock "refresh_cache-ba3de574-ae62-4e9d-87f8-434c163d9897" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:15:20 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e99c7986-d772-45d3-9cb0-672714ba6bb8 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:15:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Acquiring lock "cfdfc81c-c44a-4e43-9053-74f1fce8ca3d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Lock "cfdfc81c-c44a-4e43-9053-74f1fce8ca3d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:20 user nova-compute[73497]: INFO nova.compute.manager [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Attaching volume 7589756a-f275-495b-b635-d93ede974b61 to /dev/sdc
Aug 26 23:15:20 user nova-compute[73497]: DEBUG nova.compute.manager [req-509c5505-a19e-4104-a40b-8d1ba277c04a req-0c7fcf6f-6c25-4add-8035-d09741ec7356 service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Received event network-changed-aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:15:20 user nova-compute[73497]: DEBUG nova.compute.manager [req-509c5505-a19e-4104-a40b-8d1ba277c04a req-0c7fcf6f-6c25-4add-8035-d09741ec7356 service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Refreshing instance network info cache due to event network-changed-aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:15:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-509c5505-a19e-4104-a40b-8d1ba277c04a req-0c7fcf6f-6c25-4add-8035-d09741ec7356 service nova] Acquiring lock "refresh_cache-ba3de574-ae62-4e9d-87f8-434c163d9897" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:15:20 user nova-compute[73497]: DEBUG os_brick.utils [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:15:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:20 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b52e96-34cb-49f8-af0d-069955077e1a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:20 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc78469-eafa-467b-b97d-a9ad283dcb0a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:20 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fb74aa-b12e-4cf1-8447-ba02177165be]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:20 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d94d44-f16c-4fd4-b8a5-e4135e0024b1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:15:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:15:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:15:20 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:15:20 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c32b12-0e61-40fe-bb1a-1ce7e7802cb9]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:15:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:15:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:15:20 user nova-compute[73497]: DEBUG os_brick.utils [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] <== get_connector_properties: return (192ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:15:20 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Updating existing volume attachment record: 864a60c6-efd2-4c3f-9700-12a00a0c0180 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:15:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:21 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e99c7986-d772-45d3-9cb0-672714ba6bb8 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Updating instance_info_cache with network_info: [{"id": "ca3ccf3a-86b0-492c-99ae-9cdca5df9336", "address": "fa:16:3e:48:b6:d8", "network": {"id": "ab1acb2f-a437-49f1-a450-c4001cb8a037", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1785575264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e456078921734435bd38b72c5266d50e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3ccf3a-86", "ovs_interfaceid": "ca3ccf3a-86b0-492c-99ae-9cdca5df9336", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a", "address": "fa:16:3e:db:9f:b9", "network": {"id": "6c7174a0-0c76-4d29-b4cf-d57ffb086db3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-823928317", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e456078921734435bd38b72c5266d50e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaac12afe-d2", "ovs_interfaceid": "aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:15:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e99c7986-d772-45d3-9cb0-672714ba6bb8 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Releasing lock "refresh_cache-ba3de574-ae62-4e9d-87f8-434c163d9897" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:15:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-509c5505-a19e-4104-a40b-8d1ba277c04a req-0c7fcf6f-6c25-4add-8035-d09741ec7356 service nova] Acquired lock "refresh_cache-ba3de574-ae62-4e9d-87f8-434c163d9897" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:15:21 user nova-compute[73497]: DEBUG nova.network.neutron [req-509c5505-a19e-4104-a40b-8d1ba277c04a req-0c7fcf6f-6c25-4add-8035-d09741ec7356 service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Refreshing network info cache for port aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:15:21 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-e99c7986-d772-45d3-9cb0-672714ba6bb8 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:13:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1306226483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1306226483',id=7,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGe8nVo8i9dIVTRdjLRLAe5YZ0C6xyesogGuomHtses/n0zpuFh2lyzmy4UGl4SR+46J+vpwNqJeLYiNhrlPlaBcbP0iXsCzU1gcnZhT083Y39OsqxeF8liKiCYtA2+jQ==',key_name='tempest-keypair-411871039',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:13:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e456078921734435bd38b72c5266d50e',ramdisk_id='',reservation_id='r-hw890ap9',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-200456857',owner_user_name='tempest-TaggedAttachmentsTest-200456857-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:13:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a73eb19d92254c56b126c555a94c9457',uuid=ba3de574-ae62-4e9d-87f8-434c163d9897,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a", "address": "fa:16:3e:db:9f:b9", "network": {"id": "6c7174a0-0c76-4d29-b4cf-d57ffb086db3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-823928317", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e456078921734435bd38b72c5266d50e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaac12afe-d2", "ovs_interfaceid": "aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:15:21 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e99c7986-d772-45d3-9cb0-672714ba6bb8 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Converting VIF {"id": "aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a", "address": "fa:16:3e:db:9f:b9", "network": {"id": "6c7174a0-0c76-4d29-b4cf-d57ffb086db3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-823928317", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e456078921734435bd38b72c5266d50e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaac12afe-d2", "ovs_interfaceid": "aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:15:21 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e99c7986-d772-45d3-9cb0-672714ba6bb8 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:9f:b9,bridge_name='br-int',has_traffic_filtering=True,id=aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a,network=Network(6c7174a0-0c76-4d29-b4cf-d57ffb086db3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaac12afe-d2') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:15:21 user nova-compute[73497]: DEBUG os_vif [None req-e99c7986-d772-45d3-9cb0-672714ba6bb8 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:9f:b9,bridge_name='br-int',has_traffic_filtering=True,id=aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a,network=Network(6c7174a0-0c76-4d29-b4cf-d57ffb086db3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaac12afe-d2') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:15:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:15:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:15:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaac12afe-d2, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:15:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaac12afe-d2, col_values=(('external_ids', {'iface-id': 'aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:9f:b9', 'vm-uuid': 'ba3de574-ae62-4e9d-87f8-434c163d9897'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:15:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:15:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:21 user nova-compute[73497]: INFO os_vif [None req-e99c7986-d772-45d3-9cb0-672714ba6bb8 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:9f:b9,bridge_name='br-int',has_traffic_filtering=True,id=aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a,network=Network(6c7174a0-0c76-4d29-b4cf-d57ffb086db3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaac12afe-d2')
Aug 26 23:15:21 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-e99c7986-d772-45d3-9cb0-672714ba6bb8 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:13:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1306226483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1306226483',id=7,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGe8nVo8i9dIVTRdjLRLAe5YZ0C6xyesogGuomHtses/n0zpuFh2lyzmy4UGl4SR+46J+vpwNqJeLYiNhrlPlaBcbP0iXsCzU1gcnZhT083Y39OsqxeF8liKiCYtA2+jQ==',key_name='tempest-keypair-411871039',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:13:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e456078921734435bd38b72c5266d50e',ramdisk_id='',reservation_id='r-hw890ap9',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-200456857',owner_user_name='tempest-TaggedAttachmentsTest-200456857-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:13:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a73eb19d92254c56b126c555a94c9457',uuid=ba3de574-ae62-4e9d-87f8-434c163d9897,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a", "address": "fa:16:3e:db:9f:b9", "network": {"id": "6c7174a0-0c76-4d29-b4cf-d57ffb086db3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-823928317", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e456078921734435bd38b72c5266d50e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaac12afe-d2", "ovs_interfaceid": "aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:15:21 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e99c7986-d772-45d3-9cb0-672714ba6bb8 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Converting VIF {"id": "aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a", "address": "fa:16:3e:db:9f:b9", "network": {"id": "6c7174a0-0c76-4d29-b4cf-d57ffb086db3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-823928317", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e456078921734435bd38b72c5266d50e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaac12afe-d2", "ovs_interfaceid": "aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:15:21 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e99c7986-d772-45d3-9cb0-672714ba6bb8 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:9f:b9,bridge_name='br-int',has_traffic_filtering=True,id=aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a,network=Network(6c7174a0-0c76-4d29-b4cf-d57ffb086db3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaac12afe-d2') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:15:21 user nova-compute[73497]: DEBUG nova.compute.manager [req-2d377f13-a7b2-4afd-9611-2c881a7eb65e req-eed5ac33-1c76-4c85-906e-89975f4a136a service nova] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Received event network-changed-227712b4-3763-41dd-ab89-b42888471e7d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:15:21 user nova-compute[73497]: DEBUG nova.compute.manager [req-2d377f13-a7b2-4afd-9611-2c881a7eb65e req-eed5ac33-1c76-4c85-906e-89975f4a136a service nova] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Refreshing instance network info cache due to event network-changed-227712b4-3763-41dd-ab89-b42888471e7d. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:15:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2d377f13-a7b2-4afd-9611-2c881a7eb65e req-eed5ac33-1c76-4c85-906e-89975f4a136a service nova] Acquiring lock "refresh_cache-ab745e33-a11e-4ee4-a442-1e7893448d27" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:15:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2d377f13-a7b2-4afd-9611-2c881a7eb65e req-eed5ac33-1c76-4c85-906e-89975f4a136a service nova] Acquired lock "refresh_cache-ab745e33-a11e-4ee4-a442-1e7893448d27" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:15:21 user nova-compute[73497]: DEBUG nova.network.neutron [req-2d377f13-a7b2-4afd-9611-2c881a7eb65e req-eed5ac33-1c76-4c85-906e-89975f4a136a service nova] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Refreshing network info cache for port 227712b4-3763-41dd-ab89-b42888471e7d {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:15:21 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-e99c7986-d772-45d3-9cb0-672714ba6bb8 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] attach device xml: <interface type="ethernet">
Aug 26 23:15:21 user nova-compute[73497]:   <mac address="fa:16:3e:db:9f:b9"/>
Aug 26 23:15:21 user nova-compute[73497]:   <model type="virtio"/>
Aug 26 23:15:21 user nova-compute[73497]:   <mtu size="1442"/>
Aug 26 23:15:21 user nova-compute[73497]:   <target dev="tapaac12afe-d2"/>
Aug 26 23:15:21 user nova-compute[73497]: </interface>
Aug 26 23:15:21 user nova-compute[73497]:  {{(pid=73497) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 23:15:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Acquiring lock "ab745e33-a11e-4ee4-a442-1e7893448d27" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Lock "ab745e33-a11e-4ee4-a442-1e7893448d27" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.005s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:21 user nova-compute[73497]: DEBUG nova.objects.instance [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Lazy-loading 'flavor' on Instance uuid ab745e33-a11e-4ee4-a442-1e7893448d27 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:15:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Lock "ab745e33-a11e-4ee4-a442-1e7893448d27" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:15:21 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e99c7986-d772-45d3-9cb0-672714ba6bb8 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:15:21 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e99c7986-d772-45d3-9cb0-672714ba6bb8 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] No BDM found with device name hda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:15:21 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e99c7986-d772-45d3-9cb0-672714ba6bb8 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] No VIF found with MAC fa:16:3e:48:b6:d8, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:15:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Acquiring lock "ab745e33-a11e-4ee4-a442-1e7893448d27" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Lock "ab745e33-a11e-4ee4-a442-1e7893448d27" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:21 user nova-compute[73497]: INFO nova.compute.manager [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Attaching volume 8bbc3abb-c6d3-471c-b47f-e9a43806dfac to /dev/vdb
Aug 26 23:15:21 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-e99c7986-d772-45d3-9cb0-672714ba6bb8 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:15:21 user nova-compute[73497]:   <nova:package version="0.0.0"/>
Aug 26 23:15:21 user nova-compute[73497]:   <nova:name>tempest-device-tagging-server-1306226483</nova:name>
Aug 26 23:15:21 user nova-compute[73497]:   <nova:creationTime>2023-08-26 23:15:21</nova:creationTime>
Aug 26 23:15:21 user nova-compute[73497]:   <nova:flavor name="m1.tiny">
Aug 26 23:15:21 user nova-compute[73497]:     <nova:memory>512</nova:memory>
Aug 26 23:15:21 user nova-compute[73497]:     <nova:disk>1</nova:disk>
Aug 26 23:15:21 user nova-compute[73497]:     <nova:swap>0</nova:swap>
Aug 26 23:15:21 user nova-compute[73497]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:15:21 user nova-compute[73497]:     <nova:vcpus>1</nova:vcpus>
Aug 26 23:15:21 user nova-compute[73497]:   </nova:flavor>
Aug 26 23:15:21 user nova-compute[73497]:   <nova:owner>
Aug 26 23:15:21 user nova-compute[73497]:     <nova:user uuid="a73eb19d92254c56b126c555a94c9457">tempest-TaggedAttachmentsTest-200456857-project-member</nova:user>
Aug 26 23:15:21 user nova-compute[73497]:     <nova:project uuid="e456078921734435bd38b72c5266d50e">tempest-TaggedAttachmentsTest-200456857</nova:project>
Aug 26 23:15:21 user nova-compute[73497]:   </nova:owner>
Aug 26 23:15:21 user nova-compute[73497]:   <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:15:21 user nova-compute[73497]:   <nova:ports>
Aug 26 23:15:21 user nova-compute[73497]:     <nova:port uuid="ca3ccf3a-86b0-492c-99ae-9cdca5df9336">
Aug 26 23:15:21 user nova-compute[73497]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 23:15:21 user nova-compute[73497]:     </nova:port>
Aug 26 23:15:21 user nova-compute[73497]:     <nova:port uuid="aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a">
Aug 26 23:15:21 user nova-compute[73497]:       <nova:ip type="fixed" address="10.10.10.10" ipVersion="4"/>
Aug 26 23:15:21 user nova-compute[73497]:     </nova:port>
Aug 26 23:15:21 user nova-compute[73497]:   </nova:ports>
Aug 26 23:15:21 user nova-compute[73497]: </nova:instance>
Aug 26 23:15:21 user nova-compute[73497]:  {{(pid=73497) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e99c7986-d772-45d3-9cb0-672714ba6bb8 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lock "interface-ba3de574-ae62-4e9d-87f8-434c163d9897-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.452s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG nova.network.neutron [req-2d377f13-a7b2-4afd-9611-2c881a7eb65e req-eed5ac33-1c76-4c85-906e-89975f4a136a service nova] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Updated VIF entry in instance network info cache for port 227712b4-3763-41dd-ab89-b42888471e7d. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG nova.network.neutron [req-2d377f13-a7b2-4afd-9611-2c881a7eb65e req-eed5ac33-1c76-4c85-906e-89975f4a136a service nova] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Updating instance_info_cache with network_info: [{"id": "227712b4-3763-41dd-ab89-b42888471e7d", "address": "fa:16:3e:bc:5b:4b", "network": {"id": "d4bf6de0-149b-43b1-904c-1c0bcaa629f4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1964773456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b86400102fe46bea973847594aeb2f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap227712b4-37", "ovs_interfaceid": "227712b4-3763-41dd-ab89-b42888471e7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2d377f13-a7b2-4afd-9611-2c881a7eb65e req-eed5ac33-1c76-4c85-906e-89975f4a136a service nova] Releasing lock "refresh_cache-ab745e33-a11e-4ee4-a442-1e7893448d27" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG os_brick.utils [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG nova.network.neutron [req-509c5505-a19e-4104-a40b-8d1ba277c04a req-0c7fcf6f-6c25-4add-8035-d09741ec7356 service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Updated VIF entry in instance network info cache for port aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG nova.network.neutron [req-509c5505-a19e-4104-a40b-8d1ba277c04a req-0c7fcf6f-6c25-4add-8035-d09741ec7356 service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Updating instance_info_cache with network_info: [{"id": "ca3ccf3a-86b0-492c-99ae-9cdca5df9336", "address": "fa:16:3e:48:b6:d8", "network": {"id": "ab1acb2f-a437-49f1-a450-c4001cb8a037", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1785575264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e456078921734435bd38b72c5266d50e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3ccf3a-86", "ovs_interfaceid": "ca3ccf3a-86b0-492c-99ae-9cdca5df9336", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a", "address": "fa:16:3e:db:9f:b9", "network": {"id": "6c7174a0-0c76-4d29-b4cf-d57ffb086db3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-823928317", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e456078921734435bd38b72c5266d50e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaac12afe-d2", "ovs_interfaceid": "aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a60ad9c-33d4-4b7c-85b1-567e257a49e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-509c5505-a19e-4104-a40b-8d1ba277c04a req-0c7fcf6f-6c25-4add-8035-d09741ec7356 service nova] Releasing lock "refresh_cache-ba3de574-ae62-4e9d-87f8-434c163d9897" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[209ce99d-b751-44db-b670-f881e33d6efa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b87cba-9eec-4b23-851c-b45f49ccd9de]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf1b233-8f6d-4ead-98ab-575456771a2f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:15:22 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:15:22 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1773c091-c9aa-495a-9bca-a219da88e55d]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG os_brick.utils [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Updating existing volume attachment record: 7d36e741-ead0-4332-bd4d-424ea792df97 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG nova.compute.manager [req-57521b47-2c4a-44b4-8b0a-534f29ef9a0c req-14100d32-01d4-4395-87af-00e7043271fe service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Received event network-vif-plugged-aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-57521b47-2c4a-44b4-8b0a-534f29ef9a0c req-14100d32-01d4-4395-87af-00e7043271fe service nova] Acquiring lock "ba3de574-ae62-4e9d-87f8-434c163d9897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-57521b47-2c4a-44b4-8b0a-534f29ef9a0c req-14100d32-01d4-4395-87af-00e7043271fe service nova] Lock "ba3de574-ae62-4e9d-87f8-434c163d9897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-57521b47-2c4a-44b4-8b0a-534f29ef9a0c req-14100d32-01d4-4395-87af-00e7043271fe service nova] Lock "ba3de574-ae62-4e9d-87f8-434c163d9897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG nova.compute.manager [req-57521b47-2c4a-44b4-8b0a-534f29ef9a0c req-14100d32-01d4-4395-87af-00e7043271fe service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] No waiting events found dispatching network-vif-plugged-aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:15:22 user nova-compute[73497]: WARNING nova.compute.manager [req-57521b47-2c4a-44b4-8b0a-534f29ef9a0c req-14100d32-01d4-4395-87af-00e7043271fe service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Received unexpected event network-vif-plugged-aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a for instance with vm_state active and task_state None.
Aug 26 23:15:22 user nova-compute[73497]: DEBUG nova.compute.manager [req-57521b47-2c4a-44b4-8b0a-534f29ef9a0c req-14100d32-01d4-4395-87af-00e7043271fe service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Received event network-vif-plugged-aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-57521b47-2c4a-44b4-8b0a-534f29ef9a0c req-14100d32-01d4-4395-87af-00e7043271fe service nova] Acquiring lock "ba3de574-ae62-4e9d-87f8-434c163d9897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-57521b47-2c4a-44b4-8b0a-534f29ef9a0c req-14100d32-01d4-4395-87af-00e7043271fe service nova] Lock "ba3de574-ae62-4e9d-87f8-434c163d9897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-57521b47-2c4a-44b4-8b0a-534f29ef9a0c req-14100d32-01d4-4395-87af-00e7043271fe service nova] Lock "ba3de574-ae62-4e9d-87f8-434c163d9897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:15:22 user nova-compute[73497]: DEBUG nova.compute.manager [req-57521b47-2c4a-44b4-8b0a-534f29ef9a0c req-14100d32-01d4-4395-87af-00e7043271fe service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] No waiting events found dispatching network-vif-plugged-aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:15:22 user nova-compute[73497]: WARNING nova.compute.manager [req-57521b47-2c4a-44b4-8b0a-534f29ef9a0c req-14100d32-01d4-4395-87af-00e7043271fe service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Received unexpected event network-vif-plugged-aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a for instance with vm_state active and task_state None.
Aug 26 23:15:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LbSZfgNM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:15:31 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:15:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:15:31 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:15:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:15:31 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:15:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5608beb0-4f85-49fb-8c96-fe3a005eb008]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:15:31 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0ee848-a937-41ae-98da-bece05259170]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9] added
Aug 26 23:15:31 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Acquiring lock "ba3de574-ae62-4e9d-87f8-434c163d9897" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lock "ba3de574-ae62-4e9d-87f8-434c163d9897" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG nova.objects.instance [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lazy-loading 'flavor' on Instance uuid ba3de574-ae62-4e9d-87f8-434c163d9897 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6541e1f1-8997-4029-98c2-2d619fad3e2b]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f6fcff-de4b-4948-bbff-5515856433de]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LbSZfgNM {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lock "ba3de574-ae62-4e9d-87f8-434c163d9897" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LbSZfgNM" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb48082e-a739-41a3-801f-885d29f32ed3]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LbSZfgNM'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[311311e2-7eac-40de-81e3-18c2f11536df]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[163c7952-8880-4aec-9bb2-6041b7a3b54e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:15:31 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:15:31 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oYGZNXHf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:15:31 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:15:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db3305e-0771-4e12-bafd-0eee5bb746ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9, portal: 172.16.0.220,3260]
Aug 26 23:15:32 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9, portal: 172.16.0.220,3260] successful.
Aug 26 23:15:32 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a39e0a-c099-4db4-a7d6-9404b4aa427c]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[14aac770-a767-460d-a811-40bd76e60f82]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:15:32 user nova-compute[73497]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 (non-flash)
Aug 26 23:15:32 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:15:32 user nova-compute[73497]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 (non-flash)
Aug 26 23:15:32 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e8df35-69e1-4fcd-a59b-448cd795d4fa]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: None {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Acquiring lock "ba3de574-ae62-4e9d-87f8-434c163d9897" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lock "ba3de574-ae62-4e9d-87f8-434c163d9897" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:32 user nova-compute[73497]: INFO nova.compute.manager [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Attaching volume 04380a1a-8e66-4551-b6d3-9992d9509d40 to /dev/vdb
Aug 26 23:15:32 user nova-compute[73497]: DEBUG os_brick.utils [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ff0951-573b-4312-901f-4bebfa9a7fb5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4fb108-e461-44d6-953d-127895c39413]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c84feb-6c1e-4bc7-b4a1-f8e683dfd92d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fa0fdb-4be0-4b56-a561-d2de6d6f710d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:15:32 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:15:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e939bee9-1227-4b44-ad39-be17098188e1]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG os_brick.utils [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:15:32 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Updating existing volume attachment record: 30fadc85-001a-4a98-b051-b086ad49cbb3 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LbSZfgNM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26132333962316136', 'path': '/dev/sdc'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132333962316136', 'path': '/dev/sdc'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.100s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:15:33 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:15:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:15:33 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG nova.objects.instance [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lazy-loading 'flavor' on Instance uuid 1a58c5e7-b4c7-4bd5-8dd1-a98492139240 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c192a684-744e-4f86-a7d6-0f69766c16c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:15:33 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 23:15:33 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:15:33 user nova-compute[73497]:   <source dev="/dev/sdc"/>
Aug 26 23:15:33 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:15:33 user nova-compute[73497]:   <serial>d4078384-8f2b-4a03-b874-a9fbbac505c9</serial>
Aug 26 23:15:33 user nova-compute[73497]: </disk>
Aug 26 23:15:33 user nova-compute[73497]:  {{(pid=73497) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2abf269-9e07-436c-8d64-a23c3b2b0f01]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61] added
Aug 26 23:15:33 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b80e41-f119-4035-9150-32469e08753b]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fc148d-9c46-48fa-8880-a9f00c9cbb36]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oYGZNXHf {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oYGZNXHf" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f38b6e-eddb-47e9-9f99-845b7da59bd8]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oYGZNXHf'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13beb62-bb80-4406-977e-d70c6a8fd689]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c5a319-d9bc-4389-a1d5-3c68406b2c86]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:15:33 user nova-compute[73497]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 (non-flash)
Aug 26 23:15:33 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:15:33 user nova-compute[73497]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 (non-flash)
Aug 26 23:15:33 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae461a1b-9cf8-4809-b087-b13cc84c51db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61, portal: 172.16.0.220,3260]
Aug 26 23:15:33 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61, portal: 172.16.0.220,3260] successful.
Aug 26 23:15:33 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacba574-8767-4609-9167-3c6c7f6611e0]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7254e345-98b5-4ead-af50-fc18b12d19a6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:15:33 user nova-compute[73497]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 (non-flash)
Aug 26 23:15:33 user nova-compute[73497]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61 (non-flash)
Aug 26 23:15:33 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:15:33 user nova-compute[73497]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 (non-flash)
Aug 26 23:15:33 user nova-compute[73497]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61 (non-flash)
Aug 26 23:15:33 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c27c71-aee1-4e53-94c1-ceaebc8acbbc]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oYGZNXHf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lQKeEtSk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:15:33 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:15:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] No VIF found with MAC fa:16:3e:2b:48:b2, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-4c6efefc-6b8e-4363-98fc-2a5906b5b191 req-9b589479-825b-4163-a73e-436d5a99efec service nova] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Received event network-changed-1aecc224-deb4-4bb2-90e4-21471146ebf4 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-4c6efefc-6b8e-4363-98fc-2a5906b5b191 req-9b589479-825b-4163-a73e-436d5a99efec service nova] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Refreshing instance network info cache due to event network-changed-1aecc224-deb4-4bb2-90e4-21471146ebf4. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4c6efefc-6b8e-4363-98fc-2a5906b5b191 req-9b589479-825b-4163-a73e-436d5a99efec service nova] Acquiring lock "refresh_cache-865d6369-32ac-46ac-b6df-37d8fa4bf440" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4c6efefc-6b8e-4363-98fc-2a5906b5b191 req-9b589479-825b-4163-a73e-436d5a99efec service nova] Acquired lock "refresh_cache-865d6369-32ac-46ac-b6df-37d8fa4bf440" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG nova.network.neutron [req-4c6efefc-6b8e-4363-98fc-2a5906b5b191 req-9b589479-825b-4163-a73e-436d5a99efec service nova] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Refreshing network info cache for port 1aecc224-deb4-4bb2-90e4-21471146ebf4 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-a14bf82e-5e55-45a2-b440-2781a3143580 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "1a58c5e7-b4c7-4bd5-8dd1-a98492139240" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.737s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Acquiring lock "865d6369-32ac-46ac-b6df-37d8fa4bf440" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Lock "865d6369-32ac-46ac-b6df-37d8fa4bf440" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:33 user nova-compute[73497]: DEBUG nova.objects.instance [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Lazy-loading 'flavor' on Instance uuid 865d6369-32ac-46ac-b6df-37d8fa4bf440 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Lock "865d6369-32ac-46ac-b6df-37d8fa4bf440" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.127s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG nova.network.neutron [req-4c6efefc-6b8e-4363-98fc-2a5906b5b191 req-9b589479-825b-4163-a73e-436d5a99efec service nova] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Updated VIF entry in instance network info cache for port 1aecc224-deb4-4bb2-90e4-21471146ebf4. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG nova.network.neutron [req-4c6efefc-6b8e-4363-98fc-2a5906b5b191 req-9b589479-825b-4163-a73e-436d5a99efec service nova] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Updating instance_info_cache with network_info: [{"id": "1aecc224-deb4-4bb2-90e4-21471146ebf4", "address": "fa:16:3e:4a:4b:6c", "network": {"id": "3aab5362-39c3-4ee6-9e1d-13e88d7dfa0b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-8435068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c79abf19d9b1457bb5cb22c1072526d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aecc224-de", "ovs_interfaceid": "1aecc224-deb4-4bb2-90e4-21471146ebf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4c6efefc-6b8e-4363-98fc-2a5906b5b191 req-9b589479-825b-4163-a73e-436d5a99efec service nova] Releasing lock "refresh_cache-865d6369-32ac-46ac-b6df-37d8fa4bf440" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Acquiring lock "865d6369-32ac-46ac-b6df-37d8fa4bf440" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Lock "865d6369-32ac-46ac-b6df-37d8fa4bf440" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:34 user nova-compute[73497]: INFO nova.compute.manager [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Attaching volume d9eb27dd-3a77-4acc-a0d8-d053152b9b63 to /dev/vdb
Aug 26 23:15:34 user nova-compute[73497]: DEBUG os_brick.utils [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecacf70-1ff9-48b0-8f15-b70a8d4f0da3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[686e563e-439e-4ab9-85e7-353f232fd008]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fc4928-91a6-490b-866f-fb414d05b1a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bc8a6f-0909-4fc7-8a37-83332a24243c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:15:34 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99b9ad6-c521-4934-a39f-2b53c05d9f43]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG os_brick.utils [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Updating existing volume attachment record: 7e8d5740-2da9-4e39-9659-81d1462b1740 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] <== connect_volume: return (2436ms) {'type': 'block', 'scsi_wwn': '26636383462386464', 'path': '/dev/sdd'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636383462386464', 'path': '/dev/sdd'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.876s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:15:34 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:15:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:15:34 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG nova.objects.instance [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Lazy-loading 'flavor' on Instance uuid cfdfc81c-c44a-4e43-9053-74f1fce8ca3d {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c060236e-553a-4bc7-86a7-a52fc9168bde]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:15:34 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 23:15:34 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:15:34 user nova-compute[73497]:   <source dev="/dev/sdd"/>
Aug 26 23:15:34 user nova-compute[73497]:   <target dev="sdc" bus="scsi"/>
Aug 26 23:15:34 user nova-compute[73497]:   <serial>7589756a-f275-495b-b635-d93ede974b61</serial>
Aug 26 23:15:34 user nova-compute[73497]:   <address type="drive" controller="0" unit="2"/>
Aug 26 23:15:34 user nova-compute[73497]: </disk>
Aug 26 23:15:34 user nova-compute[73497]:  {{(pid=73497) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fdaf580-4616-480e-82b8-39755976821c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac] added
Aug 26 23:15:34 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0828c381-3a45-4f54-b235-69a84d1b0bae]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[58080574-335b-4236-9ed8-e80c2c32f46c]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lQKeEtSk {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lQKeEtSk" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[132f2889-d6de-4deb-867b-0eb9e6d77017]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lQKeEtSk'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1e1594-2c89-4576-9685-1c3b64aa91b8]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38fa632-5d3f-4872-a175-7477753460d0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:15:34 user nova-compute[73497]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 (non-flash)
Aug 26 23:15:34 user nova-compute[73497]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61 (non-flash)
Aug 26 23:15:34 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:15:34 user nova-compute[73497]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 (non-flash)
Aug 26 23:15:34 user nova-compute[73497]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61 (non-flash)
Aug 26 23:15:34 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1e5e3e-cbbe-4d35-9822-5379ca2be729]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac, portal: 172.16.0.220,3260]
Aug 26 23:15:34 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac, portal: 172.16.0.220,3260] successful.
Aug 26 23:15:34 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d435336-b71a-41e6-9988-beafebedd33b]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4743c6b-8ac5-49bd-86ba-ed39352201b1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:15:34 user nova-compute[73497]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 (non-flash)
Aug 26 23:15:34 user nova-compute[73497]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61 (non-flash)
Aug 26 23:15:34 user nova-compute[73497]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)
Aug 26 23:15:34 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:15:34 user nova-compute[73497]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 (non-flash)
Aug 26 23:15:34 user nova-compute[73497]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61 (non-flash)
Aug 26 23:15:34 user nova-compute[73497]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)
Aug 26 23:15:34 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4c7599-186f-49fd-bb7f-bca6facb0a68]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lQKeEtSk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c7a77674-b363-4c8f-b0db-dd784a964d75 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Acquiring lock "1a58c5e7-b4c7-4bd5-8dd1-a98492139240" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c7a77674-b363-4c8f-b0db-dd784a964d75 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "1a58c5e7-b4c7-4bd5-8dd1-a98492139240" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] No BDM found with device name sda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] No BDM found with device name sdc, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:15:34 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] No VIF found with MAC fa:16:3e:d9:48:94, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:15:35 user nova-compute[73497]: INFO nova.compute.manager [None req-c7a77674-b363-4c8f-b0db-dd784a964d75 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Detaching volume d4078384-8f2b-4a03-b874-a9fbbac505c9
Aug 26 23:15:35 user nova-compute[73497]: INFO nova.virt.block_device [None req-c7a77674-b363-4c8f-b0db-dd784a964d75 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Attempting to driver detach volume d4078384-8f2b-4a03-b874-a9fbbac505c9 from mountpoint /dev/vdb
Aug 26 23:15:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c7a77674-b363-4c8f-b0db-dd784a964d75 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Attempting to detach device vdb from instance 1a58c5e7-b4c7-4bd5-8dd1-a98492139240 from the persistent domain config. {{(pid=73497) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-c7a77674-b363-4c8f-b0db-dd784a964d75 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:15:35 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:15:35 user nova-compute[73497]:   <source dev="/dev/sdc"/>
Aug 26 23:15:35 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:15:35 user nova-compute[73497]:   <serial>d4078384-8f2b-4a03-b874-a9fbbac505c9</serial>
Aug 26 23:15:35 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:15:35 user nova-compute[73497]: </disk>
Aug 26 23:15:35 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:15:35 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-c7a77674-b363-4c8f-b0db-dd784a964d75 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Successfully detached device vdb from instance 1a58c5e7-b4c7-4bd5-8dd1-a98492139240 from the persistent domain config.
Aug 26 23:15:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c7a77674-b363-4c8f-b0db-dd784a964d75 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1a58c5e7-b4c7-4bd5-8dd1-a98492139240 from the live domain config. {{(pid=73497) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-c7a77674-b363-4c8f-b0db-dd784a964d75 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:15:35 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:15:35 user nova-compute[73497]:   <source dev="/dev/sdc"/>
Aug 26 23:15:35 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:15:35 user nova-compute[73497]:   <serial>d4078384-8f2b-4a03-b874-a9fbbac505c9</serial>
Aug 26 23:15:35 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:15:35 user nova-compute[73497]: </disk>
Aug 26 23:15:35 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8eaa07dc-93e0-43fc-8818-60001eedba5e tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Lock "cfdfc81c-c44a-4e43-9053-74f1fce8ca3d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.579s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Received event <DeviceRemovedEvent: 1693091735.5568624, 1a58c5e7-b4c7-4bd5-8dd1-a98492139240 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73497) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c7a77674-b363-4c8f-b0db-dd784a964d75 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1a58c5e7-b4c7-4bd5-8dd1-a98492139240 {{(pid=73497) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 23:15:35 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-c7a77674-b363-4c8f-b0db-dd784a964d75 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Successfully detached device vdb from instance 1a58c5e7-b4c7-4bd5-8dd1-a98492139240 from the live domain config.
Aug 26 23:15:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7a77674-b363-4c8f-b0db-dd784a964d75 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a77674-b363-4c8f-b0db-dd784a964d75 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LbSZfgNM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:15:35 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-c7a77674-b363-4c8f-b0db-dd784a964d75 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:15:35 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-c7a77674-b363-4c8f-b0db-dd784a964d75 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-7f2d9b2c-33e1-415e-958f-9257ee662cc6 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Acquiring lock "cfdfc81c-c44a-4e43-9053-74f1fce8ca3d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-7f2d9b2c-33e1-415e-958f-9257ee662cc6 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Lock "cfdfc81c-c44a-4e43-9053-74f1fce8ca3d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:35 user nova-compute[73497]: INFO nova.compute.manager [None req-7f2d9b2c-33e1-415e-958f-9257ee662cc6 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Detaching volume 7589756a-f275-495b-b635-d93ede974b61
Aug 26 23:15:35 user nova-compute[73497]: INFO nova.virt.block_device [None req-7f2d9b2c-33e1-415e-958f-9257ee662cc6 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Attempting to driver detach volume 7589756a-f275-495b-b635-d93ede974b61 from mountpoint /dev/sdc
Aug 26 23:15:35 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] <== connect_volume: return (2232ms) {'type': 'block', 'scsi_wwn': '23033303261346634', 'path': '/dev/sde'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033303261346634', 'path': '/dev/sde'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-c7a77674-b363-4c8f-b0db-dd784a964d75 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.214s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a77674-b363-4c8f-b0db-dd784a964d75 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG nova.objects.instance [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Lazy-loading 'flavor' on Instance uuid ab745e33-a11e-4ee4-a442-1e7893448d27 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7f2d9b2c-33e1-415e-958f-9257ee662cc6 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Attempting to detach device sdc from instance cfdfc81c-c44a-4e43-9053-74f1fce8ca3d from the persistent domain config. {{(pid=73497) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-7f2d9b2c-33e1-415e-958f-9257ee662cc6 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:15:35 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:15:35 user nova-compute[73497]:   <source dev="/dev/sdd"/>
Aug 26 23:15:35 user nova-compute[73497]:   <target dev="sdc" bus="scsi"/>
Aug 26 23:15:35 user nova-compute[73497]:   <serial>7589756a-f275-495b-b635-d93ede974b61</serial>
Aug 26 23:15:35 user nova-compute[73497]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 26 23:15:35 user nova-compute[73497]: </disk>
Aug 26 23:15:35 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe8b5a6-403b-40d4-a4e5-bb8d74fd8d01]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:35 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-7f2d9b2c-33e1-415e-958f-9257ee662cc6 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Successfully detached device sdc from instance cfdfc81c-c44a-4e43-9053-74f1fce8ca3d from the persistent domain config.
Aug 26 23:15:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7f2d9b2c-33e1-415e-958f-9257ee662cc6 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance cfdfc81c-c44a-4e43-9053-74f1fce8ca3d from the live domain config. {{(pid=73497) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-7f2d9b2c-33e1-415e-958f-9257ee662cc6 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:15:35 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:15:35 user nova-compute[73497]:   <source dev="/dev/sdd"/>
Aug 26 23:15:35 user nova-compute[73497]:   <target dev="sdc" bus="scsi"/>
Aug 26 23:15:35 user nova-compute[73497]:   <serial>7589756a-f275-495b-b635-d93ede974b61</serial>
Aug 26 23:15:35 user nova-compute[73497]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 26 23:15:35 user nova-compute[73497]: </disk>
Aug 26 23:15:35 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 23:15:35 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:15:35 user nova-compute[73497]:   <source dev="/dev/sde"/>
Aug 26 23:15:35 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:15:35 user nova-compute[73497]:   <serial>8bbc3abb-c6d3-471c-b47f-e9a43806dfac</serial>
Aug 26 23:15:35 user nova-compute[73497]: </disk>
Aug 26 23:15:35 user nova-compute[73497]:  {{(pid=73497) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[016a9528-f29d-4e41-b619-3479c9df8da0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a77674-b363-4c8f-b0db-dd784a964d75 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:15:35 user nova-compute[73497]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 (non-flash)
Aug 26 23:15:35 user nova-compute[73497]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61 (non-flash)
Aug 26 23:15:35 user nova-compute[73497]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)
Aug 26 23:15:35 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a77674-b363-4c8f-b0db-dd784a964d75 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:15:35 user nova-compute[73497]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 (non-flash)
Aug 26 23:15:35 user nova-compute[73497]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61 (non-flash)
Aug 26 23:15:35 user nova-compute[73497]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)
Aug 26 23:15:35 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a77674-b363-4c8f-b0db-dd784a964d75 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282c10cb80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9'): ({'sdc'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-c7a77674-b363-4c8f-b0db-dd784a964d75 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Removing single pathed devices sdc {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd03e331-24ff-48a3-a94a-80c4112c09e5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb54a8f5-c1d2-4273-9531-d2e1268dcc20]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-c7a77674-b363-4c8f-b0db-dd784a964d75 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Flushing IO for device /dev/sdc {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d795f90-90d2-4c8d-8597-4d1cbacf6ca9]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-c7a77674-b363-4c8f-b0db-dd784a964d75 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a0315c-f379-4e30-8ffe-744e0116d09c]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-c7a77674-b363-4c8f-b0db-dd784a964d75 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-c7a77674-b363-4c8f-b0db-dd784a964d75 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] SCSI volumes sdc have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a77674-b363-4c8f-b0db-dd784a964d75 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[570bf669-c26c-4786-bf5b-475b3491facf]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a77674-b363-4c8f-b0db-dd784a964d75 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a68754-41dd-4291-ab35-4727ffc7ef3a]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a77674-b363-4c8f-b0db-dd784a964d75 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9, portal: 172.16.0.220,3260]
Aug 26 23:15:36 user nova-compute[73497]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9, portal: 172.16.0.220,3260] successful.
Aug 26 23:15:36 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4078384-8f2b-4a03-b874-a9fbbac505c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d310a01-13e8-4ef3-9ff2-ee6f38ec7670]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a77674-b363-4c8f-b0db-dd784a964d75 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-c7a77674-b363-4c8f-b0db-dd784a964d75 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a77674-b363-4c8f-b0db-dd784a964d75 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] <== disconnect_volume: return (494ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7a77674-b363-4c8f-b0db-dd784a964d75 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] No VIF found with MAC fa:16:3e:bc:5b:4b, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Received event <DeviceRemovedEvent: 1693091736.4519625, cfdfc81c-c44a-4e43-9053-74f1fce8ca3d => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73497) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7f2d9b2c-33e1-415e-958f-9257ee662cc6 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance cfdfc81c-c44a-4e43-9053-74f1fce8ca3d {{(pid=73497) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 23:15:36 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-7f2d9b2c-33e1-415e-958f-9257ee662cc6 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Successfully detached device sdc from instance cfdfc81c-c44a-4e43-9053-74f1fce8ca3d from the live domain config.
Aug 26 23:15:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f2d9b2c-33e1-415e-958f-9257ee662cc6 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f2d9b2c-33e1-415e-958f-9257ee662cc6 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oYGZNXHf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:15:36 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-7f2d9b2c-33e1-415e-958f-9257ee662cc6 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:15:36 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-7f2d9b2c-33e1-415e-958f-9257ee662cc6 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-7f2d9b2c-33e1-415e-958f-9257ee662cc6 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f2d9b2c-33e1-415e-958f-9257ee662cc6 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c5bffb-8ee0-44a5-9fa4-37b6b7f61ecd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[448e4a77-a4a6-438b-9221-bc73c4085b5d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f2d9b2c-33e1-415e-958f-9257ee662cc6 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:15:36 user nova-compute[73497]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61 (non-flash)
Aug 26 23:15:36 user nova-compute[73497]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)
Aug 26 23:15:36 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f2d9b2c-33e1-415e-958f-9257ee662cc6 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:15:36 user nova-compute[73497]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61 (non-flash)
Aug 26 23:15:36 user nova-compute[73497]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)
Aug 26 23:15:36 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f2d9b2c-33e1-415e-958f-9257ee662cc6 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282c3d0ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61'): ({'sdd'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-7f2d9b2c-33e1-415e-958f-9257ee662cc6 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Removing single pathed devices sdd {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f23fbe9-c89e-4497-96a0-ea5b4aa2da46]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4f932f-41b3-4a17-b13c-fc60a9e416ef]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-7f2d9b2c-33e1-415e-958f-9257ee662cc6 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Flushing IO for device /dev/sdd {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b579bc-77c9-4c7f-9fb1-fa621f457827]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-7f2d9b2c-33e1-415e-958f-9257ee662cc6 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bf17e6-6e4c-4f8a-b1b4-75ad82e2d084]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-7f2d9b2c-33e1-415e-958f-9257ee662cc6 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-7f2d9b2c-33e1-415e-958f-9257ee662cc6 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] SCSI volumes sdd have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f2d9b2c-33e1-415e-958f-9257ee662cc6 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d606c7-b323-41f1-b32b-705a6f713e64]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f2d9b2c-33e1-415e-958f-9257ee662cc6 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfeb2c1-ca5a-4552-b971-dee7a937be45]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f2d9b2c-33e1-415e-958f-9257ee662cc6 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61, portal: 172.16.0.220,3260]
Aug 26 23:15:36 user nova-compute[73497]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61, portal: 172.16.0.220,3260] successful.
Aug 26 23:15:36 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7589756a-f275-495b-b635-d93ede974b61 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aaa700b-142e-442f-a995-a06dc3dae81c]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f2d9b2c-33e1-415e-958f-9257ee662cc6 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-7f2d9b2c-33e1-415e-958f-9257ee662cc6 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f2d9b2c-33e1-415e-958f-9257ee662cc6 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] <== disconnect_volume: return (285ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:15:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f2d9b2c-33e1-415e-958f-9257ee662cc6 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:15:39 user nova-compute[73497]: DEBUG nova.objects.instance [None req-c7a77674-b363-4c8f-b0db-dd784a964d75 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lazy-loading 'flavor' on Instance uuid 1a58c5e7-b4c7-4bd5-8dd1-a98492139240 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:15:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c7a77674-b363-4c8f-b0db-dd784a964d75 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "1a58c5e7-b4c7-4bd5-8dd1-a98492139240" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.567s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:15:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0f8a4cef-f59e-4710-a09a-9a3efd666297 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Lock "ab745e33-a11e-4ee4-a442-1e7893448d27" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.661s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:15:40 user nova-compute[73497]: DEBUG nova.objects.instance [None req-7f2d9b2c-33e1-415e-958f-9257ee662cc6 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Lazy-loading 'flavor' on Instance uuid cfdfc81c-c44a-4e43-9053-74f1fce8ca3d {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:15:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-7f2d9b2c-33e1-415e-958f-9257ee662cc6 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Lock "cfdfc81c-c44a-4e43-9053-74f1fce8ca3d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.795s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4e740888-9a6d-41b7-9e8a-789a9a6b3670 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Acquiring lock "cfdfc81c-c44a-4e43-9053-74f1fce8ca3d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4e740888-9a6d-41b7-9e8a-789a9a6b3670 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Lock "cfdfc81c-c44a-4e43-9053-74f1fce8ca3d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4e740888-9a6d-41b7-9e8a-789a9a6b3670 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Acquiring lock "cfdfc81c-c44a-4e43-9053-74f1fce8ca3d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4e740888-9a6d-41b7-9e8a-789a9a6b3670 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Lock "cfdfc81c-c44a-4e43-9053-74f1fce8ca3d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4e740888-9a6d-41b7-9e8a-789a9a6b3670 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Lock "cfdfc81c-c44a-4e43-9053-74f1fce8ca3d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:15:41 user nova-compute[73497]: INFO nova.compute.manager [None req-4e740888-9a6d-41b7-9e8a-789a9a6b3670 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Terminating instance
Aug 26 23:15:41 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4e740888-9a6d-41b7-9e8a-789a9a6b3670 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Acquiring lock "ab745e33-a11e-4ee4-a442-1e7893448d27" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Lock "ab745e33-a11e-4ee4-a442-1e7893448d27" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG os_brick.utils [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb5222d-2d06-4507-8637-a235d31b0170]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fa011a-16f2-495c-a741-943a8cc8eb07]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c4b389-a1f0-4e72-80cd-69bdd8e5cbc1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4baeaa2-121d-4332-beb4-8d46c9daffa5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG nova.compute.manager [req-810be740-e557-454d-a9d9-a6250fc1a098 req-27b6571e-4896-4b20-aa47-82b64fa33361 service nova] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Received event network-vif-unplugged-11dc5742-f487-414e-b289-90a7fddccaec {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-810be740-e557-454d-a9d9-a6250fc1a098 req-27b6571e-4896-4b20-aa47-82b64fa33361 service nova] Acquiring lock "cfdfc81c-c44a-4e43-9053-74f1fce8ca3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-810be740-e557-454d-a9d9-a6250fc1a098 req-27b6571e-4896-4b20-aa47-82b64fa33361 service nova] Lock "cfdfc81c-c44a-4e43-9053-74f1fce8ca3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-810be740-e557-454d-a9d9-a6250fc1a098 req-27b6571e-4896-4b20-aa47-82b64fa33361 service nova] Lock "cfdfc81c-c44a-4e43-9053-74f1fce8ca3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG nova.compute.manager [req-810be740-e557-454d-a9d9-a6250fc1a098 req-27b6571e-4896-4b20-aa47-82b64fa33361 service nova] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] No waiting events found dispatching network-vif-unplugged-11dc5742-f487-414e-b289-90a7fddccaec {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG nova.compute.manager [req-810be740-e557-454d-a9d9-a6250fc1a098 req-27b6571e-4896-4b20-aa47-82b64fa33361 service nova] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Received event network-vif-unplugged-11dc5742-f487-414e-b289-90a7fddccaec for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:15:41 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:15:41 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4a4a6c-1c7b-450d-ab95-fb949492394a]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:15:41 user nova-compute[73497]: DEBUG os_brick.utils [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:15:42 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Instance destroyed successfully.
Aug 26 23:15:42 user nova-compute[73497]: DEBUG nova.objects.instance [None req-4e740888-9a6d-41b7-9e8a-789a9a6b3670 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Lazy-loading 'resources' on Instance uuid cfdfc81c-c44a-4e43-9053-74f1fce8ca3d {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:15:42 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-4e740888-9a6d-41b7-9e8a-789a9a6b3670 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:13:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-983585510',display_name='tempest-AttachSCSIVolumeTestJSON-server-983585510',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-983585510',id=6,image_ref='5cc40225-7426-4e1b-8602-a165cb52d572',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLk97rDgp4Vn23M64FLaLbKUbeqQQljd4JroX4MgytLQ9qa78Wu+3W4JqRD6oseotciaehYpNqFIouLoq2iE8bva3W0PzmsaLLt97aT+t0xyM4OJ6OrEvCE6VXOU5e0weQ==',key_name='tempest-keypair-894659020',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:13:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b681bf9074b4c37b9aa9cff23838b6b',ramdisk_id='',reservation_id='r-2r3c4hhq',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5cc40225-7426-4e1b-8602-a165cb52d572',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-994485492',owner_user_name='tempest-AttachSCSIVolumeTestJSON-994485492-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:13:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0447b57ebab64796a1de68ed821c849a',uuid=cfdfc81c-c44a-4e43-9053-74f1fce8ca3d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11dc5742-f487-414e-b289-90a7fddccaec", "address": "fa:16:3e:d9:48:94", "network": {"id": "40420587-c296-4175-9bd3-81c86df22141", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-831716329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b681bf9074b4c37b9aa9cff23838b6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11dc5742-f4", "ovs_interfaceid": "11dc5742-f487-414e-b289-90a7fddccaec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:15:42 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-4e740888-9a6d-41b7-9e8a-789a9a6b3670 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Converting VIF {"id": "11dc5742-f487-414e-b289-90a7fddccaec", "address": "fa:16:3e:d9:48:94", "network": {"id": "40420587-c296-4175-9bd3-81c86df22141", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-831716329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b681bf9074b4c37b9aa9cff23838b6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11dc5742-f4", "ovs_interfaceid": "11dc5742-f487-414e-b289-90a7fddccaec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:15:42 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-4e740888-9a6d-41b7-9e8a-789a9a6b3670 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:48:94,bridge_name='br-int',has_traffic_filtering=True,id=11dc5742-f487-414e-b289-90a7fddccaec,network=Network(40420587-c296-4175-9bd3-81c86df22141),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11dc5742-f4') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:15:42 user nova-compute[73497]: DEBUG os_vif [None req-4e740888-9a6d-41b7-9e8a-789a9a6b3670 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:48:94,bridge_name='br-int',has_traffic_filtering=True,id=11dc5742-f487-414e-b289-90a7fddccaec,network=Network(40420587-c296-4175-9bd3-81c86df22141),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11dc5742-f4') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:15:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11dc5742-f4, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:15:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:15:42 user nova-compute[73497]: INFO os_vif [None req-4e740888-9a6d-41b7-9e8a-789a9a6b3670 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:48:94,bridge_name='br-int',has_traffic_filtering=True,id=11dc5742-f487-414e-b289-90a7fddccaec,network=Network(40420587-c296-4175-9bd3-81c86df22141),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11dc5742-f4')
Aug 26 23:15:42 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-4e740888-9a6d-41b7-9e8a-789a9a6b3670 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Deleting instance files /opt/stack/data/nova/instances/cfdfc81c-c44a-4e43-9053-74f1fce8ca3d_del
Aug 26 23:15:42 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-4e740888-9a6d-41b7-9e8a-789a9a6b3670 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Deletion of /opt/stack/data/nova/instances/cfdfc81c-c44a-4e43-9053-74f1fce8ca3d_del complete
Aug 26 23:15:42 user nova-compute[73497]: INFO nova.compute.manager [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Swapping volume 8bbc3abb-c6d3-471c-b47f-e9a43806dfac for 4dac4890-c469-48e1-a4df-bef84bc6e46a
Aug 26 23:15:42 user nova-compute[73497]: INFO nova.compute.manager [None req-4e740888-9a6d-41b7-9e8a-789a9a6b3670 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Took 1.03 seconds to destroy the instance on the hypervisor.
Aug 26 23:15:42 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-4e740888-9a6d-41b7-9e8a-789a9a6b3670 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:15:42 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:15:42 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:15:43 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:15:43 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Took 1.31 seconds to deallocate network for instance.
Aug 26 23:15:43 user nova-compute[73497]: DEBUG nova.compute.manager [req-329473b2-d764-441f-b096-dfe9ccf404a5 req-1fefc0ec-b9b3-46ca-b3b8-1d1ce6122de9 service nova] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Received event network-vif-deleted-11dc5742-f487-414e-b289-90a7fddccaec {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:15:43 user nova-compute[73497]: DEBUG nova.compute.manager [req-41b9dbff-11ff-4400-976e-0f48e8f1217f req-1961e5be-a6d4-4ea3-b7e9-7f5cc3fb1d83 service nova] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Received event network-vif-plugged-11dc5742-f487-414e-b289-90a7fddccaec {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:15:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-41b9dbff-11ff-4400-976e-0f48e8f1217f req-1961e5be-a6d4-4ea3-b7e9-7f5cc3fb1d83 service nova] Acquiring lock "cfdfc81c-c44a-4e43-9053-74f1fce8ca3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-41b9dbff-11ff-4400-976e-0f48e8f1217f req-1961e5be-a6d4-4ea3-b7e9-7f5cc3fb1d83 service nova] Lock "cfdfc81c-c44a-4e43-9053-74f1fce8ca3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-41b9dbff-11ff-4400-976e-0f48e8f1217f req-1961e5be-a6d4-4ea3-b7e9-7f5cc3fb1d83 service nova] Lock "cfdfc81c-c44a-4e43-9053-74f1fce8ca3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:15:43 user nova-compute[73497]: DEBUG nova.compute.manager [req-41b9dbff-11ff-4400-976e-0f48e8f1217f req-1961e5be-a6d4-4ea3-b7e9-7f5cc3fb1d83 service nova] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] No waiting events found dispatching network-vif-plugged-11dc5742-f487-414e-b289-90a7fddccaec {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:15:43 user nova-compute[73497]: WARNING nova.compute.manager [req-41b9dbff-11ff-4400-976e-0f48e8f1217f req-1961e5be-a6d4-4ea3-b7e9-7f5cc3fb1d83 service nova] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Received unexpected event network-vif-plugged-11dc5742-f487-414e-b289-90a7fddccaec for instance with vm_state active and task_state deleting.
Aug 26 23:15:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4e740888-9a6d-41b7-9e8a-789a9a6b3670 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4e740888-9a6d-41b7-9e8a-789a9a6b3670 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-4e740888-9a6d-41b7-9e8a-789a9a6b3670 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-4e740888-9a6d-41b7-9e8a-789a9a6b3670 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4e740888-9a6d-41b7-9e8a-789a9a6b3670 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.338s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:15:44 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-4e740888-9a6d-41b7-9e8a-789a9a6b3670 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Deleted allocations for instance cfdfc81c-c44a-4e43-9053-74f1fce8ca3d
Aug 26 23:15:44 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qogyQMIB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:15:44 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:15:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:15:44 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:15:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:15:44 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:15:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4e740888-9a6d-41b7-9e8a-789a9a6b3670 tempest-AttachSCSIVolumeTestJSON-994485492 tempest-AttachSCSIVolumeTestJSON-994485492-project-member] Lock "cfdfc81c-c44a-4e43-9053-74f1fce8ca3d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.901s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[40af48f6-274d-4b53-b5fc-652395cd3376]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:15:44 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[36722327-3158-45a5-89dd-94deaf601d59]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40] added
Aug 26 23:15:44 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[498c7d69-af76-42db-87c3-63980fa160f5]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fd32a8-e75c-4d00-96f5-537b52ede123]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qogyQMIB {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qogyQMIB" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f574f0cb-06ee-4e9a-9664-69581ba1b5ae]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qogyQMIB'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4235cefb-ad28-423f-aaf9-b2a27cbfc9dc]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d063f3e-0ac7-43da-9ae4-496e36c836ed]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:15:44 user nova-compute[73497]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)
Aug 26 23:15:44 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:15:44 user nova-compute[73497]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)
Aug 26 23:15:44 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7995de56-0c3c-4ef2-9e38-3240b0c9ad55]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40, portal: 172.16.0.220,3260]
Aug 26 23:15:44 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40, portal: 172.16.0.220,3260] successful.
Aug 26 23:15:44 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5036e45-707c-4742-846d-9d592f807c6e]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a372225b-c060-4725-8dea-e995cb7b68e9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:15:44 user nova-compute[73497]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)
Aug 26 23:15:44 user nova-compute[73497]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40 (non-flash)
Aug 26 23:15:44 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:15:44 user nova-compute[73497]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)
Aug 26 23:15:44 user nova-compute[73497]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40 (non-flash)
Aug 26 23:15:44 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] HCTL ('34', '-', '-', 0) found on session 7 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e97db8e-1b4a-4c26-a745-3fa5548b79a2]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:44 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Searching for a device in session 7 and hctl ['34', '*', '*', 0] yield: None {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:15:45 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Searching for a device in session 7 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:15:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qogyQMIB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:15:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:15:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23538623262383062', 'path': '/dev/sdc'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:15:45 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538623262383062', 'path': '/dev/sdc'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:15:45 user nova-compute[73497]: DEBUG nova.objects.instance [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lazy-loading 'flavor' on Instance uuid ba3de574-ae62-4e9d-87f8-434c163d9897 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:15:45 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 23:15:45 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:15:45 user nova-compute[73497]:   <source dev="/dev/sdc"/>
Aug 26 23:15:45 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:15:45 user nova-compute[73497]:   <serial>04380a1a-8e66-4551-b6d3-9992d9509d40</serial>
Aug 26 23:15:45 user nova-compute[73497]: </disk>
Aug 26 23:15:45 user nova-compute[73497]:  {{(pid=73497) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] No BDM found with device name hda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] No VIF found with MAC fa:16:3e:48:b6:d8, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8b1e748b-2b01-465c-a809-7eadeb1d93a1 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lock "ba3de574-ae62-4e9d-87f8-434c163d9897" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.074s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WXMQwyOE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:15:46 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:15:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:15:46 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:15:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:15:46 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:15:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f133d6-4e0d-4de1-be49-68dd1ac546d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:15:46 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8757f177-9009-4e22-b019-9d9e01c49f58]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63] added
Aug 26 23:15:46 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3cddae-e1fc-47ad-a069-c17fe80f5a81]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb6596f-a1b5-49d5-8494-8c4fc686ed65]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WXMQwyOE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WXMQwyOE" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[db19c29f-1e7f-4a6e-8935-4820d579dfb2]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WXMQwyOE'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8454c321-7d55-4ec5-9acc-2b3cf7212f0a]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4b3a3a-d89b-4a75-a6b0-bb697f4f7d79]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:15:46 user nova-compute[73497]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)
Aug 26 23:15:46 user nova-compute[73497]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40 (non-flash)
Aug 26 23:15:46 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:15:46 user nova-compute[73497]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)
Aug 26 23:15:46 user nova-compute[73497]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40 (non-flash)
Aug 26 23:15:46 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1033b90a-1d5c-47a3-bfeb-fdb8998edf53]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63, portal: 172.16.0.220,3260]
Aug 26 23:15:46 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63, portal: 172.16.0.220,3260] successful.
Aug 26 23:15:46 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6199778-d9af-469d-8a72-a2cb2ca34aa9]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54f8177-4317-4e0c-8171-8c92e5311ae1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:15:46 user nova-compute[73497]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)
Aug 26 23:15:46 user nova-compute[73497]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40 (non-flash)
Aug 26 23:15:46 user nova-compute[73497]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63 (non-flash)
Aug 26 23:15:46 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:15:46 user nova-compute[73497]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)
Aug 26 23:15:46 user nova-compute[73497]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40 (non-flash)
Aug 26 23:15:46 user nova-compute[73497]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63 (non-flash)
Aug 26 23:15:46 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] HCTL ('35', '-', '-', 0) found on session 8 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c972746f-203e-4bab-b2e0-23242f356ac0]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Searching for a device in session 8 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:15:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WXMQwyOE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:15:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:47 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-577e734b-8ca4-4e56-8634-c6a536b55c15 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Acquiring lock "ba3de574-ae62-4e9d-87f8-434c163d9897" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:47 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-577e734b-8ca4-4e56-8634-c6a536b55c15 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lock "ba3de574-ae62-4e9d-87f8-434c163d9897" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:47 user nova-compute[73497]: INFO nova.compute.manager [None req-577e734b-8ca4-4e56-8634-c6a536b55c15 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Detaching volume 04380a1a-8e66-4551-b6d3-9992d9509d40
Aug 26 23:15:47 user nova-compute[73497]: INFO nova.virt.block_device [None req-577e734b-8ca4-4e56-8634-c6a536b55c15 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Attempting to driver detach volume 04380a1a-8e66-4551-b6d3-9992d9509d40 from mountpoint /dev/vdb
Aug 26 23:15:47 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-577e734b-8ca4-4e56-8634-c6a536b55c15 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Attempting to detach device vdb from instance ba3de574-ae62-4e9d-87f8-434c163d9897 from the persistent domain config. {{(pid=73497) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 23:15:47 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-577e734b-8ca4-4e56-8634-c6a536b55c15 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:15:47 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:15:47 user nova-compute[73497]:   <source dev="/dev/sdc"/>
Aug 26 23:15:47 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:15:47 user nova-compute[73497]:   <serial>04380a1a-8e66-4551-b6d3-9992d9509d40</serial>
Aug 26 23:15:47 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 23:15:47 user nova-compute[73497]: </disk>
Aug 26 23:15:47 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:15:47 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-577e734b-8ca4-4e56-8634-c6a536b55c15 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Successfully detached device vdb from instance ba3de574-ae62-4e9d-87f8-434c163d9897 from the persistent domain config.
Aug 26 23:15:47 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-577e734b-8ca4-4e56-8634-c6a536b55c15 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ba3de574-ae62-4e9d-87f8-434c163d9897 from the live domain config. {{(pid=73497) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 23:15:47 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-577e734b-8ca4-4e56-8634-c6a536b55c15 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:15:47 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:15:47 user nova-compute[73497]:   <source dev="/dev/sdc"/>
Aug 26 23:15:47 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:15:47 user nova-compute[73497]:   <serial>04380a1a-8e66-4551-b6d3-9992d9509d40</serial>
Aug 26 23:15:47 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 23:15:47 user nova-compute[73497]: </disk>
Aug 26 23:15:47 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:15:47 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:15:47 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23936633866383861', 'path': '/dev/sdd'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:15:47 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936633866383861', 'path': '/dev/sdd'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:15:47 user nova-compute[73497]: DEBUG nova.objects.instance [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Lazy-loading 'flavor' on Instance uuid 865d6369-32ac-46ac-b6df-37d8fa4bf440 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:15:47 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] attach device xml: <disk type="block" device="disk">
Aug 26 23:15:47 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:15:47 user nova-compute[73497]:   <source dev="/dev/sdd"/>
Aug 26 23:15:47 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:15:47 user nova-compute[73497]:   <serial>d9eb27dd-3a77-4acc-a0d8-d053152b9b63</serial>
Aug 26 23:15:47 user nova-compute[73497]: </disk>
Aug 26 23:15:47 user nova-compute[73497]:  {{(pid=73497) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 23:15:47 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:15:47 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:15:47 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] No VIF found with MAC fa:16:3e:4a:4b:6c, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5bb08b85-90e8-42b1-8c98-e020e5e80e4c tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Lock "865d6369-32ac-46ac-b6df-37d8fa4bf440" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.934s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Received event <DeviceRemovedEvent: 1693091748.2348528, ba3de574-ae62-4e9d-87f8-434c163d9897 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73497) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-577e734b-8ca4-4e56-8634-c6a536b55c15 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ba3de574-ae62-4e9d-87f8-434c163d9897 {{(pid=73497) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 23:15:48 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-577e734b-8ca4-4e56-8634-c6a536b55c15 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Successfully detached device vdb from instance ba3de574-ae62-4e9d-87f8-434c163d9897 from the live domain config.
Aug 26 23:15:48 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-577e734b-8ca4-4e56-8634-c6a536b55c15 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-577e734b-8ca4-4e56-8634-c6a536b55c15 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qogyQMIB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:15:48 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-577e734b-8ca4-4e56-8634-c6a536b55c15 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:15:48 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-577e734b-8ca4-4e56-8634-c6a536b55c15 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-577e734b-8ca4-4e56-8634-c6a536b55c15 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-577e734b-8ca4-4e56-8634-c6a536b55c15 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2635b30c-ff70-4c2b-be8e-aa38d3e6a4de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b06164-506c-4d82-a75f-97aea060ce74]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-577e734b-8ca4-4e56-8634-c6a536b55c15 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:15:48 user nova-compute[73497]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)
Aug 26 23:15:48 user nova-compute[73497]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40 (non-flash)
Aug 26 23:15:48 user nova-compute[73497]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63 (non-flash)
Aug 26 23:15:48 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-577e734b-8ca4-4e56-8634-c6a536b55c15 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:15:48 user nova-compute[73497]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)
Aug 26 23:15:48 user nova-compute[73497]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40 (non-flash)
Aug 26 23:15:48 user nova-compute[73497]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63 (non-flash)
Aug 26 23:15:48 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-577e734b-8ca4-4e56-8634-c6a536b55c15 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282c514c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40'): ({'sdc'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-577e734b-8ca4-4e56-8634-c6a536b55c15 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Removing single pathed devices sdc {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efe014c-5e42-457d-8ad2-5d7aa7b0b76b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcd11f2-d614-4e0c-b9cb-f961130b56a1]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-577e734b-8ca4-4e56-8634-c6a536b55c15 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Flushing IO for device /dev/sdc {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a034a6-cdbc-4915-852c-58e4819235ee]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-577e734b-8ca4-4e56-8634-c6a536b55c15 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d02a72-221c-4414-b73e-838f930b4b1a]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-577e734b-8ca4-4e56-8634-c6a536b55c15 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-577e734b-8ca4-4e56-8634-c6a536b55c15 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] SCSI volumes sdc have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-577e734b-8ca4-4e56-8634-c6a536b55c15 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e15e39e-1863-4122-bf39-8d00d5c2dcbc]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-577e734b-8ca4-4e56-8634-c6a536b55c15 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01d0699-4782-45fe-a0ae-4ad97fc7c9f8]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-577e734b-8ca4-4e56-8634-c6a536b55c15 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40, portal: 172.16.0.220,3260]
Aug 26 23:15:48 user nova-compute[73497]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40, portal: 172.16.0.220,3260] successful.
Aug 26 23:15:48 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04380a1a-8e66-4551-b6d3-9992d9509d40 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[319cae72-76ea-497f-bf22-09f88a085d41]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-577e734b-8ca4-4e56-8634-c6a536b55c15 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-577e734b-8ca4-4e56-8634-c6a536b55c15 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-577e734b-8ca4-4e56-8634-c6a536b55c15 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] <== disconnect_volume: return (341ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-577e734b-8ca4-4e56-8634-c6a536b55c15 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865d6369-32ac-46ac-b6df-37d8fa4bf440/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:49 user nova-compute[73497]: DEBUG nova.compute.manager [req-fea36dd3-be38-4f31-813f-510161cffcbd req-608dbb66-105d-42cc-afd6-89ec7a9e55ed service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Received event network-changed-ea0c8f3c-1937-4d8c-968a-21a620ff5f7d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:15:49 user nova-compute[73497]: DEBUG nova.compute.manager [req-fea36dd3-be38-4f31-813f-510161cffcbd req-608dbb66-105d-42cc-afd6-89ec7a9e55ed service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Refreshing instance network info cache due to event network-changed-ea0c8f3c-1937-4d8c-968a-21a620ff5f7d. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:15:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-fea36dd3-be38-4f31-813f-510161cffcbd req-608dbb66-105d-42cc-afd6-89ec7a9e55ed service nova] Acquiring lock "refresh_cache-62f841d2-09e7-448b-8c1c-26c824c473ba" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:15:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-fea36dd3-be38-4f31-813f-510161cffcbd req-608dbb66-105d-42cc-afd6-89ec7a9e55ed service nova] Acquired lock "refresh_cache-62f841d2-09e7-448b-8c1c-26c824c473ba" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:15:49 user nova-compute[73497]: DEBUG nova.network.neutron [req-fea36dd3-be38-4f31-813f-510161cffcbd req-608dbb66-105d-42cc-afd6-89ec7a9e55ed service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Refreshing network info cache for port ea0c8f3c-1937-4d8c-968a-21a620ff5f7d {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:15:49 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-76a5139e-0fa1-4655-905e-3beebc7ec555 tempest-VolumesAssistedSnapshotsTest-891177546 tempest-VolumesAssistedSnapshotsTest-891177546-project] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] volume_snapshot_create: create_info: {'snapshot_id': 'ad6c12c0-0e9c-4f5e-8053-30d23fd3470f', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=73497) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 26 23:15:49 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-76a5139e-0fa1-4655-905e-3beebc7ec555 tempest-VolumesAssistedSnapshotsTest-891177546 tempest-VolumesAssistedSnapshotsTest-891177546-project] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] snap xml: <domainsnapshot>
Aug 26 23:15:49 user nova-compute[73497]:   <disks>
Aug 26 23:15:49 user nova-compute[73497]:     <disk name="/dev/sdd" snapshot="external" type="file">
Aug 26 23:15:49 user nova-compute[73497]:       <source file="/dev/new_file"/>
Aug 26 23:15:49 user nova-compute[73497]:     </disk>
Aug 26 23:15:49 user nova-compute[73497]:     <disk name="vda" snapshot="no"/>
Aug 26 23:15:49 user nova-compute[73497]:   </disks>
Aug 26 23:15:49 user nova-compute[73497]: </domainsnapshot>
Aug 26 23:15:49 user nova-compute[73497]:  {{(pid=73497) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 26 23:15:49 user nova-compute[73497]: DEBUG nova.objects.instance [None req-76a5139e-0fa1-4655-905e-3beebc7ec555 tempest-VolumesAssistedSnapshotsTest-891177546 tempest-VolumesAssistedSnapshotsTest-891177546-project] Lazy-loading 'system_metadata' on Instance uuid 865d6369-32ac-46ac-b6df-37d8fa4bf440 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:15:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865d6369-32ac-46ac-b6df-37d8fa4bf440/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865d6369-32ac-46ac-b6df-37d8fa4bf440/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:49 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-76a5139e-0fa1-4655-905e-3beebc7ec555 tempest-VolumesAssistedSnapshotsTest-891177546 tempest-VolumesAssistedSnapshotsTest-891177546-project] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 23:15:49 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c2cd4bb7-4aba-4992-a164-eba9303a955a tempest-VolumesAssistedSnapshotsTest-891177546 tempest-VolumesAssistedSnapshotsTest-891177546-project] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] volume_snapshot_delete: delete_info: {'volume_id': 'd9eb27dd-3a77-4acc-a0d8-d053152b9b63'} {{(pid=73497) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [None req-c2cd4bb7-4aba-4992-a164-eba9303a955a tempest-VolumesAssistedSnapshotsTest-891177546 tempest-VolumesAssistedSnapshotsTest-891177546-project] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Traceback (most recent call last):
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]     if delete_info['type'] != 'qcow2':
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] KeyError: 'type'
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] 
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [None req-76a5139e-0fa1-4655-905e-3beebc7ec555 tempest-VolumesAssistedSnapshotsTest-891177546 tempest-VolumesAssistedSnapshotsTest-891177546-project] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Traceback (most recent call last):
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]     rv = execute(f, *args, **kwargs)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]     six.reraise(c, e, tb)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]     raise value
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]     rv = meth(*args, **kwargs)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] 
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [None req-76a5139e-0fa1-4655-905e-3beebc7ec555 tempest-VolumesAssistedSnapshotsTest-891177546 tempest-VolumesAssistedSnapshotsTest-891177546-project] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Traceback (most recent call last):
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]     self._volume_snapshot_create(context, instance, guest,
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]     rv = execute(f, *args, **kwargs)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]     six.reraise(c, e, tb)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]     raise value
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]     rv = meth(*args, **kwargs)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] 
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [None req-c2cd4bb7-4aba-4992-a164-eba9303a955a tempest-VolumesAssistedSnapshotsTest-891177546 tempest-VolumesAssistedSnapshotsTest-891177546-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver 
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver 
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-61f2493f-3e25-420c-9f5b-09486ea30cbc)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver 
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver 
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver 
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server [None req-c2cd4bb7-4aba-4992-a164-eba9303a955a tempest-VolumesAssistedSnapshotsTest-891177546 tempest-VolumesAssistedSnapshotsTest-891177546-project] Exception during message handling: KeyError: 'type'
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server 
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver [None req-76a5139e-0fa1-4655-905e-3beebc7ec555 tempest-VolumesAssistedSnapshotsTest-891177546 tempest-VolumesAssistedSnapshotsTest-891177546-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot ad6c12c0-0e9c-4f5e-8053-30d23fd3470f could not be found.
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     raise value
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver 
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver 
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot ad6c12c0-0e9c-4f5e-8053-30d23fd3470f could not be found. (HTTP 404) (Request-ID: req-6f51634b-6185-44f9-bab2-f3650037c41f)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver 
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver 
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot ad6c12c0-0e9c-4f5e-8053-30d23fd3470f could not be found.
Aug 26 23:15:49 user nova-compute[73497]: ERROR nova.virt.libvirt.driver 
Aug 26 23:15:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865d6369-32ac-46ac-b6df-37d8fa4bf440/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:49 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server [None req-76a5139e-0fa1-4655-905e-3beebc7ec555 tempest-VolumesAssistedSnapshotsTest-891177546 tempest-VolumesAssistedSnapshotsTest-891177546-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server     raise value
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 23:15:49 user nova-compute[73497]: ERROR oslo_messaging.rpc.server 
Aug 26 23:15:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab745e33-a11e-4ee4-a442-1e7893448d27/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:49 user nova-compute[73497]: DEBUG nova.objects.instance [None req-577e734b-8ca4-4e56-8634-c6a536b55c15 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lazy-loading 'flavor' on Instance uuid ba3de574-ae62-4e9d-87f8-434c163d9897 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:15:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab745e33-a11e-4ee4-a442-1e7893448d27/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab745e33-a11e-4ee4-a442-1e7893448d27/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-577e734b-8ca4-4e56-8634-c6a536b55c15 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lock "ba3de574-ae62-4e9d-87f8-434c163d9897" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.272s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:15:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-29b8958c-4350-4ab0-922e-a136eb1475ee tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Acquiring lock "865d6369-32ac-46ac-b6df-37d8fa4bf440" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-29b8958c-4350-4ab0-922e-a136eb1475ee tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Lock "865d6369-32ac-46ac-b6df-37d8fa4bf440" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:49 user nova-compute[73497]: INFO nova.compute.manager [None req-29b8958c-4350-4ab0-922e-a136eb1475ee tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Detaching volume d9eb27dd-3a77-4acc-a0d8-d053152b9b63
Aug 26 23:15:49 user nova-compute[73497]: INFO nova.virt.block_device [None req-29b8958c-4350-4ab0-922e-a136eb1475ee tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Attempting to driver detach volume d9eb27dd-3a77-4acc-a0d8-d053152b9b63 from mountpoint /dev/vdb
Aug 26 23:15:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab745e33-a11e-4ee4-a442-1e7893448d27/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:49 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:15:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79d00f46-3843-4297-ba47-33557b11d489/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:49 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-29b8958c-4350-4ab0-922e-a136eb1475ee tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Attempting to detach device vdb from instance 865d6369-32ac-46ac-b6df-37d8fa4bf440 from the persistent domain config. {{(pid=73497) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 23:15:49 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-29b8958c-4350-4ab0-922e-a136eb1475ee tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] detach device xml: <disk type="block" device="disk">
Aug 26 23:15:49 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:15:49 user nova-compute[73497]:   <source dev="/dev/sdd"/>
Aug 26 23:15:49 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:15:49 user nova-compute[73497]:   <serial>d9eb27dd-3a77-4acc-a0d8-d053152b9b63</serial>
Aug 26 23:15:49 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:15:49 user nova-compute[73497]: </disk>
Aug 26 23:15:49 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:15:49 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-29b8958c-4350-4ab0-922e-a136eb1475ee tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Successfully detached device vdb from instance 865d6369-32ac-46ac-b6df-37d8fa4bf440 from the persistent domain config.
Aug 26 23:15:49 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-29b8958c-4350-4ab0-922e-a136eb1475ee tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 865d6369-32ac-46ac-b6df-37d8fa4bf440 from the live domain config. {{(pid=73497) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 23:15:49 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-29b8958c-4350-4ab0-922e-a136eb1475ee tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] detach device xml: <disk type="block" device="disk">
Aug 26 23:15:49 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:15:49 user nova-compute[73497]:   <source dev="/dev/sdd"/>
Aug 26 23:15:49 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:15:49 user nova-compute[73497]:   <serial>d9eb27dd-3a77-4acc-a0d8-d053152b9b63</serial>
Aug 26 23:15:49 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:15:49 user nova-compute[73497]: </disk>
Aug 26 23:15:49 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:15:49 user nova-compute[73497]: DEBUG nova.network.neutron [req-fea36dd3-be38-4f31-813f-510161cffcbd req-608dbb66-105d-42cc-afd6-89ec7a9e55ed service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Updated VIF entry in instance network info cache for port ea0c8f3c-1937-4d8c-968a-21a620ff5f7d. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:15:49 user nova-compute[73497]: DEBUG nova.network.neutron [req-fea36dd3-be38-4f31-813f-510161cffcbd req-608dbb66-105d-42cc-afd6-89ec7a9e55ed service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Updating instance_info_cache with network_info: [{"id": "ea0c8f3c-1937-4d8c-968a-21a620ff5f7d", "address": "fa:16:3e:34:77:60", "network": {"id": "52dfb1fe-f560-4f40-8594-3b13d3ff06d9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2040079808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a6bf8d596b4695a60e15661fd18352", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0c8f3c-19", "ovs_interfaceid": "ea0c8f3c-1937-4d8c-968a-21a620ff5f7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:15:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-fea36dd3-be38-4f31-813f-510161cffcbd req-608dbb66-105d-42cc-afd6-89ec7a9e55ed service nova] Releasing lock "refresh_cache-62f841d2-09e7-448b-8c1c-26c824c473ba" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79d00f46-3843-4297-ba47-33557b11d489/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79d00f46-3843-4297-ba47-33557b11d489/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0fa38e1d-31fb-444b-9bbd-4fb088afa3b4 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Acquiring lock "interface-ba3de574-ae62-4e9d-87f8-434c163d9897-aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0fa38e1d-31fb-444b-9bbd-4fb088afa3b4 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lock "interface-ba3de574-ae62-4e9d-87f8-434c163d9897-aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG nova.objects.instance [None req-0fa38e1d-31fb-444b-9bbd-4fb088afa3b4 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lazy-loading 'flavor' on Instance uuid ba3de574-ae62-4e9d-87f8-434c163d9897 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-0fa38e1d-31fb-444b-9bbd-4fb088afa3b4 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:13:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1306226483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1306226483',id=7,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGe8nVo8i9dIVTRdjLRLAe5YZ0C6xyesogGuomHtses/n0zpuFh2lyzmy4UGl4SR+46J+vpwNqJeLYiNhrlPlaBcbP0iXsCzU1gcnZhT083Y39OsqxeF8liKiCYtA2+jQ==',key_name='tempest-keypair-411871039',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:13:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e456078921734435bd38b72c5266d50e',ramdisk_id='',reservation_id='r-hw890ap9',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-200456857',owner_user_name='tempest-TaggedAttachmentsTest-200456857-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:13:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a73eb19d92254c56b126c555a94c9457',uuid=ba3de574-ae62-4e9d-87f8-434c163d9897,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a", "address": "fa:16:3e:db:9f:b9", "network": {"id": "6c7174a0-0c76-4d29-b4cf-d57ffb086db3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-823928317", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e456078921734435bd38b72c5266d50e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaac12afe-d2", "ovs_interfaceid": "aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-0fa38e1d-31fb-444b-9bbd-4fb088afa3b4 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Converting VIF {"id": "aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a", "address": "fa:16:3e:db:9f:b9", "network": {"id": "6c7174a0-0c76-4d29-b4cf-d57ffb086db3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-823928317", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e456078921734435bd38b72c5266d50e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaac12afe-d2", "ovs_interfaceid": "aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-0fa38e1d-31fb-444b-9bbd-4fb088afa3b4 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:9f:b9,bridge_name='br-int',has_traffic_filtering=True,id=aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a,network=Network(6c7174a0-0c76-4d29-b4cf-d57ffb086db3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaac12afe-d2') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-0fa38e1d-31fb-444b-9bbd-4fb088afa3b4 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:db:9f:b9"/><model type="virtio"/><mtu size="1442"/><target dev="tapaac12afe-d2"/></interface> {{(pid=73497) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-0fa38e1d-31fb-444b-9bbd-4fb088afa3b4 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:db:9f:b9"/><model type="virtio"/><mtu size="1442"/><target dev="tapaac12afe-d2"/></interface> {{(pid=73497) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0fa38e1d-31fb-444b-9bbd-4fb088afa3b4 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Attempting to detach device tapaac12afe-d2 from instance ba3de574-ae62-4e9d-87f8-434c163d9897 from the persistent domain config. {{(pid=73497) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-0fa38e1d-31fb-444b-9bbd-4fb088afa3b4 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] detach device xml: <interface type="ethernet">
Aug 26 23:15:50 user nova-compute[73497]:   <mac address="fa:16:3e:db:9f:b9"/>
Aug 26 23:15:50 user nova-compute[73497]:   <model type="virtio"/>
Aug 26 23:15:50 user nova-compute[73497]:   <mtu size="1442"/>
Aug 26 23:15:50 user nova-compute[73497]:   <target dev="tapaac12afe-d2"/>
Aug 26 23:15:50 user nova-compute[73497]: </interface>
Aug 26 23:15:50 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-0fa38e1d-31fb-444b-9bbd-4fb088afa3b4 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:db:9f:b9"/><model type="virtio"/><mtu size="1442"/><target dev="tapaac12afe-d2"/></interface> {{(pid=73497) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-0fa38e1d-31fb-444b-9bbd-4fb088afa3b4 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:db:9f:b9"/><model type="virtio"/><mtu size="1442"/><target dev="tapaac12afe-d2"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 26 23:15:50 user nova-compute[73497]:   <name>instance-00000007</name>
Aug 26 23:15:50 user nova-compute[73497]:   <uuid>ba3de574-ae62-4e9d-87f8-434c163d9897</uuid>
Aug 26 23:15:50 user nova-compute[73497]:   <metadata>
Aug 26 23:15:50 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:15:50 user nova-compute[73497]:   <nova:package version="0.0.0"/>
Aug 26 23:15:50 user nova-compute[73497]:   <nova:name>tempest-device-tagging-server-1306226483</nova:name>
Aug 26 23:15:50 user nova-compute[73497]:   <nova:creationTime>2023-08-26 23:15:21</nova:creationTime>
Aug 26 23:15:50 user nova-compute[73497]:   <nova:flavor name="m1.tiny">
Aug 26 23:15:50 user nova-compute[73497]:     <nova:memory>512</nova:memory>
Aug 26 23:15:50 user nova-compute[73497]:     <nova:disk>1</nova:disk>
Aug 26 23:15:50 user nova-compute[73497]:     <nova:swap>0</nova:swap>
Aug 26 23:15:50 user nova-compute[73497]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:15:50 user nova-compute[73497]:     <nova:vcpus>1</nova:vcpus>
Aug 26 23:15:50 user nova-compute[73497]:   </nova:flavor>
Aug 26 23:15:50 user nova-compute[73497]:   <nova:owner>
Aug 26 23:15:50 user nova-compute[73497]:     <nova:user uuid="a73eb19d92254c56b126c555a94c9457">tempest-TaggedAttachmentsTest-200456857-project-member</nova:user>
Aug 26 23:15:50 user nova-compute[73497]:     <nova:project uuid="e456078921734435bd38b72c5266d50e">tempest-TaggedAttachmentsTest-200456857</nova:project>
Aug 26 23:15:50 user nova-compute[73497]:   </nova:owner>
Aug 26 23:15:50 user nova-compute[73497]:   <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:15:50 user nova-compute[73497]:   <nova:ports>
Aug 26 23:15:50 user nova-compute[73497]:     <nova:port uuid="ca3ccf3a-86b0-492c-99ae-9cdca5df9336">
Aug 26 23:15:50 user nova-compute[73497]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 23:15:50 user nova-compute[73497]:     </nova:port>
Aug 26 23:15:50 user nova-compute[73497]:     <nova:port uuid="aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a">
Aug 26 23:15:50 user nova-compute[73497]:       <nova:ip type="fixed" address="10.10.10.10" ipVersion="4"/>
Aug 26 23:15:50 user nova-compute[73497]:     </nova:port>
Aug 26 23:15:50 user nova-compute[73497]:   </nova:ports>
Aug 26 23:15:50 user nova-compute[73497]: </nova:instance>
Aug 26 23:15:50 user nova-compute[73497]:   </metadata>
Aug 26 23:15:50 user nova-compute[73497]:   <memory unit='KiB'>524288</memory>
Aug 26 23:15:50 user nova-compute[73497]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 26 23:15:50 user nova-compute[73497]:   <vcpu placement='static'>1</vcpu>
Aug 26 23:15:50 user nova-compute[73497]:   <resource>
Aug 26 23:15:50 user nova-compute[73497]:     <partition>/machine</partition>
Aug 26 23:15:50 user nova-compute[73497]:   </resource>
Aug 26 23:15:50 user nova-compute[73497]:   <sysinfo type='smbios'>
Aug 26 23:15:50 user nova-compute[73497]:     <system>
Aug 26 23:15:50 user nova-compute[73497]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 26 23:15:50 user nova-compute[73497]:       <entry name='product'>OpenStack Nova</entry>
Aug 26 23:15:50 user nova-compute[73497]:       <entry name='version'>0.0.0</entry>
Aug 26 23:15:50 user nova-compute[73497]:       <entry name='serial'>ba3de574-ae62-4e9d-87f8-434c163d9897</entry>
Aug 26 23:15:50 user nova-compute[73497]:       <entry name='uuid'>ba3de574-ae62-4e9d-87f8-434c163d9897</entry>
Aug 26 23:15:50 user nova-compute[73497]:       <entry name='family'>Virtual Machine</entry>
Aug 26 23:15:50 user nova-compute[73497]:     </system>
Aug 26 23:15:50 user nova-compute[73497]:   </sysinfo>
Aug 26 23:15:50 user nova-compute[73497]:   <os>
Aug 26 23:15:50 user nova-compute[73497]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 26 23:15:50 user nova-compute[73497]:     <boot dev='hd'/>
Aug 26 23:15:50 user nova-compute[73497]:     <smbios mode='sysinfo'/>
Aug 26 23:15:50 user nova-compute[73497]:   </os>
Aug 26 23:15:50 user nova-compute[73497]:   <features>
Aug 26 23:15:50 user nova-compute[73497]:     <acpi/>
Aug 26 23:15:50 user nova-compute[73497]:     <apic/>
Aug 26 23:15:50 user nova-compute[73497]:     <vmcoreinfo state='on'/>
Aug 26 23:15:50 user nova-compute[73497]:   </features>
Aug 26 23:15:50 user nova-compute[73497]:   <cpu mode='custom' match='exact' check='full'>
Aug 26 23:15:50 user nova-compute[73497]:     <model fallback='forbid'>Nehalem</model>
Aug 26 23:15:50 user nova-compute[73497]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 26 23:15:50 user nova-compute[73497]:     <feature policy='require' name='vme'/>
Aug 26 23:15:50 user nova-compute[73497]:     <feature policy='require' name='x2apic'/>
Aug 26 23:15:50 user nova-compute[73497]:     <feature policy='require' name='hypervisor'/>
Aug 26 23:15:50 user nova-compute[73497]:   </cpu>
Aug 26 23:15:50 user nova-compute[73497]:   <clock offset='utc'>
Aug 26 23:15:50 user nova-compute[73497]:     <timer name='pit' tickpolicy='delay'/>
Aug 26 23:15:50 user nova-compute[73497]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 26 23:15:50 user nova-compute[73497]:     <timer name='hpet' present='no'/>
Aug 26 23:15:50 user nova-compute[73497]:   </clock>
Aug 26 23:15:50 user nova-compute[73497]:   <on_poweroff>destroy</on_poweroff>
Aug 26 23:15:50 user nova-compute[73497]:   <on_reboot>restart</on_reboot>
Aug 26 23:15:50 user nova-compute[73497]:   <on_crash>destroy</on_crash>
Aug 26 23:15:50 user nova-compute[73497]:   <devices>
Aug 26 23:15:50 user nova-compute[73497]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 23:15:50 user nova-compute[73497]:     <disk type='file' device='disk'>
Aug 26 23:15:50 user nova-compute[73497]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 26 23:15:50 user nova-compute[73497]:       <source file='/opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897/disk' index='2'/>
Aug 26 23:15:50 user nova-compute[73497]:       <backingStore type='file' index='3'>
Aug 26 23:15:50 user nova-compute[73497]:         <format type='raw'/>
Aug 26 23:15:50 user nova-compute[73497]:         <source file='/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981'/>
Aug 26 23:15:50 user nova-compute[73497]:         <backingStore/>
Aug 26 23:15:50 user nova-compute[73497]:       </backingStore>
Aug 26 23:15:50 user nova-compute[73497]:       <target dev='vda' bus='virtio'/>
Aug 26 23:15:50 user nova-compute[73497]:       <alias name='virtio-disk0'/>
Aug 26 23:15:50 user nova-compute[73497]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 26 23:15:50 user nova-compute[73497]:     </disk>
Aug 26 23:15:50 user nova-compute[73497]:     <disk type='file' device='cdrom'>
Aug 26 23:15:50 user nova-compute[73497]:       <driver name='qemu' type='raw' cache='none'/>
Aug 26 23:15:50 user nova-compute[73497]:       <source file='/opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897/disk.config' index='1'/>
Aug 26 23:15:50 user nova-compute[73497]:       <backingStore/>
Aug 26 23:15:50 user nova-compute[73497]:       <target dev='hda' bus='ide'/>
Aug 26 23:15:50 user nova-compute[73497]:       <readonly/>
Aug 26 23:15:50 user nova-compute[73497]:       <alias name='ide0-0-0'/>
Aug 26 23:15:50 user nova-compute[73497]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 26 23:15:50 user nova-compute[73497]:     </disk>
Aug 26 23:15:50 user nova-compute[73497]:     <controller type='usb' index='0' model='none'>
Aug 26 23:15:50 user nova-compute[73497]:       <alias name='usb'/>
Aug 26 23:15:50 user nova-compute[73497]:     </controller>
Aug 26 23:15:50 user nova-compute[73497]:     <controller type='pci' index='0' model='pci-root'>
Aug 26 23:15:50 user nova-compute[73497]:       <alias name='pci.0'/>
Aug 26 23:15:50 user nova-compute[73497]:     </controller>
Aug 26 23:15:50 user nova-compute[73497]:     <controller type='ide' index='0'>
Aug 26 23:15:50 user nova-compute[73497]:       <alias name='ide'/>
Aug 26 23:15:50 user nova-compute[73497]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 26 23:15:50 user nova-compute[73497]:     </controller>
Aug 26 23:15:50 user nova-compute[73497]:     <interface type='ethernet'>
Aug 26 23:15:50 user nova-compute[73497]:       <mac address='fa:16:3e:48:b6:d8'/>
Aug 26 23:15:50 user nova-compute[73497]:       <target dev='tapca3ccf3a-86'/>
Aug 26 23:15:50 user nova-compute[73497]:       <model type='virtio'/>
Aug 26 23:15:50 user nova-compute[73497]:       <mtu size='1442'/>
Aug 26 23:15:50 user nova-compute[73497]:       <alias name='net0'/>
Aug 26 23:15:50 user nova-compute[73497]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 26 23:15:50 user nova-compute[73497]:     </interface>
Aug 26 23:15:50 user nova-compute[73497]:     <interface type='ethernet'>
Aug 26 23:15:50 user nova-compute[73497]:       <mac address='fa:16:3e:db:9f:b9'/>
Aug 26 23:15:50 user nova-compute[73497]:       <target dev='tapaac12afe-d2'/>
Aug 26 23:15:50 user nova-compute[73497]:       <model type='virtio'/>
Aug 26 23:15:50 user nova-compute[73497]:       <mtu size='1442'/>
Aug 26 23:15:50 user nova-compute[73497]:       <alias name='net1'/>
Aug 26 23:15:50 user nova-compute[73497]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 26 23:15:50 user nova-compute[73497]:     </interface>
Aug 26 23:15:50 user nova-compute[73497]:     <serial type='pty'>
Aug 26 23:15:50 user nova-compute[73497]:       <source path='/dev/pts/6'/>
Aug 26 23:15:50 user nova-compute[73497]:       <log file='/opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897/console.log' append='off'/>
Aug 26 23:15:50 user nova-compute[73497]:       <target type='isa-serial' port='0'>
Aug 26 23:15:50 user nova-compute[73497]:         <model name='isa-serial'/>
Aug 26 23:15:50 user nova-compute[73497]:       </target>
Aug 26 23:15:50 user nova-compute[73497]:       <alias name='serial0'/>
Aug 26 23:15:50 user nova-compute[73497]:     </serial>
Aug 26 23:15:50 user nova-compute[73497]:     <console type='pty' tty='/dev/pts/6'>
Aug 26 23:15:50 user nova-compute[73497]:       <source path='/dev/pts/6'/>
Aug 26 23:15:50 user nova-compute[73497]:       <log file='/opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897/console.log' append='off'/>
Aug 26 23:15:50 user nova-compute[73497]:       <target type='serial' port='0'/>
Aug 26 23:15:50 user nova-compute[73497]:       <alias name='serial0'/>
Aug 26 23:15:50 user nova-compute[73497]:     </console>
Aug 26 23:15:50 user nova-compute[73497]:     <input type='mouse' bus='ps2'>
Aug 26 23:15:50 user nova-compute[73497]:       <alias name='input0'/>
Aug 26 23:15:50 user nova-compute[73497]:     </input>
Aug 26 23:15:50 user nova-compute[73497]:     <input type='keyboard' bus='ps2'>
Aug 26 23:15:50 user nova-compute[73497]:       <alias name='input1'/>
Aug 26 23:15:50 user nova-compute[73497]:     </input>
Aug 26 23:15:50 user nova-compute[73497]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 26 23:15:50 user nova-compute[73497]:       <listen type='address' address='0.0.0.0'/>
Aug 26 23:15:50 user nova-compute[73497]:     </graphics>
Aug 26 23:15:50 user nova-compute[73497]:     <audio id='1' type='none'/>
Aug 26 23:15:50 user nova-compute[73497]:     <video>
Aug 26 23:15:50 user nova-compute[73497]:       <model type='virtio' heads='1' primary='yes'/>
Aug 26 23:15:50 user nova-compute[73497]:       <alias name='video0'/>
Aug 26 23:15:50 user nova-compute[73497]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 26 23:15:50 user nova-compute[73497]:     </video>
Aug 26 23:15:50 user nova-compute[73497]:     <memballoon model='virtio'>
Aug 26 23:15:50 user nova-compute[73497]:       <stats period='10'/>
Aug 26 23:15:50 user nova-compute[73497]:       <alias name='balloon0'/>
Aug 26 23:15:50 user nova-compute[73497]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 26 23:15:50 user nova-compute[73497]:     </memballoon>
Aug 26 23:15:50 user nova-compute[73497]:     <rng model='virtio'>
Aug 26 23:15:50 user nova-compute[73497]:       <backend model='random'>/dev/urandom</backend>
Aug 26 23:15:50 user nova-compute[73497]:       <alias name='rng0'/>
Aug 26 23:15:50 user nova-compute[73497]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 26 23:15:50 user nova-compute[73497]:     </rng>
Aug 26 23:15:50 user nova-compute[73497]:   </devices>
Aug 26 23:15:50 user nova-compute[73497]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 26 23:15:50 user nova-compute[73497]:     <label>libvirt-ba3de574-ae62-4e9d-87f8-434c163d9897</label>
Aug 26 23:15:50 user nova-compute[73497]:     <imagelabel>libvirt-ba3de574-ae62-4e9d-87f8-434c163d9897</imagelabel>
Aug 26 23:15:50 user nova-compute[73497]:   </seclabel>
Aug 26 23:15:50 user nova-compute[73497]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 26 23:15:50 user nova-compute[73497]:     <label>+64055:+108</label>
Aug 26 23:15:50 user nova-compute[73497]:     <imagelabel>+64055:+108</imagelabel>
Aug 26 23:15:50 user nova-compute[73497]:   </seclabel>
Aug 26 23:15:50 user nova-compute[73497]: </domain>
Aug 26 23:15:50 user nova-compute[73497]:  {{(pid=73497) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 26 23:15:50 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-0fa38e1d-31fb-444b-9bbd-4fb088afa3b4 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Successfully detached device tapaac12afe-d2 from instance ba3de574-ae62-4e9d-87f8-434c163d9897 from the persistent domain config.
Aug 26 23:15:50 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0fa38e1d-31fb-444b-9bbd-4fb088afa3b4 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] (1/8): Attempting to detach device tapaac12afe-d2 with device alias net1 from instance ba3de574-ae62-4e9d-87f8-434c163d9897 from the live domain config. {{(pid=73497) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-0fa38e1d-31fb-444b-9bbd-4fb088afa3b4 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] detach device xml: <interface type="ethernet">
Aug 26 23:15:50 user nova-compute[73497]:   <mac address="fa:16:3e:db:9f:b9"/>
Aug 26 23:15:50 user nova-compute[73497]:   <model type="virtio"/>
Aug 26 23:15:50 user nova-compute[73497]:   <mtu size="1442"/>
Aug 26 23:15:50 user nova-compute[73497]:   <target dev="tapaac12afe-d2"/>
Aug 26 23:15:50 user nova-compute[73497]: </interface>
Aug 26 23:15:50 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79d00f46-3843-4297-ba47-33557b11d489/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Received event <DeviceRemovedEvent: 1693091750.3894355, 865d6369-32ac-46ac-b6df-37d8fa4bf440 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73497) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-29b8958c-4350-4ab0-922e-a136eb1475ee tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 865d6369-32ac-46ac-b6df-37d8fa4bf440 {{(pid=73497) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 23:15:50 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-29b8958c-4350-4ab0-922e-a136eb1475ee tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Successfully detached device vdb from instance 865d6369-32ac-46ac-b6df-37d8fa4bf440 from the live domain config.
Aug 26 23:15:50 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29b8958c-4350-4ab0-922e-a136eb1475ee tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b8958c-4350-4ab0-922e-a136eb1475ee tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WXMQwyOE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:15:50 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-29b8958c-4350-4ab0-922e-a136eb1475ee tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:15:50 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-29b8958c-4350-4ab0-922e-a136eb1475ee tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-29b8958c-4350-4ab0-922e-a136eb1475ee tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b8958c-4350-4ab0-922e-a136eb1475ee tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa84d08e-59dd-41b0-bd18-10b3ca610dfa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:50 user nova-compute[73497]: INFO nova.compute.manager [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Rebuilding instance
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b9b4a8-88b6-4ac9-8e89-dfd1dc3e2cb0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b8958c-4350-4ab0-922e-a136eb1475ee tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:15:50 user nova-compute[73497]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)
Aug 26 23:15:50 user nova-compute[73497]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63 (non-flash)
Aug 26 23:15:50 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b8958c-4350-4ab0-922e-a136eb1475ee tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:15:50 user nova-compute[73497]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)
Aug 26 23:15:50 user nova-compute[73497]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63 (non-flash)
Aug 26 23:15:50 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b8958c-4350-4ab0-922e-a136eb1475ee tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28341b0c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63'): ({'sdd'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-29b8958c-4350-4ab0-922e-a136eb1475ee tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Removing single pathed devices sdd {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a85203-a842-4e2d-b373-32664961fc98]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec02084-d5fb-4784-9cc4-f848a402c7a5]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-29b8958c-4350-4ab0-922e-a136eb1475ee tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Flushing IO for device /dev/sdd {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ef1de5-b781-44a0-9246-de7e5e16b2a2]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-29b8958c-4350-4ab0-922e-a136eb1475ee tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Received event <DeviceRemovedEvent: 1693091750.612611, ba3de574-ae62-4e9d-87f8-434c163d9897 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73497) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0fa38e1d-31fb-444b-9bbd-4fb088afa3b4 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Start waiting for the detach event from libvirt for device tapaac12afe-d2 with device alias net1 for instance ba3de574-ae62-4e9d-87f8-434c163d9897 {{(pid=73497) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-0fa38e1d-31fb-444b-9bbd-4fb088afa3b4 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:db:9f:b9"/><model type="virtio"/><mtu size="1442"/><target dev="tapaac12afe-d2"/></interface> {{(pid=73497) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG nova.compute.manager [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-0fa38e1d-31fb-444b-9bbd-4fb088afa3b4 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:db:9f:b9"/><model type="virtio"/><mtu size="1442"/><target dev="tapaac12afe-d2"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 26 23:15:50 user nova-compute[73497]:   <name>instance-00000007</name>
Aug 26 23:15:50 user nova-compute[73497]:   <uuid>ba3de574-ae62-4e9d-87f8-434c163d9897</uuid>
Aug 26 23:15:50 user nova-compute[73497]:   <metadata>
Aug 26 23:15:50 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:15:50 user nova-compute[73497]:   <nova:package version="0.0.0"/>
Aug 26 23:15:50 user nova-compute[73497]:   <nova:name>tempest-device-tagging-server-1306226483</nova:name>
Aug 26 23:15:50 user nova-compute[73497]:   <nova:creationTime>2023-08-26 23:15:21</nova:creationTime>
Aug 26 23:15:50 user nova-compute[73497]:   <nova:flavor name="m1.tiny">
Aug 26 23:15:50 user nova-compute[73497]:     <nova:memory>512</nova:memory>
Aug 26 23:15:50 user nova-compute[73497]:     <nova:disk>1</nova:disk>
Aug 26 23:15:50 user nova-compute[73497]:     <nova:swap>0</nova:swap>
Aug 26 23:15:50 user nova-compute[73497]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:15:50 user nova-compute[73497]:     <nova:vcpus>1</nova:vcpus>
Aug 26 23:15:50 user nova-compute[73497]:   </nova:flavor>
Aug 26 23:15:50 user nova-compute[73497]:   <nova:owner>
Aug 26 23:15:50 user nova-compute[73497]:     <nova:user uuid="a73eb19d92254c56b126c555a94c9457">tempest-TaggedAttachmentsTest-200456857-project-member</nova:user>
Aug 26 23:15:50 user nova-compute[73497]:     <nova:project uuid="e456078921734435bd38b72c5266d50e">tempest-TaggedAttachmentsTest-200456857</nova:project>
Aug 26 23:15:50 user nova-compute[73497]:   </nova:owner>
Aug 26 23:15:50 user nova-compute[73497]:   <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:15:50 user nova-compute[73497]:   <nova:ports>
Aug 26 23:15:50 user nova-compute[73497]:     <nova:port uuid="ca3ccf3a-86b0-492c-99ae-9cdca5df9336">
Aug 26 23:15:50 user nova-compute[73497]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 23:15:50 user nova-compute[73497]:     </nova:port>
Aug 26 23:15:50 user nova-compute[73497]:     <nova:port uuid="aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a">
Aug 26 23:15:50 user nova-compute[73497]:       <nova:ip type="fixed" address="10.10.10.10" ipVersion="4"/>
Aug 26 23:15:50 user nova-compute[73497]:     </nova:port>
Aug 26 23:15:50 user nova-compute[73497]:   </nova:ports>
Aug 26 23:15:50 user nova-compute[73497]: </nova:instance>
Aug 26 23:15:50 user nova-compute[73497]:   </metadata>
Aug 26 23:15:50 user nova-compute[73497]:   <memory unit='KiB'>524288</memory>
Aug 26 23:15:50 user nova-compute[73497]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 26 23:15:50 user nova-compute[73497]:   <vcpu placement='static'>1</vcpu>
Aug 26 23:15:50 user nova-compute[73497]:   <resource>
Aug 26 23:15:50 user nova-compute[73497]:     <partition>/machine</partition>
Aug 26 23:15:50 user nova-compute[73497]:   </resource>
Aug 26 23:15:50 user nova-compute[73497]:   <sysinfo type='smbios'>
Aug 26 23:15:50 user nova-compute[73497]:     <system>
Aug 26 23:15:50 user nova-compute[73497]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 26 23:15:50 user nova-compute[73497]:       <entry name='product'>OpenStack Nova</entry>
Aug 26 23:15:50 user nova-compute[73497]:       <entry name='version'>0.0.0</entry>
Aug 26 23:15:50 user nova-compute[73497]:       <entry name='serial'>ba3de574-ae62-4e9d-87f8-434c163d9897</entry>
Aug 26 23:15:50 user nova-compute[73497]:       <entry name='uuid'>ba3de574-ae62-4e9d-87f8-434c163d9897</entry>
Aug 26 23:15:50 user nova-compute[73497]:       <entry name='family'>Virtual Machine</entry>
Aug 26 23:15:50 user nova-compute[73497]:     </system>
Aug 26 23:15:50 user nova-compute[73497]:   </sysinfo>
Aug 26 23:15:50 user nova-compute[73497]:   <os>
Aug 26 23:15:50 user nova-compute[73497]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 26 23:15:50 user nova-compute[73497]:     <boot dev='hd'/>
Aug 26 23:15:50 user nova-compute[73497]:     <smbios mode='sysinfo'/>
Aug 26 23:15:50 user nova-compute[73497]:   </os>
Aug 26 23:15:50 user nova-compute[73497]:   <features>
Aug 26 23:15:50 user nova-compute[73497]:     <acpi/>
Aug 26 23:15:50 user nova-compute[73497]:     <apic/>
Aug 26 23:15:50 user nova-compute[73497]:     <vmcoreinfo state='on'/>
Aug 26 23:15:50 user nova-compute[73497]:   </features>
Aug 26 23:15:50 user nova-compute[73497]:   <cpu mode='custom' match='exact' check='full'>
Aug 26 23:15:50 user nova-compute[73497]:     <model fallback='forbid'>Nehalem</model>
Aug 26 23:15:50 user nova-compute[73497]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 26 23:15:50 user nova-compute[73497]:     <feature policy='require' name='vme'/>
Aug 26 23:15:50 user nova-compute[73497]:     <feature policy='require' name='x2apic'/>
Aug 26 23:15:50 user nova-compute[73497]:     <feature policy='require' name='hypervisor'/>
Aug 26 23:15:50 user nova-compute[73497]:   </cpu>
Aug 26 23:15:50 user nova-compute[73497]:   <clock offset='utc'>
Aug 26 23:15:50 user nova-compute[73497]:     <timer name='pit' tickpolicy='delay'/>
Aug 26 23:15:50 user nova-compute[73497]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 26 23:15:50 user nova-compute[73497]:     <timer name='hpet' present='no'/>
Aug 26 23:15:50 user nova-compute[73497]:   </clock>
Aug 26 23:15:50 user nova-compute[73497]:   <on_poweroff>destroy</on_poweroff>
Aug 26 23:15:50 user nova-compute[73497]:   <on_reboot>restart</on_reboot>
Aug 26 23:15:50 user nova-compute[73497]:   <on_crash>destroy</on_crash>
Aug 26 23:15:50 user nova-compute[73497]:   <devices>
Aug 26 23:15:50 user nova-compute[73497]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 23:15:50 user nova-compute[73497]:     <disk type='file' device='disk'>
Aug 26 23:15:50 user nova-compute[73497]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 26 23:15:50 user nova-compute[73497]:       <source file='/opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897/disk' index='2'/>
Aug 26 23:15:50 user nova-compute[73497]:       <backingStore type='file' index='3'>
Aug 26 23:15:50 user nova-compute[73497]:         <format type='raw'/>
Aug 26 23:15:50 user nova-compute[73497]:         <source file='/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981'/>
Aug 26 23:15:50 user nova-compute[73497]:         <backingStore/>
Aug 26 23:15:50 user nova-compute[73497]:       </backingStore>
Aug 26 23:15:50 user nova-compute[73497]:       <target dev='vda' bus='virtio'/>
Aug 26 23:15:50 user nova-compute[73497]:       <alias name='virtio-disk0'/>
Aug 26 23:15:50 user nova-compute[73497]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 26 23:15:50 user nova-compute[73497]:     </disk>
Aug 26 23:15:50 user nova-compute[73497]:     <disk type='file' device='cdrom'>
Aug 26 23:15:50 user nova-compute[73497]:       <driver name='qemu' type='raw' cache='none'/>
Aug 26 23:15:50 user nova-compute[73497]:       <source file='/opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897/disk.config' index='1'/>
Aug 26 23:15:50 user nova-compute[73497]:       <backingStore/>
Aug 26 23:15:50 user nova-compute[73497]:       <target dev='hda' bus='ide'/>
Aug 26 23:15:50 user nova-compute[73497]:       <readonly/>
Aug 26 23:15:50 user nova-compute[73497]:       <alias name='ide0-0-0'/>
Aug 26 23:15:50 user nova-compute[73497]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 26 23:15:50 user nova-compute[73497]:     </disk>
Aug 26 23:15:50 user nova-compute[73497]:     <controller type='usb' index='0' model='none'>
Aug 26 23:15:50 user nova-compute[73497]:       <alias name='usb'/>
Aug 26 23:15:50 user nova-compute[73497]:     </controller>
Aug 26 23:15:50 user nova-compute[73497]:     <controller type='pci' index='0' model='pci-root'>
Aug 26 23:15:50 user nova-compute[73497]:       <alias name='pci.0'/>
Aug 26 23:15:50 user nova-compute[73497]:     </controller>
Aug 26 23:15:50 user nova-compute[73497]:     <controller type='ide' index='0'>
Aug 26 23:15:50 user nova-compute[73497]:       <alias name='ide'/>
Aug 26 23:15:50 user nova-compute[73497]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 26 23:15:50 user nova-compute[73497]:     </controller>
Aug 26 23:15:50 user nova-compute[73497]:     <interface type='ethernet'>
Aug 26 23:15:50 user nova-compute[73497]:       <mac address='fa:16:3e:48:b6:d8'/>
Aug 26 23:15:50 user nova-compute[73497]:       <target dev='tapca3ccf3a-86'/>
Aug 26 23:15:50 user nova-compute[73497]:       <model type='virtio'/>
Aug 26 23:15:50 user nova-compute[73497]:       <mtu size='1442'/>
Aug 26 23:15:50 user nova-compute[73497]:       <alias name='net0'/>
Aug 26 23:15:50 user nova-compute[73497]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 26 23:15:50 user nova-compute[73497]:     </interface>
Aug 26 23:15:50 user nova-compute[73497]:     <serial type='pty'>
Aug 26 23:15:50 user nova-compute[73497]:       <source path='/dev/pts/6'/>
Aug 26 23:15:50 user nova-compute[73497]:       <log file='/opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897/console.log' append='off'/>
Aug 26 23:15:50 user nova-compute[73497]:       <target type='isa-serial' port='0'>
Aug 26 23:15:50 user nova-compute[73497]:         <model name='isa-serial'/>
Aug 26 23:15:50 user nova-compute[73497]:       </target>
Aug 26 23:15:50 user nova-compute[73497]:       <alias name='serial0'/>
Aug 26 23:15:50 user nova-compute[73497]:     </serial>
Aug 26 23:15:50 user nova-compute[73497]:     <console type='pty' tty='/dev/pts/6'>
Aug 26 23:15:50 user nova-compute[73497]:       <source path='/dev/pts/6'/>
Aug 26 23:15:50 user nova-compute[73497]:       <log file='/opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897/console.log' append='off'/>
Aug 26 23:15:50 user nova-compute[73497]:       <target type='serial' port='0'/>
Aug 26 23:15:50 user nova-compute[73497]:       <alias name='serial0'/>
Aug 26 23:15:50 user nova-compute[73497]:     </console>
Aug 26 23:15:50 user nova-compute[73497]:     <input type='mouse' bus='ps2'>
Aug 26 23:15:50 user nova-compute[73497]:       <alias name='input0'/>
Aug 26 23:15:50 user nova-compute[73497]:     </input>
Aug 26 23:15:50 user nova-compute[73497]:     <input type='keyboard' bus='ps2'>
Aug 26 23:15:50 user nova-compute[73497]:       <alias name='input1'/>
Aug 26 23:15:50 user nova-compute[73497]:     </input>
Aug 26 23:15:50 user nova-compute[73497]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 26 23:15:50 user nova-compute[73497]:       <listen type='address' address='0.0.0.0'/>
Aug 26 23:15:50 user nova-compute[73497]:     </graphics>
Aug 26 23:15:50 user nova-compute[73497]:     <audio id='1' type='none'/>
Aug 26 23:15:50 user nova-compute[73497]:     <video>
Aug 26 23:15:50 user nova-compute[73497]:       <model type='virtio' heads='1' primary='yes'/>
Aug 26 23:15:50 user nova-compute[73497]:       <alias name='video0'/>
Aug 26 23:15:50 user nova-compute[73497]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 26 23:15:50 user nova-compute[73497]:     </video>
Aug 26 23:15:50 user nova-compute[73497]:     <memballoon model='virtio'>
Aug 26 23:15:50 user nova-compute[73497]:       <stats period='10'/>
Aug 26 23:15:50 user nova-compute[73497]:       <alias name='balloon0'/>
Aug 26 23:15:50 user nova-compute[73497]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 26 23:15:50 user nova-compute[73497]:     </memballoon>
Aug 26 23:15:50 user nova-compute[73497]:     <rng model='virtio'>
Aug 26 23:15:50 user nova-compute[73497]:       <backend model='random'>/dev/urandom</backend>
Aug 26 23:15:50 user nova-compute[73497]:       <alias name='rng0'/>
Aug 26 23:15:50 user nova-compute[73497]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 26 23:15:50 user nova-compute[73497]:     </rng>
Aug 26 23:15:50 user nova-compute[73497]:   </devices>
Aug 26 23:15:50 user nova-compute[73497]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 26 23:15:50 user nova-compute[73497]:     <label>libvirt-ba3de574-ae62-4e9d-87f8-434c163d9897</label>
Aug 26 23:15:50 user nova-compute[73497]:     <imagelabel>libvirt-ba3de574-ae62-4e9d-87f8-434c163d9897</imagelabel>
Aug 26 23:15:50 user nova-compute[73497]:   </seclabel>
Aug 26 23:15:50 user nova-compute[73497]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 26 23:15:50 user nova-compute[73497]:     <label>+64055:+108</label>
Aug 26 23:15:50 user nova-compute[73497]:     <imagelabel>+64055:+108</imagelabel>
Aug 26 23:15:50 user nova-compute[73497]:   </seclabel>
Aug 26 23:15:50 user nova-compute[73497]: </domain>
Aug 26 23:15:50 user nova-compute[73497]:  {{(pid=73497) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 26 23:15:50 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-0fa38e1d-31fb-444b-9bbd-4fb088afa3b4 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Successfully detached device tapaac12afe-d2 from instance ba3de574-ae62-4e9d-87f8-434c163d9897 from the live domain config.
Aug 26 23:15:50 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-0fa38e1d-31fb-444b-9bbd-4fb088afa3b4 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:13:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1306226483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1306226483',id=7,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGe8nVo8i9dIVTRdjLRLAe5YZ0C6xyesogGuomHtses/n0zpuFh2lyzmy4UGl4SR+46J+vpwNqJeLYiNhrlPlaBcbP0iXsCzU1gcnZhT083Y39OsqxeF8liKiCYtA2+jQ==',key_name='tempest-keypair-411871039',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:13:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e456078921734435bd38b72c5266d50e',ramdisk_id='',reservation_id='r-hw890ap9',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-200456857',owner_user_name='tempest-TaggedAttachmentsTest-200456857-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:13:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a73eb19d92254c56b126c555a94c9457',uuid=ba3de574-ae62-4e9d-87f8-434c163d9897,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a", "address": "fa:16:3e:db:9f:b9", "network": {"id": "6c7174a0-0c76-4d29-b4cf-d57ffb086db3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-823928317", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e456078921734435bd38b72c5266d50e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaac12afe-d2", "ovs_interfaceid": "aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-0fa38e1d-31fb-444b-9bbd-4fb088afa3b4 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Converting VIF {"id": "aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a", "address": "fa:16:3e:db:9f:b9", "network": {"id": "6c7174a0-0c76-4d29-b4cf-d57ffb086db3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-823928317", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e456078921734435bd38b72c5266d50e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaac12afe-d2", "ovs_interfaceid": "aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-0fa38e1d-31fb-444b-9bbd-4fb088afa3b4 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:9f:b9,bridge_name='br-int',has_traffic_filtering=True,id=aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a,network=Network(6c7174a0-0c76-4d29-b4cf-d57ffb086db3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaac12afe-d2') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG os_vif [None req-0fa38e1d-31fb-444b-9bbd-4fb088afa3b4 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:9f:b9,bridge_name='br-int',has_traffic_filtering=True,id=aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a,network=Network(6c7174a0-0c76-4d29-b4cf-d57ffb086db3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaac12afe-d2') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaac12afe-d2, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2cb82c5-9f3c-4590-843a-5df9700353f2]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-29b8958c-4350-4ab0-922e-a136eb1475ee tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-29b8958c-4350-4ab0-922e-a136eb1475ee tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] SCSI volumes sdd have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b8958c-4350-4ab0-922e-a136eb1475ee tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c4eacd-2aae-41ad-ac21-4606491542d3]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b8958c-4350-4ab0-922e-a136eb1475ee tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:50 user nova-compute[73497]: INFO os_vif [None req-0fa38e1d-31fb-444b-9bbd-4fb088afa3b4 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:9f:b9,bridge_name='br-int',has_traffic_filtering=True,id=aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a,network=Network(6c7174a0-0c76-4d29-b4cf-d57ffb086db3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaac12afe-d2')
Aug 26 23:15:50 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-0fa38e1d-31fb-444b-9bbd-4fb088afa3b4 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:15:50 user nova-compute[73497]:   <nova:package version="0.0.0"/>
Aug 26 23:15:50 user nova-compute[73497]:   <nova:name>tempest-device-tagging-server-1306226483</nova:name>
Aug 26 23:15:50 user nova-compute[73497]:   <nova:creationTime>2023-08-26 23:15:50</nova:creationTime>
Aug 26 23:15:50 user nova-compute[73497]:   <nova:flavor name="m1.tiny">
Aug 26 23:15:50 user nova-compute[73497]:     <nova:memory>512</nova:memory>
Aug 26 23:15:50 user nova-compute[73497]:     <nova:disk>1</nova:disk>
Aug 26 23:15:50 user nova-compute[73497]:     <nova:swap>0</nova:swap>
Aug 26 23:15:50 user nova-compute[73497]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:15:50 user nova-compute[73497]:     <nova:vcpus>1</nova:vcpus>
Aug 26 23:15:50 user nova-compute[73497]:   </nova:flavor>
Aug 26 23:15:50 user nova-compute[73497]:   <nova:owner>
Aug 26 23:15:50 user nova-compute[73497]:     <nova:user uuid="a73eb19d92254c56b126c555a94c9457">tempest-TaggedAttachmentsTest-200456857-project-member</nova:user>
Aug 26 23:15:50 user nova-compute[73497]:     <nova:project uuid="e456078921734435bd38b72c5266d50e">tempest-TaggedAttachmentsTest-200456857</nova:project>
Aug 26 23:15:50 user nova-compute[73497]:   </nova:owner>
Aug 26 23:15:50 user nova-compute[73497]:   <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:15:50 user nova-compute[73497]:   <nova:ports>
Aug 26 23:15:50 user nova-compute[73497]:     <nova:port uuid="ca3ccf3a-86b0-492c-99ae-9cdca5df9336">
Aug 26 23:15:50 user nova-compute[73497]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 23:15:50 user nova-compute[73497]:     </nova:port>
Aug 26 23:15:50 user nova-compute[73497]:   </nova:ports>
Aug 26 23:15:50 user nova-compute[73497]: </nova:instance>
Aug 26 23:15:50 user nova-compute[73497]:  {{(pid=73497) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf53d9f5-01b7-486f-9475-db5984f5b3fa]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b8958c-4350-4ab0-922e-a136eb1475ee tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63, portal: 172.16.0.220,3260]
Aug 26 23:15:50 user nova-compute[73497]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63, portal: 172.16.0.220,3260] successful.
Aug 26 23:15:50 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9eb27dd-3a77-4acc-a0d8-d053152b9b63 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1542ccea-bf1b-4cc0-a7e5-5437dc658e07]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b8958c-4350-4ab0-922e-a136eb1475ee tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-29b8958c-4350-4ab0-922e-a136eb1475ee tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.425s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b8958c-4350-4ab0-922e-a136eb1475ee tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] <== disconnect_volume: return (428ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29b8958c-4350-4ab0-922e-a136eb1475ee tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG nova.compute.manager [req-5d94b6d8-3724-4754-be02-4d4766386f64 req-995a37dc-39e0-4885-8763-602da23e4419 service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Received event network-vif-unplugged-aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-5d94b6d8-3724-4754-be02-4d4766386f64 req-995a37dc-39e0-4885-8763-602da23e4419 service nova] Acquiring lock "ba3de574-ae62-4e9d-87f8-434c163d9897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-5d94b6d8-3724-4754-be02-4d4766386f64 req-995a37dc-39e0-4885-8763-602da23e4419 service nova] Lock "ba3de574-ae62-4e9d-87f8-434c163d9897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-5d94b6d8-3724-4754-be02-4d4766386f64 req-995a37dc-39e0-4885-8763-602da23e4419 service nova] Lock "ba3de574-ae62-4e9d-87f8-434c163d9897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG nova.compute.manager [req-5d94b6d8-3724-4754-be02-4d4766386f64 req-995a37dc-39e0-4885-8763-602da23e4419 service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] No waiting events found dispatching network-vif-unplugged-aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:15:50 user nova-compute[73497]: WARNING nova.compute.manager [req-5d94b6d8-3724-4754-be02-4d4766386f64 req-995a37dc-39e0-4885-8763-602da23e4419 service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Received unexpected event network-vif-unplugged-aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a for instance with vm_state active and task_state None.
Aug 26 23:15:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG nova.compute.manager [req-05b705ea-1d4c-4556-a238-e63909338d13 req-12ad1f73-23e2-40ba-b760-2a15dbc5ac77 service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Received event network-vif-unplugged-ea0c8f3c-1937-4d8c-968a-21a620ff5f7d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-05b705ea-1d4c-4556-a238-e63909338d13 req-12ad1f73-23e2-40ba-b760-2a15dbc5ac77 service nova] Acquiring lock "62f841d2-09e7-448b-8c1c-26c824c473ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-05b705ea-1d4c-4556-a238-e63909338d13 req-12ad1f73-23e2-40ba-b760-2a15dbc5ac77 service nova] Lock "62f841d2-09e7-448b-8c1c-26c824c473ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-05b705ea-1d4c-4556-a238-e63909338d13 req-12ad1f73-23e2-40ba-b760-2a15dbc5ac77 service nova] Lock "62f841d2-09e7-448b-8c1c-26c824c473ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG nova.compute.manager [req-05b705ea-1d4c-4556-a238-e63909338d13 req-12ad1f73-23e2-40ba-b760-2a15dbc5ac77 service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] No waiting events found dispatching network-vif-unplugged-ea0c8f3c-1937-4d8c-968a-21a620ff5f7d {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:15:51 user nova-compute[73497]: WARNING nova.compute.manager [req-05b705ea-1d4c-4556-a238-e63909338d13 req-12ad1f73-23e2-40ba-b760-2a15dbc5ac77 service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Received unexpected event network-vif-unplugged-ea0c8f3c-1937-4d8c-968a-21a620ff5f7d for instance with vm_state active and task_state rebuilding.
Aug 26 23:15:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0fa38e1d-31fb-444b-9bbd-4fb088afa3b4 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Acquiring lock "refresh_cache-ba3de574-ae62-4e9d-87f8-434c163d9897" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0fa38e1d-31fb-444b-9bbd-4fb088afa3b4 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Acquired lock "refresh_cache-ba3de574-ae62-4e9d-87f8-434c163d9897" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG nova.network.neutron [None req-0fa38e1d-31fb-444b-9bbd-4fb088afa3b4 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:51 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Instance destroyed successfully.
Aug 26 23:15:51 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Instance destroyed successfully.
Aug 26 23:15:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:13:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-766701757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-474747102',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByjF8J1FTf4Yf+f0bhNilYywxbVc7jA9buhoEIOCxGzdOlcDHyYAz+iC83msNEYmiVpBnhhT5cv+65/WSDDw63y6W9k4x8IST6h+KDUrN39XmHZzLFbe/p/7dgfn+8+iA==',key_name='tempest-keypair-1496592320',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:14:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='02a6bf8d596b4695a60e15661fd18352',ramdisk_id='',reservation_id='r-lyo5f7oa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1814198428',owner_user_name='tempest-ServerActionsV293TestJSON-1814198428-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:15:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c6bce6dad6f4c1092286fa122e6ed74',uuid=62f841d2-09e7-448b-8c1c-26c824c473ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea0c8f3c-1937-4d8c-968a-21a620ff5f7d", "address": "fa:16:3e:34:77:60", "network": {"id": "52dfb1fe-f560-4f40-8594-3b13d3ff06d9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2040079808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a6bf8d596b4695a60e15661fd18352", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0c8f3c-19", "ovs_interfaceid": "ea0c8f3c-1937-4d8c-968a-21a620ff5f7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Converting VIF {"id": "ea0c8f3c-1937-4d8c-968a-21a620ff5f7d", "address": "fa:16:3e:34:77:60", "network": {"id": "52dfb1fe-f560-4f40-8594-3b13d3ff06d9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2040079808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a6bf8d596b4695a60e15661fd18352", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0c8f3c-19", "ovs_interfaceid": "ea0c8f3c-1937-4d8c-968a-21a620ff5f7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:77:60,bridge_name='br-int',has_traffic_filtering=True,id=ea0c8f3c-1937-4d8c-968a-21a620ff5f7d,network=Network(52dfb1fe-f560-4f40-8594-3b13d3ff06d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0c8f3c-19') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG os_vif [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:77:60,bridge_name='br-int',has_traffic_filtering=True,id=ea0c8f3c-1937-4d8c-968a-21a620ff5f7d,network=Network(52dfb1fe-f560-4f40-8594-3b13d3ff06d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0c8f3c-19') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea0c8f3c-19, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:15:51 user nova-compute[73497]: INFO os_vif [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:77:60,bridge_name='br-int',has_traffic_filtering=True,id=ea0c8f3c-1937-4d8c-968a-21a620ff5f7d,network=Network(52dfb1fe-f560-4f40-8594-3b13d3ff06d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0c8f3c-19')
Aug 26 23:15:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ONHTIbKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:15:51 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 23:15:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e911079-04d6-4dfc-8568-14714093effc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab76971-ed2e-44b4-b203-5098d7bc15de]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:15:51 user nova-compute[73497]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)
Aug 26 23:15:51 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:15:51 user nova-compute[73497]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)
Aug 26 23:15:51 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281c573d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a'): ({'sdb'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Removing single pathed devices sdb {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f2263b-6558-4276-8d53-7796374c9ab4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca144c10-5633-4fa4-b791-b2f24c38818d]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Flushing IO for device /dev/sdb {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[752bf070-c309-456c-a698-8baa06c8457f]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG nova.objects.instance [None req-29b8958c-4350-4ab0-922e-a136eb1475ee tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Lazy-loading 'flavor' on Instance uuid 865d6369-32ac-46ac-b6df-37d8fa4bf440 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfa8187-679c-4f17-bf7a-5286c3d46077]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4564368e-245e-4241-bbff-5e4a07b36495]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-29b8958c-4350-4ab0-922e-a136eb1475ee tempest-VolumesAssistedSnapshotsTest-1593629219 tempest-VolumesAssistedSnapshotsTest-1593629219-project-admin] Lock "865d6369-32ac-46ac-b6df-37d8fa4bf440" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.314s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[db73f6c2-a972-4c02-b735-1eba6caf8889]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a, portal: 172.16.0.220,3260]
Aug 26 23:15:52 user nova-compute[73497]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a, portal: 172.16.0.220,3260] successful.
Aug 26 23:15:52 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[562258b1-59aa-4163-bd20-5a629001a2d3]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.809s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] <== disconnect_volume: return (812ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:15:52 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Deleting instance files /opt/stack/data/nova/instances/62f841d2-09e7-448b-8c1c-26c824c473ba_del
Aug 26 23:15:52 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Deletion of /opt/stack/data/nova/instances/62f841d2-09e7-448b-8c1c-26c824c473ba_del complete
Aug 26 23:15:52 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:15:52 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:15:52 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=7340MB free_disk=25.498565673828125GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:52 user nova-compute[73497]: INFO nova.network.neutron [None req-0fa38e1d-31fb-444b-9bbd-4fb088afa3b4 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Port aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 26 23:15:52 user nova-compute[73497]: DEBUG nova.network.neutron [None req-0fa38e1d-31fb-444b-9bbd-4fb088afa3b4 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Updating instance_info_cache with network_info: [{"id": "ca3ccf3a-86b0-492c-99ae-9cdca5df9336", "address": "fa:16:3e:48:b6:d8", "network": {"id": "ab1acb2f-a437-49f1-a450-c4001cb8a037", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1785575264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e456078921734435bd38b72c5266d50e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3ccf3a-86", "ovs_interfaceid": "ca3ccf3a-86b0-492c-99ae-9cdca5df9336", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0fa38e1d-31fb-444b-9bbd-4fb088afa3b4 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Releasing lock "refresh_cache-ba3de574-ae62-4e9d-87f8-434c163d9897" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0fa38e1d-31fb-444b-9bbd-4fb088afa3b4 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lock "interface-ba3de574-ae62-4e9d-87f8-434c163d9897-aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.539s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 926f8e5c-8d8a-4f07-bf08-e60700ce4698 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 994093f0-e6b2-4c96-b259-c559ef2b1fbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 171985a3-358d-4b26-a66c-372b9b99b386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 1a58c5e7-b4c7-4bd5-8dd1-a98492139240 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance ba3de574-ae62-4e9d-87f8-434c163d9897 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance ab745e33-a11e-4ee4-a442-1e7893448d27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 865d6369-32ac-46ac-b6df-37d8fa4bf440 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 62f841d2-09e7-448b-8c1c-26c824c473ba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 79d00f46-3843-4297-ba47-33557b11d489 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:15:52 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 62f841d2-09e7-448b-8c1c-26c824c473ba could not be found.
Aug 26 23:15:52 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ONHTIbKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:15:52 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 23:15:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeab9e9d-f959-487b-bf79-572e97477ba2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[106c92fa-7aeb-4f1a-965c-7b26da57ac8b]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)
Aug 26 23:15:52 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)
Aug 26 23:15:52 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281c56e680>, {}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Disconnecting from: [] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.058s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] <== disconnect_volume: return (60ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG nova.compute.manager [req-87d39eab-361c-47e7-8a20-4e62bb1b57ae req-fd6ad96e-f6da-47a4-99ab-7f322b066c44 service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Received event network-vif-plugged-aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-87d39eab-361c-47e7-8a20-4e62bb1b57ae req-fd6ad96e-f6da-47a4-99ab-7f322b066c44 service nova] Acquiring lock "ba3de574-ae62-4e9d-87f8-434c163d9897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-87d39eab-361c-47e7-8a20-4e62bb1b57ae req-fd6ad96e-f6da-47a4-99ab-7f322b066c44 service nova] Lock "ba3de574-ae62-4e9d-87f8-434c163d9897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-87d39eab-361c-47e7-8a20-4e62bb1b57ae req-fd6ad96e-f6da-47a4-99ab-7f322b066c44 service nova] Lock "ba3de574-ae62-4e9d-87f8-434c163d9897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:15:52 user nova-compute[73497]: DEBUG nova.compute.manager [req-87d39eab-361c-47e7-8a20-4e62bb1b57ae req-fd6ad96e-f6da-47a4-99ab-7f322b066c44 service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] No waiting events found dispatching network-vif-plugged-aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:15:52 user nova-compute[73497]: WARNING nova.compute.manager [req-87d39eab-361c-47e7-8a20-4e62bb1b57ae req-fd6ad96e-f6da-47a4-99ab-7f322b066c44 service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Received unexpected event network-vif-plugged-aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a for instance with vm_state active and task_state None.
Aug 26 23:15:52 user nova-compute[73497]: DEBUG nova.compute.manager [req-87d39eab-361c-47e7-8a20-4e62bb1b57ae req-fd6ad96e-f6da-47a4-99ab-7f322b066c44 service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Received event network-vif-deleted-aac12afe-d2c8-48d9-9bb8-5dc65df5ed0a {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:15:53 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:15:53 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:15:53 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:15:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.549s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:15:53 user nova-compute[73497]: DEBUG nova.compute.manager [req-61fe366a-fb56-4d54-9e93-33bb67d032f1 req-0cf68dee-773e-494c-80ba-70ac2202652b service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Received event network-vif-plugged-ea0c8f3c-1937-4d8c-968a-21a620ff5f7d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:15:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-61fe366a-fb56-4d54-9e93-33bb67d032f1 req-0cf68dee-773e-494c-80ba-70ac2202652b service nova] Acquiring lock "62f841d2-09e7-448b-8c1c-26c824c473ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-61fe366a-fb56-4d54-9e93-33bb67d032f1 req-0cf68dee-773e-494c-80ba-70ac2202652b service nova] Lock "62f841d2-09e7-448b-8c1c-26c824c473ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-61fe366a-fb56-4d54-9e93-33bb67d032f1 req-0cf68dee-773e-494c-80ba-70ac2202652b service nova] Lock "62f841d2-09e7-448b-8c1c-26c824c473ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:15:53 user nova-compute[73497]: DEBUG nova.compute.manager [req-61fe366a-fb56-4d54-9e93-33bb67d032f1 req-0cf68dee-773e-494c-80ba-70ac2202652b service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] No waiting events found dispatching network-vif-plugged-ea0c8f3c-1937-4d8c-968a-21a620ff5f7d {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:15:53 user nova-compute[73497]: WARNING nova.compute.manager [req-61fe366a-fb56-4d54-9e93-33bb67d032f1 req-0cf68dee-773e-494c-80ba-70ac2202652b service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Received unexpected event network-vif-plugged-ea0c8f3c-1937-4d8c-968a-21a620ff5f7d for instance with vm_state active and task_state rebuilding.
Aug 26 23:15:53 user nova-compute[73497]: DEBUG nova.compute.manager [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Preparing to wait for external event volume-reimaged-2fb2814e-8af9-455e-aaba-faa885d49a3a {{(pid=73497) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 26 23:15:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Acquiring lock "62f841d2-09e7-448b-8c1c-26c824c473ba-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Lock "62f841d2-09e7-448b-8c1c-26c824c473ba-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Lock "62f841d2-09e7-448b-8c1c-26c824c473ba-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:15:54 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:15:54 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:15:54 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:15:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-994093f0-e6b2-4c96-b259-c559ef2b1fbc" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:15:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-994093f0-e6b2-4c96-b259-c559ef2b1fbc" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:15:54 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:15:54 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Updating instance_info_cache with network_info: [{"id": "9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2", "address": "fa:16:3e:b8:5f:1d", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b0aca2b-85", "ovs_interfaceid": "9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:15:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-994093f0-e6b2-4c96-b259-c559ef2b1fbc" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:15:55 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:15:55 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:15:55 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:15:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:15:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:15:57 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693091742.2996292, cfdfc81c-c44a-4e43-9053-74f1fce8ca3d => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:15:57 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] VM Stopped (Lifecycle Event)
Aug 26 23:15:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-b9ce09a9-e2ec-4a09-86ad-d120aab0708a None None] [instance: cfdfc81c-c44a-4e43-9053-74f1fce8ca3d] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:15:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:15:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:15:57 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:15:57 user nova-compute[73497]: INFO nova.compute.claims [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Claim successful on node user
Aug 26 23:15:57 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:15:57 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:15:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:15:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:15:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:15:57 user nova-compute[73497]: DEBUG nova.network.neutron [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:15:57 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:15:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:15:58 user nova-compute[73497]: INFO nova.virt.block_device [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Booting with blank volume at /dev/vda
Aug 26 23:15:58 user nova-compute[73497]: DEBUG nova.policy [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '83005131fdc2411abe7a198157910743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee8ef1c899342b38a624c1c28309d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:15:58 user nova-compute[73497]: DEBUG nova.network.neutron [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Successfully created port: 2fdb126c-c800-488a-9879-08a65e646325 {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:15:59 user nova-compute[73497]: DEBUG nova.network.neutron [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Successfully updated port: 2fdb126c-c800-488a-9879-08a65e646325 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:15:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "refresh_cache-aebaeda6-23d1-43a1-afc8-bdc8992067e5" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:15:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquired lock "refresh_cache-aebaeda6-23d1-43a1-afc8-bdc8992067e5" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:15:59 user nova-compute[73497]: DEBUG nova.network.neutron [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:15:59 user nova-compute[73497]: DEBUG nova.compute.manager [req-3a0689c9-ea6e-42b8-ad3d-81c98fe094e8 req-8f1593e7-feff-4af7-913b-60fc0a591a22 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Received event network-changed-2fdb126c-c800-488a-9879-08a65e646325 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:15:59 user nova-compute[73497]: DEBUG nova.compute.manager [req-3a0689c9-ea6e-42b8-ad3d-81c98fe094e8 req-8f1593e7-feff-4af7-913b-60fc0a591a22 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Refreshing instance network info cache due to event network-changed-2fdb126c-c800-488a-9879-08a65e646325. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:15:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3a0689c9-ea6e-42b8-ad3d-81c98fe094e8 req-8f1593e7-feff-4af7-913b-60fc0a591a22 service nova] Acquiring lock "refresh_cache-aebaeda6-23d1-43a1-afc8-bdc8992067e5" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:15:59 user nova-compute[73497]: DEBUG nova.network.neutron [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:15:59 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wSCatUur', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ab745e33-a11e-4ee4-a442-1e7893448d27', 'attached_at': '', 'detached_at': '', 'volume_id': '4dac4890-c469-48e1-a4df-bef84bc6e46a', 'serial': '4dac4890-c469-48e1-a4df-bef84bc6e46a'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lQKeEtSk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'ab745e33-a11e-4ee4-a442-1e7893448d27', 'attached_at': '', 'detached_at': '', 'volume_id': '8bbc3abb-c6d3-471c-b47f-e9a43806dfac', 'serial'} {{(pid=73497) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 26 23:15:59 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:15:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wSCatUur', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:15:59 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:15:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:15:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:15:59 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:15:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:15:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:15:59 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:15:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:59 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[06713b59-de78-4ee8-8413-3665f3d1e6bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:15:59 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:15:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:15:59 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c16a9f9-acc8-42f1-920e-8ee7df7146cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:15:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a] added
Aug 26 23:15:59 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:15:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d38ece-9f5c-41aa-b6b9-69818ade6b5e]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3a5597-578d-40ca-b1ea-9d813a3858ff]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wSCatUur {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wSCatUur" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc648775-a70f-4aa8-946e-33be4b12dd5a]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wSCatUur'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[365fde77-273c-4466-aee5-03dd905d8ddd]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5955c669-acea-4b34-bf3f-082cc351c3dd]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)
Aug 26 23:16:00 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)
Aug 26 23:16:00 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG nova.network.neutron [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Updating instance_info_cache with network_info: [{"id": "2fdb126c-c800-488a-9879-08a65e646325", "address": "fa:16:3e:e0:28:c4", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fdb126c-c8", "ovs_interfaceid": "2fdb126c-c800-488a-9879-08a65e646325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Releasing lock "refresh_cache-aebaeda6-23d1-43a1-afc8-bdc8992067e5" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG nova.compute.manager [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Instance network_info: |[{"id": "2fdb126c-c800-488a-9879-08a65e646325", "address": "fa:16:3e:e0:28:c4", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fdb126c-c8", "ovs_interfaceid": "2fdb126c-c800-488a-9879-08a65e646325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3a0689c9-ea6e-42b8-ad3d-81c98fe094e8 req-8f1593e7-feff-4af7-913b-60fc0a591a22 service nova] Acquired lock "refresh_cache-aebaeda6-23d1-43a1-afc8-bdc8992067e5" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG nova.network.neutron [req-3a0689c9-ea6e-42b8-ad3d-81c98fe094e8 req-8f1593e7-feff-4af7-913b-60fc0a591a22 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Refreshing network info cache for port 2fdb126c-c800-488a-9879-08a65e646325 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5633109c-6628-40d8-ba20-93fe6ad0c5bf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a, portal: 172.16.0.220,3260]
Aug 26 23:16:00 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a, portal: 172.16.0.220,3260] successful.
Aug 26 23:16:00 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2d8fde-6017-4b13-9165-312d6b7d3fab]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a9348c-8d12-4982-a2d1-d4ef753e200d]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)
Aug 26 23:16:00 user nova-compute[73497]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a (non-flash)
Aug 26 23:16:00 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)
Aug 26 23:16:00 user nova-compute[73497]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a (non-flash)
Aug 26 23:16:00 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] HCTL ('33', '-', '-', 0) found on session 9 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[11faf6b5-4284-4f95-8c99-0135cf94c91b]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Searching for a device in session 9 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wSCatUur', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG nova.network.neutron [req-3a0689c9-ea6e-42b8-ad3d-81c98fe094e8 req-8f1593e7-feff-4af7-913b-60fc0a591a22 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Updated VIF entry in instance network info cache for port 2fdb126c-c800-488a-9879-08a65e646325. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG nova.network.neutron [req-3a0689c9-ea6e-42b8-ad3d-81c98fe094e8 req-8f1593e7-feff-4af7-913b-60fc0a591a22 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Updating instance_info_cache with network_info: [{"id": "2fdb126c-c800-488a-9879-08a65e646325", "address": "fa:16:3e:e0:28:c4", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fdb126c-c8", "ovs_interfaceid": "2fdb126c-c800-488a-9879-08a65e646325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:16:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3a0689c9-ea6e-42b8-ad3d-81c98fe094e8 req-8f1593e7-feff-4af7-913b-60fc0a591a22 service nova] Releasing lock "refresh_cache-aebaeda6-23d1-43a1-afc8-bdc8992067e5" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:16:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:16:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26537616532376565', 'path': '/dev/sdb'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:16:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537616532376565', 'path': '/dev/sdb'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:16:01 user nova-compute[73497]: DEBUG nova.objects.instance [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Lazy-loading 'flavor' on Instance uuid ab745e33-a11e-4ee4-a442-1e7893448d27 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:16:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:16:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=73497) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 23:16:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] COPY block job progress, current cursor: 137363456 final cursor: 1073741824 {{(pid=73497) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 23:16:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] COPY block job progress, current cursor: 304087040 final cursor: 1073741824 {{(pid=73497) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 23:16:03 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] COPY block job progress, current cursor: 448790528 final cursor: 1073741824 {{(pid=73497) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 23:16:03 user nova-compute[73497]: DEBUG os_brick.utils [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:16:03 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] COPY block job progress, current cursor: 614465536 final cursor: 1073741824 {{(pid=73497) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 23:16:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.031s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:03 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[84694238-b544-4a96-8af5-b228e2dc8a42]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:03 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[020bb717-05da-4a83-ade1-667b7743f2a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:03 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b8efb8-1998-469d-9a01-6e16ae987b30]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:03 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ec4e39-f791-4dcb-bfb5-c5b116af4b9c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:16:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:16:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:16:03 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:16:03 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b353cd16-04fc-4b0d-ae91-ddd99347b8e7]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:16:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:16:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:16:03 user nova-compute[73497]: DEBUG os_brick.utils [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] <== get_connector_properties: return (230ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:16:03 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Updating existing volume attachment record: 31f5b467-a336-4adb-a56d-11eb7f0055d7 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:16:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:04 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] COPY block job progress, current cursor: 718274560 final cursor: 1073741824 {{(pid=73497) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 23:16:04 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] COPY block job progress, current cursor: 855638016 final cursor: 1073741824 {{(pid=73497) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 23:16:05 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] COPY block job progress, current cursor: 1011875840 final cursor: 1073741824 {{(pid=73497) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 23:16:05 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73497) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 23:16:05 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:16:05 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lQKeEtSk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:16:05 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:16:05 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:16:05 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:16:05 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:16:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:05 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01256d2-ae89-478b-a404-5fd60df8ac06]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:05 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0befa506-190c-4c3f-bcd8-c772387e29f2]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:05 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)
Aug 26 23:16:05 user nova-compute[73497]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a (non-flash)
Aug 26 23:16:05 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:16:05 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)
Aug 26 23:16:05 user nova-compute[73497]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a (non-flash)
Aug 26 23:16:05 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:16:05 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282c5164d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac'): ({'sde'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:16:05 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Removing single pathed devices sde {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:16:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:06 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41441ff-9619-40fe-a592-106df973fa15]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:06 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fcad86-1bf8-4327-9228-15c10a11f1fa]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:06 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Flushing IO for device /dev/sde {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:16:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:06 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e448ed5-8fcb-4e37-8522-d0a85ac948b3]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:06 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:16:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:06 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee00c1b-671f-46ae-8d5f-2eeb51668cda]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:06 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:16:06 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] SCSI volumes sde have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:16:06 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:16:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:06 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf38bd5-b470-4d6e-8f4c-a833464ed562]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:06 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:06 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[753e7a7f-f649-46fb-8aa7-e24b1494a3a6]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:06 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac, portal: 172.16.0.220,3260]
Aug 26 23:16:06 user nova-compute[73497]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac, portal: 172.16.0.220,3260] successful.
Aug 26 23:16:06 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:06 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a272a7b2-3fbb-4ad3-8bbb-db4eab484ce2]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:06 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:06 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:16:06 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] <== disconnect_volume: return (316ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:16:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:16:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:06 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wSCatUur', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'ab745e33-a11e-4ee4-a442-1e7893448d27', 'attached_at': '', 'detached_at': '', 'volume_id': '4dac4890-c469-48e1-a4df-bef84bc6e46a', 'serial'} {{(pid=73497) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 26 23:16:06 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] swap_volume: removing Cinder connection for volume 8bbc3abb-c6d3-471c-b47f-e9a43806dfac {{(pid=73497) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 26 23:16:06 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693091751.619224, 62f841d2-09e7-448b-8c1c-26c824c473ba => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:16:06 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] VM Stopped (Lifecycle Event)
Aug 26 23:16:06 user nova-compute[73497]: DEBUG nova.compute.manager [None req-307cecce-1e8e-4799-8f2f-26d109af36ef None None] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:16:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:16:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:16:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:16:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:16:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Acquiring lock "ee6283d5-40de-432d-997c-0be52ff673ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "ee6283d5-40de-432d-997c-0be52ff673ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:17 user nova-compute[73497]: DEBUG nova.compute.manager [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:16:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:17 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:16:17 user nova-compute[73497]: INFO nova.compute.claims [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Claim successful on node user
Aug 26 23:16:17 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:16:17 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:16:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:17 user nova-compute[73497]: DEBUG nova.compute.manager [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:16:17 user nova-compute[73497]: DEBUG nova.compute.manager [req-caaa5d3f-1484-4961-aa4b-2a455216c544 req-291b08a9-5af5-438e-9651-b97206e74fbb service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Received event volume-reimaged-2fb2814e-8af9-455e-aaba-faa885d49a3a {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:16:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-caaa5d3f-1484-4961-aa4b-2a455216c544 req-291b08a9-5af5-438e-9651-b97206e74fbb service nova] Acquiring lock "62f841d2-09e7-448b-8c1c-26c824c473ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-caaa5d3f-1484-4961-aa4b-2a455216c544 req-291b08a9-5af5-438e-9651-b97206e74fbb service nova] Lock "62f841d2-09e7-448b-8c1c-26c824c473ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-caaa5d3f-1484-4961-aa4b-2a455216c544 req-291b08a9-5af5-438e-9651-b97206e74fbb service nova] Lock "62f841d2-09e7-448b-8c1c-26c824c473ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:17 user nova-compute[73497]: DEBUG nova.compute.manager [req-caaa5d3f-1484-4961-aa4b-2a455216c544 req-291b08a9-5af5-438e-9651-b97206e74fbb service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Processing event volume-reimaged-2fb2814e-8af9-455e-aaba-faa885d49a3a {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 26 23:16:17 user nova-compute[73497]: DEBUG nova.compute.manager [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Instance event wait completed in 23 seconds for volume-reimaged {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:16:17 user nova-compute[73497]: DEBUG nova.compute.manager [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:16:17 user nova-compute[73497]: DEBUG nova.network.neutron [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:16:17 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:16:17 user nova-compute[73497]: DEBUG nova.compute.manager [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:16:17 user nova-compute[73497]: INFO nova.virt.block_device [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Booting with volume 2fb2814e-8af9-455e-aaba-faa885d49a3a at /dev/vda
Aug 26 23:16:17 user nova-compute[73497]: DEBUG nova.policy [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cd09339d0e1d46d4a268f6ac8651a9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e765258a50d46dea25bfd9c72970eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:16:17 user nova-compute[73497]: DEBUG nova.compute.manager [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:16:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:16:17 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Creating image(s)
Aug 26 23:16:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "/opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "/opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:17 user nova-compute[73497]: DEBUG os_brick.utils [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:16:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:17 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c587985-edad-4db8-9b6d-883ab6179c79]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:17 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[28274d6b-c714-46bd-98df-c62d9790ea47]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d392c396-7b19-4934-b366-22f4f1dac143]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e075d9-7640-4684-a55d-93ff39100d5a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:16:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:16:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:16:18 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:16:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c795819-9322-4ef1-9a52-bc9c31d50018]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:16:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:16:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:16:18 user nova-compute[73497]: DEBUG os_brick.utils [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:16:18 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Updating existing volume attachment record: 204ff587-967c-4573-a1ec-a5cd920e0c9a {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:16:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.187s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.178s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk 1073741824" returned: 0 in 0.056s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.173s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:18 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:16:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:18 user nova-compute[73497]: DEBUG nova.network.neutron [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Successfully created port: 61639246-9d84-4629-9666-154897feaeae {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:16:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:18 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Cannot resize image /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:16:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:16:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Ensure instance console log exists: /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:16:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:19 user nova-compute[73497]: DEBUG nova.network.neutron [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Successfully updated port: 61639246-9d84-4629-9666-154897feaeae {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:16:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Acquiring lock "refresh_cache-ee6283d5-40de-432d-997c-0be52ff673ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:16:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Acquired lock "refresh_cache-ee6283d5-40de-432d-997c-0be52ff673ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:16:19 user nova-compute[73497]: DEBUG nova.network.neutron [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:16:19 user nova-compute[73497]: DEBUG nova.compute.manager [req-3a873438-69d9-48f8-939e-a91a48f0de79 req-37f677da-21bd-477d-acb0-3cb23f09954b service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Received event network-changed-61639246-9d84-4629-9666-154897feaeae {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:16:19 user nova-compute[73497]: DEBUG nova.compute.manager [req-3a873438-69d9-48f8-939e-a91a48f0de79 req-37f677da-21bd-477d-acb0-3cb23f09954b service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Refreshing instance network info cache due to event network-changed-61639246-9d84-4629-9666-154897feaeae. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:16:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3a873438-69d9-48f8-939e-a91a48f0de79 req-37f677da-21bd-477d-acb0-3cb23f09954b service nova] Acquiring lock "refresh_cache-ee6283d5-40de-432d-997c-0be52ff673ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:16:19 user nova-compute[73497]: DEBUG nova.network.neutron [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:16:19 user nova-compute[73497]: DEBUG nova.network.neutron [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Updating instance_info_cache with network_info: [{"id": "61639246-9d84-4629-9666-154897feaeae", "address": "fa:16:3e:56:41:f9", "network": {"id": "108c66fb-49a3-4c69-a3ac-93d9643a1d3e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025099504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e765258a50d46dea25bfd9c72970eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61639246-9d", "ovs_interfaceid": "61639246-9d84-4629-9666-154897feaeae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:16:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Releasing lock "refresh_cache-ee6283d5-40de-432d-997c-0be52ff673ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:16:19 user nova-compute[73497]: DEBUG nova.compute.manager [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Instance network_info: |[{"id": "61639246-9d84-4629-9666-154897feaeae", "address": "fa:16:3e:56:41:f9", "network": {"id": "108c66fb-49a3-4c69-a3ac-93d9643a1d3e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025099504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e765258a50d46dea25bfd9c72970eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61639246-9d", "ovs_interfaceid": "61639246-9d84-4629-9666-154897feaeae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:16:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3a873438-69d9-48f8-939e-a91a48f0de79 req-37f677da-21bd-477d-acb0-3cb23f09954b service nova] Acquired lock "refresh_cache-ee6283d5-40de-432d-997c-0be52ff673ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:16:19 user nova-compute[73497]: DEBUG nova.network.neutron [req-3a873438-69d9-48f8-939e-a91a48f0de79 req-37f677da-21bd-477d-acb0-3cb23f09954b service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Refreshing network info cache for port 61639246-9d84-4629-9666-154897feaeae {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:16:19 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Start _get_guest_xml network_info=[{"id": "61639246-9d84-4629-9666-154897feaeae", "address": "fa:16:3e:56:41:f9", "network": {"id": "108c66fb-49a3-4c69-a3ac-93d9643a1d3e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025099504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e765258a50d46dea25bfd9c72970eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61639246-9d", "ovs_interfaceid": "61639246-9d84-4629-9666-154897feaeae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:16:20 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:16:20 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:16:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:16:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:16:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:16:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:16:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:16:20 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:16:20 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:16:20 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:16:20 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:16:20 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:16:20 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:16:20 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:16:20 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:16:20 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:16:20 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:16:20 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:16:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:16:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-956611518',display_name='tempest-ServerActionsTestOtherB-server-956611518',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-956611518',id=13,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqify97xxdfMwMioKw2wicMrkUmyII/F1wNcYn2coMZNsxaRCqyQGjP8va1kHwD6Z9ddCdHd23iUWPYbjiNJPdJt82WzvrKCaPX0PtGf0585mA5lLDP0NEIbnQp6LuyOw==',key_name='tempest-keypair-800864699',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e765258a50d46dea25bfd9c72970eb9',ramdisk_id='',reservation_id='r-owyjaonv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-435374476',owner_user_name='tempest-ServerActionsTestOtherB-435374476-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:16:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd09339d0e1d46d4a268f6ac8651a9f5',uuid=ee6283d5-40de-432d-997c-0be52ff673ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61639246-9d84-4629-9666-154897feaeae", "address": "fa:16:3e:56:41:f9", "network": {"id": "108c66fb-49a3-4c69-a3ac-93d9643a1d3e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025099504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e765258a50d46dea25bfd9c72970eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61639246-9d", "ovs_interfaceid": "61639246-9d84-4629-9666-154897feaeae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:16:20 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Converting VIF {"id": "61639246-9d84-4629-9666-154897feaeae", "address": "fa:16:3e:56:41:f9", "network": {"id": "108c66fb-49a3-4c69-a3ac-93d9643a1d3e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025099504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e765258a50d46dea25bfd9c72970eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61639246-9d", "ovs_interfaceid": "61639246-9d84-4629-9666-154897feaeae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:16:20 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=61639246-9d84-4629-9666-154897feaeae,network=Network(108c66fb-49a3-4c69-a3ac-93d9643a1d3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61639246-9d') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:16:20 user nova-compute[73497]: DEBUG nova.objects.instance [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lazy-loading 'pci_devices' on Instance uuid ee6283d5-40de-432d-997c-0be52ff673ca {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:16:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:16:20 user nova-compute[73497]:   <uuid>ee6283d5-40de-432d-997c-0be52ff673ca</uuid>
Aug 26 23:16:20 user nova-compute[73497]:   <name>instance-0000000d</name>
Aug 26 23:16:20 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:16:20 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:16:20 user nova-compute[73497]:   <metadata>
Aug 26 23:16:20 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:16:20 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:16:20 user nova-compute[73497]:       <nova:name>tempest-ServerActionsTestOtherB-server-956611518</nova:name>
Aug 26 23:16:20 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:16:20</nova:creationTime>
Aug 26 23:16:20 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:16:20 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:16:20 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:16:20 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:16:20 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:16:20 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:16:20 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:16:20 user nova-compute[73497]:       <nova:owner>
Aug 26 23:16:20 user nova-compute[73497]:         <nova:user uuid="cd09339d0e1d46d4a268f6ac8651a9f5">tempest-ServerActionsTestOtherB-435374476-project-member</nova:user>
Aug 26 23:16:20 user nova-compute[73497]:         <nova:project uuid="1e765258a50d46dea25bfd9c72970eb9">tempest-ServerActionsTestOtherB-435374476</nova:project>
Aug 26 23:16:20 user nova-compute[73497]:       </nova:owner>
Aug 26 23:16:20 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:16:20 user nova-compute[73497]:       <nova:ports>
Aug 26 23:16:20 user nova-compute[73497]:         <nova:port uuid="61639246-9d84-4629-9666-154897feaeae">
Aug 26 23:16:20 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 23:16:20 user nova-compute[73497]:         </nova:port>
Aug 26 23:16:20 user nova-compute[73497]:       </nova:ports>
Aug 26 23:16:20 user nova-compute[73497]:     </nova:instance>
Aug 26 23:16:20 user nova-compute[73497]:   </metadata>
Aug 26 23:16:20 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:16:20 user nova-compute[73497]:     <system>
Aug 26 23:16:20 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:16:20 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:16:20 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:16:20 user nova-compute[73497]:       <entry name="serial">ee6283d5-40de-432d-997c-0be52ff673ca</entry>
Aug 26 23:16:20 user nova-compute[73497]:       <entry name="uuid">ee6283d5-40de-432d-997c-0be52ff673ca</entry>
Aug 26 23:16:20 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:16:20 user nova-compute[73497]:     </system>
Aug 26 23:16:20 user nova-compute[73497]:   </sysinfo>
Aug 26 23:16:20 user nova-compute[73497]:   <os>
Aug 26 23:16:20 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:16:20 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:16:20 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:16:20 user nova-compute[73497]:   </os>
Aug 26 23:16:20 user nova-compute[73497]:   <features>
Aug 26 23:16:20 user nova-compute[73497]:     <acpi/>
Aug 26 23:16:20 user nova-compute[73497]:     <apic/>
Aug 26 23:16:20 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:16:20 user nova-compute[73497]:   </features>
Aug 26 23:16:20 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:16:20 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:16:20 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:16:20 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:16:20 user nova-compute[73497]:   </clock>
Aug 26 23:16:20 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:16:20 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:16:20 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:16:20 user nova-compute[73497]:   </cpu>
Aug 26 23:16:20 user nova-compute[73497]:   <devices>
Aug 26 23:16:20 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:16:20 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:16:20 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk"/>
Aug 26 23:16:20 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:16:20 user nova-compute[73497]:     </disk>
Aug 26 23:16:20 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:16:20 user nova-compute[73497]:       <mac address="fa:16:3e:56:41:f9"/>
Aug 26 23:16:20 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:16:20 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:16:20 user nova-compute[73497]:       <target dev="tap61639246-9d"/>
Aug 26 23:16:20 user nova-compute[73497]:     </interface>
Aug 26 23:16:20 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:16:20 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/console.log" append="off"/>
Aug 26 23:16:20 user nova-compute[73497]:     </serial>
Aug 26 23:16:20 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:16:20 user nova-compute[73497]:     <video>
Aug 26 23:16:20 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:16:20 user nova-compute[73497]:     </video>
Aug 26 23:16:20 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:16:20 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:16:20 user nova-compute[73497]:     </rng>
Aug 26 23:16:20 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:16:20 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:16:20 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:16:20 user nova-compute[73497]:     </memballoon>
Aug 26 23:16:20 user nova-compute[73497]:   </devices>
Aug 26 23:16:20 user nova-compute[73497]: </domain>
Aug 26 23:16:20 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:16:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:16:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-956611518',display_name='tempest-ServerActionsTestOtherB-server-956611518',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-956611518',id=13,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqify97xxdfMwMioKw2wicMrkUmyII/F1wNcYn2coMZNsxaRCqyQGjP8va1kHwD6Z9ddCdHd23iUWPYbjiNJPdJt82WzvrKCaPX0PtGf0585mA5lLDP0NEIbnQp6LuyOw==',key_name='tempest-keypair-800864699',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e765258a50d46dea25bfd9c72970eb9',ramdisk_id='',reservation_id='r-owyjaonv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-435374476',owner_user_name='tempest-ServerActionsTestOtherB-435374476-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:16:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd09339d0e1d46d4a268f6ac8651a9f5',uuid=ee6283d5-40de-432d-997c-0be52ff673ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61639246-9d84-4629-9666-154897feaeae", "address": "fa:16:3e:56:41:f9", "network": {"id": "108c66fb-49a3-4c69-a3ac-93d9643a1d3e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025099504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e765258a50d46dea25bfd9c72970eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61639246-9d", "ovs_interfaceid": "61639246-9d84-4629-9666-154897feaeae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:16:20 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Converting VIF {"id": "61639246-9d84-4629-9666-154897feaeae", "address": "fa:16:3e:56:41:f9", "network": {"id": "108c66fb-49a3-4c69-a3ac-93d9643a1d3e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025099504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e765258a50d46dea25bfd9c72970eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61639246-9d", "ovs_interfaceid": "61639246-9d84-4629-9666-154897feaeae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:16:20 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=61639246-9d84-4629-9666-154897feaeae,network=Network(108c66fb-49a3-4c69-a3ac-93d9643a1d3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61639246-9d') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:16:20 user nova-compute[73497]: DEBUG os_vif [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=61639246-9d84-4629-9666-154897feaeae,network=Network(108c66fb-49a3-4c69-a3ac-93d9643a1d3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61639246-9d') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:16:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:16:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:16:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61639246-9d, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:16:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap61639246-9d, col_values=(('external_ids', {'iface-id': '61639246-9d84-4629-9666-154897feaeae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:41:f9', 'vm-uuid': 'ee6283d5-40de-432d-997c-0be52ff673ca'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:16:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:16:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:20 user nova-compute[73497]: INFO os_vif [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=61639246-9d84-4629-9666-154897feaeae,network=Network(108c66fb-49a3-4c69-a3ac-93d9643a1d3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61639246-9d')
Aug 26 23:16:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:16:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] No VIF found with MAC fa:16:3e:56:41:f9, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:16:20 user nova-compute[73497]: DEBUG nova.network.neutron [req-3a873438-69d9-48f8-939e-a91a48f0de79 req-37f677da-21bd-477d-acb0-3cb23f09954b service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Updated VIF entry in instance network info cache for port 61639246-9d84-4629-9666-154897feaeae. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:16:20 user nova-compute[73497]: DEBUG nova.network.neutron [req-3a873438-69d9-48f8-939e-a91a48f0de79 req-37f677da-21bd-477d-acb0-3cb23f09954b service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Updating instance_info_cache with network_info: [{"id": "61639246-9d84-4629-9666-154897feaeae", "address": "fa:16:3e:56:41:f9", "network": {"id": "108c66fb-49a3-4c69-a3ac-93d9643a1d3e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025099504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e765258a50d46dea25bfd9c72970eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61639246-9d", "ovs_interfaceid": "61639246-9d84-4629-9666-154897feaeae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:16:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3a873438-69d9-48f8-939e-a91a48f0de79 req-37f677da-21bd-477d-acb0-3cb23f09954b service nova] Releasing lock "refresh_cache-ee6283d5-40de-432d-997c-0be52ff673ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:16:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:21 user nova-compute[73497]: DEBUG nova.compute.manager [req-c967f687-7500-4218-baa3-83f9ae5c88b1 req-6e04dec0-c8bc-4b91-bc1f-6dee5801b988 service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Received event network-vif-plugged-61639246-9d84-4629-9666-154897feaeae {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:16:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c967f687-7500-4218-baa3-83f9ae5c88b1 req-6e04dec0-c8bc-4b91-bc1f-6dee5801b988 service nova] Acquiring lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c967f687-7500-4218-baa3-83f9ae5c88b1 req-6e04dec0-c8bc-4b91-bc1f-6dee5801b988 service nova] Lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c967f687-7500-4218-baa3-83f9ae5c88b1 req-6e04dec0-c8bc-4b91-bc1f-6dee5801b988 service nova] Lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:21 user nova-compute[73497]: DEBUG nova.compute.manager [req-c967f687-7500-4218-baa3-83f9ae5c88b1 req-6e04dec0-c8bc-4b91-bc1f-6dee5801b988 service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] No waiting events found dispatching network-vif-plugged-61639246-9d84-4629-9666-154897feaeae {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:16:21 user nova-compute[73497]: WARNING nova.compute.manager [req-c967f687-7500-4218-baa3-83f9ae5c88b1 req-6e04dec0-c8bc-4b91-bc1f-6dee5801b988 service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Received unexpected event network-vif-plugged-61639246-9d84-4629-9666-154897feaeae for instance with vm_state building and task_state spawning.
Aug 26 23:16:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:23 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091783.6338584, ee6283d5-40de-432d-997c-0be52ff673ca => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:16:23 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] VM Resumed (Lifecycle Event)
Aug 26 23:16:23 user nova-compute[73497]: DEBUG nova.compute.manager [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:16:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:16:23 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Instance spawned successfully.
Aug 26 23:16:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:16:23 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:16:23 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:16:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:16:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:16:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:16:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:16:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:16:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:16:23 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:16:23 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091783.6373987, ee6283d5-40de-432d-997c-0be52ff673ca => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:16:23 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] VM Started (Lifecycle Event)
Aug 26 23:16:23 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:16:23 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:16:23 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:16:23 user nova-compute[73497]: INFO nova.compute.manager [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Took 5.86 seconds to spawn the instance on the hypervisor.
Aug 26 23:16:23 user nova-compute[73497]: DEBUG nova.compute.manager [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:16:23 user nova-compute[73497]: DEBUG nova.compute.manager [req-70461ba9-7724-4e1a-98a9-46bd791e9989 req-5ee76c42-aa03-4f01-afae-d9df19891c9d service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Received event network-vif-plugged-61639246-9d84-4629-9666-154897feaeae {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:16:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-70461ba9-7724-4e1a-98a9-46bd791e9989 req-5ee76c42-aa03-4f01-afae-d9df19891c9d service nova] Acquiring lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-70461ba9-7724-4e1a-98a9-46bd791e9989 req-5ee76c42-aa03-4f01-afae-d9df19891c9d service nova] Lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-70461ba9-7724-4e1a-98a9-46bd791e9989 req-5ee76c42-aa03-4f01-afae-d9df19891c9d service nova] Lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:23 user nova-compute[73497]: DEBUG nova.compute.manager [req-70461ba9-7724-4e1a-98a9-46bd791e9989 req-5ee76c42-aa03-4f01-afae-d9df19891c9d service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] No waiting events found dispatching network-vif-plugged-61639246-9d84-4629-9666-154897feaeae {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:16:23 user nova-compute[73497]: WARNING nova.compute.manager [req-70461ba9-7724-4e1a-98a9-46bd791e9989 req-5ee76c42-aa03-4f01-afae-d9df19891c9d service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Received unexpected event network-vif-plugged-61639246-9d84-4629-9666-154897feaeae for instance with vm_state building and task_state spawning.
Aug 26 23:16:23 user nova-compute[73497]: INFO nova.compute.manager [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Took 6.69 seconds to build instance.
Aug 26 23:16:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-db8c859d-bbe6-4084-80b5-8953ab53b026 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "ee6283d5-40de-432d-997c-0be52ff673ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.807s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] swap_volume: Updating volume 8bbc3abb-c6d3-471c-b47f-e9a43806dfac BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "wSCatUur", "auth_password": "umDZ0OQKlr3enc", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "4dac4890-c469-48e1-a4df-bef84bc6e46a"}, "status": "reserved", "instance": "ab745e33-a11e-4ee4-a442-1e7893448d27", "attached_at": "", "detached_at": "", "volume_id": "4dac4890-c469-48e1-a4df-bef84bc6e46a", "serial": "4dac4890-c469-48e1-a4df-bef84bc6e46a"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '4dac4890-c469-48e1-a4df-bef84bc6e46a', 'no_device': None, 'attachment_id': '420a5531-77ba-443c-a6f7-c54e53e7e593'} {{(pid=73497) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e5847ae1-ca25-4660-9aed-e87a449a20a5 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Lock "ab745e33-a11e-4ee4-a442-1e7893448d27" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 43.585s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG nova.compute.manager [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:16:25 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Creating image(s)
Aug 26 23:16:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Did not create local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Ensure instance console log exists: /opt/stack/data/nova/instances/aebaeda6-23d1-43a1-afc8-bdc8992067e5/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Start _get_guest_xml network_info=[{"id": "2fdb126c-c800-488a-9879-08a65e646325", "address": "fa:16:3e:e0:28:c4", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fdb126c-c8", "ovs_interfaceid": "2fdb126c-c800-488a-9879-08a65e646325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '31f5b467-a336-4adb-a56d-11eb7f0055d7', 'guest_format': None, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nrOEmVhU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aebaeda6-23d1-43a1-afc8-bdc8992067e5', 'attached_at': '', 'detached_at': '', 'volume_id': '8c797b7d-2462-4a35-9c56-b07c78e085d2', 'serial': '8c797b7d-2462-4a35-9c56-b07c78e085d2'}, 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:16:25 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:16:25 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:16:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nrOEmVhU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:16:25 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:16:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:16:25 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:16:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:16:25 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:16:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4845bfe2-3e47-468d-a45e-63011761b4e8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:16:25 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[760faac4-b78b-4dbb-978c-80b4cab0c45f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2] added
Aug 26 23:16:25 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e600f23-6275-45fa-81f4-6a3be44ab809]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[108fdc12-c6ba-4193-8094-19c608d08048]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nrOEmVhU {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nrOEmVhU" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd4e33e-cbf2-4b1f-8720-19b831f1e48c]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nrOEmVhU'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c2753f-3715-49f3-aca1-41d3cd0992d6]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8217a21-f6cd-4ece-b603-a46fab2fb997]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a (non-flash)
Aug 26 23:16:26 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a (non-flash)
Aug 26 23:16:26 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbd98cb-45ce-4a0b-81ee-5e25bb1cba23]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2, portal: 172.16.0.220,3260]
Aug 26 23:16:26 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2, portal: 172.16.0.220,3260] successful.
Aug 26 23:16:26 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Acquiring lock "ab745e33-a11e-4ee4-a442-1e7893448d27" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Lock "ab745e33-a11e-4ee4-a442-1e7893448d27" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG os_brick.utils [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac61953b-b9fe-49d3-ab61-350598d08c87]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b432809-561f-402e-bdbc-3e1ebf6b8a0a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbf7b93-07d8-49e0-85fd-0c651f848a47]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:16:26 user nova-compute[73497]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a (non-flash)
Aug 26 23:16:26 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:16:26 user nova-compute[73497]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a (non-flash)
Aug 26 23:16:26 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.494s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] HCTL ('34', '-', '-', 0) found on session 11 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[570f4392-5e68-4ee6-a031-2d0bd3946199]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacb81ae-fc09-4999-b9dd-4d0d9c22f243]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Searching for a device in session 11 and hctl ['34', '*', '*', 0] yield: None {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[85775eed-bbd4-4e48-bc09-a7e158abd58a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0234ebe8-c4f1-4f56-b4e1-ddae32fa20e7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:16:26 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6e4998-63bf-459f-913a-e9b701938902]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG os_brick.utils [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:26 user nova-compute[73497]: INFO nova.compute.manager [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Swapping volume 4dac4890-c469-48e1-a4df-bef84bc6e46a for 8bbc3abb-c6d3-471c-b47f-e9a43806dfac
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Acquiring lock "a19ccf77-8c30-44af-bd19-9b879fa60942" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "a19ccf77-8c30-44af-bd19-9b879fa60942" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG nova.compute.manager [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:26 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:16:26 user nova-compute[73497]: INFO nova.compute.claims [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Claim successful on node user
Aug 26 23:16:27 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Searching for a device in session 11 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nrOEmVhU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.527s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] <== connect_volume: return (1528ms) {'type': 'block', 'scsi_wwn': '26262383063396566', 'path': '/dev/sdc'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262383063396566', 'path': '/dev/sdc'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1490878168',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1490878168',id=12,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ee8ef1c899342b38a624c1c28309d41',ramdisk_id='',reservation_id='r-92y3pmcv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1276656289',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:15:58Z,user_data=None,user_id='83005131fdc2411abe7a198157910743',uuid=aebaeda6-23d1-43a1-afc8-bdc8992067e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2fdb126c-c800-488a-9879-08a65e646325", "address": "fa:16:3e:e0:28:c4", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fdb126c-c8", "ovs_interfaceid": "2fdb126c-c800-488a-9879-08a65e646325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Converting VIF {"id": "2fdb126c-c800-488a-9879-08a65e646325", "address": "fa:16:3e:e0:28:c4", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fdb126c-c8", "ovs_interfaceid": "2fdb126c-c800-488a-9879-08a65e646325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:28:c4,bridge_name='br-int',has_traffic_filtering=True,id=2fdb126c-c800-488a-9879-08a65e646325,network=Network(f8ba0a6b-e4fc-4236-9df3-90ffab8824fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fdb126c-c8') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG nova.objects.instance [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lazy-loading 'pci_devices' on Instance uuid aebaeda6-23d1-43a1-afc8-bdc8992067e5 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:16:27 user nova-compute[73497]:   <uuid>aebaeda6-23d1-43a1-afc8-bdc8992067e5</uuid>
Aug 26 23:16:27 user nova-compute[73497]:   <name>instance-0000000c</name>
Aug 26 23:16:27 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:16:27 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:16:27 user nova-compute[73497]:   <metadata>
Aug 26 23:16:27 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:16:27 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:16:27 user nova-compute[73497]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1490878168</nova:name>
Aug 26 23:16:27 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:16:25</nova:creationTime>
Aug 26 23:16:27 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:16:27 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:16:27 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:16:27 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:16:27 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:16:27 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:16:27 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:16:27 user nova-compute[73497]:       <nova:owner>
Aug 26 23:16:27 user nova-compute[73497]:         <nova:user uuid="83005131fdc2411abe7a198157910743">tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member</nova:user>
Aug 26 23:16:27 user nova-compute[73497]:         <nova:project uuid="3ee8ef1c899342b38a624c1c28309d41">tempest-ServerBootFromVolumeStableRescueTest-1276656289</nova:project>
Aug 26 23:16:27 user nova-compute[73497]:       </nova:owner>
Aug 26 23:16:27 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:16:27 user nova-compute[73497]:       <nova:ports>
Aug 26 23:16:27 user nova-compute[73497]:         <nova:port uuid="2fdb126c-c800-488a-9879-08a65e646325">
Aug 26 23:16:27 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 23:16:27 user nova-compute[73497]:         </nova:port>
Aug 26 23:16:27 user nova-compute[73497]:       </nova:ports>
Aug 26 23:16:27 user nova-compute[73497]:     </nova:instance>
Aug 26 23:16:27 user nova-compute[73497]:   </metadata>
Aug 26 23:16:27 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:16:27 user nova-compute[73497]:     <system>
Aug 26 23:16:27 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:16:27 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:16:27 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:16:27 user nova-compute[73497]:       <entry name="serial">aebaeda6-23d1-43a1-afc8-bdc8992067e5</entry>
Aug 26 23:16:27 user nova-compute[73497]:       <entry name="uuid">aebaeda6-23d1-43a1-afc8-bdc8992067e5</entry>
Aug 26 23:16:27 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:16:27 user nova-compute[73497]:     </system>
Aug 26 23:16:27 user nova-compute[73497]:   </sysinfo>
Aug 26 23:16:27 user nova-compute[73497]:   <os>
Aug 26 23:16:27 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:16:27 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:16:27 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:16:27 user nova-compute[73497]:   </os>
Aug 26 23:16:27 user nova-compute[73497]:   <features>
Aug 26 23:16:27 user nova-compute[73497]:     <acpi/>
Aug 26 23:16:27 user nova-compute[73497]:     <apic/>
Aug 26 23:16:27 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:16:27 user nova-compute[73497]:   </features>
Aug 26 23:16:27 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:16:27 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:16:27 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:16:27 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:16:27 user nova-compute[73497]:   </clock>
Aug 26 23:16:27 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:16:27 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:16:27 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:16:27 user nova-compute[73497]:   </cpu>
Aug 26 23:16:27 user nova-compute[73497]:   <devices>
Aug 26 23:16:27 user nova-compute[73497]:     <disk type="block" device="disk">
Aug 26 23:16:27 user nova-compute[73497]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:16:27 user nova-compute[73497]:       <source dev="/dev/sdc"/>
Aug 26 23:16:27 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:16:27 user nova-compute[73497]:       <serial>8c797b7d-2462-4a35-9c56-b07c78e085d2</serial>
Aug 26 23:16:27 user nova-compute[73497]:     </disk>
Aug 26 23:16:27 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:16:27 user nova-compute[73497]:       <mac address="fa:16:3e:e0:28:c4"/>
Aug 26 23:16:27 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:16:27 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:16:27 user nova-compute[73497]:       <target dev="tap2fdb126c-c8"/>
Aug 26 23:16:27 user nova-compute[73497]:     </interface>
Aug 26 23:16:27 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:16:27 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/aebaeda6-23d1-43a1-afc8-bdc8992067e5/console.log" append="off"/>
Aug 26 23:16:27 user nova-compute[73497]:     </serial>
Aug 26 23:16:27 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:16:27 user nova-compute[73497]:     <video>
Aug 26 23:16:27 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:16:27 user nova-compute[73497]:     </video>
Aug 26 23:16:27 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:16:27 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:16:27 user nova-compute[73497]:     </rng>
Aug 26 23:16:27 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:16:27 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:16:27 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:16:27 user nova-compute[73497]:     </memballoon>
Aug 26 23:16:27 user nova-compute[73497]:   </devices>
Aug 26 23:16:27 user nova-compute[73497]: </domain>
Aug 26 23:16:27 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1490878168',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1490878168',id=12,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ee8ef1c899342b38a624c1c28309d41',ramdisk_id='',reservation_id='r-92y3pmcv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1276656289',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:15:58Z,user_data=None,user_id='83005131fdc2411abe7a198157910743',uuid=aebaeda6-23d1-43a1-afc8-bdc8992067e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2fdb126c-c800-488a-9879-08a65e646325", "address": "fa:16:3e:e0:28:c4", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fdb126c-c8", "ovs_interfaceid": "2fdb126c-c800-488a-9879-08a65e646325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Converting VIF {"id": "2fdb126c-c800-488a-9879-08a65e646325", "address": "fa:16:3e:e0:28:c4", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fdb126c-c8", "ovs_interfaceid": "2fdb126c-c800-488a-9879-08a65e646325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:28:c4,bridge_name='br-int',has_traffic_filtering=True,id=2fdb126c-c800-488a-9879-08a65e646325,network=Network(f8ba0a6b-e4fc-4236-9df3-90ffab8824fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fdb126c-c8') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG os_vif [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:28:c4,bridge_name='br-int',has_traffic_filtering=True,id=2fdb126c-c800-488a-9879-08a65e646325,network=Network(f8ba0a6b-e4fc-4236-9df3-90ffab8824fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fdb126c-c8') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2fdb126c-c8, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2fdb126c-c8, col_values=(('external_ids', {'iface-id': '2fdb126c-c800-488a-9879-08a65e646325', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:28:c4', 'vm-uuid': 'aebaeda6-23d1-43a1-afc8-bdc8992067e5'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:27 user nova-compute[73497]: INFO os_vif [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:28:c4,bridge_name='br-int',has_traffic_filtering=True,id=2fdb126c-c800-488a-9879-08a65e646325,network=Network(f8ba0a6b-e4fc-4236-9df3-90ffab8824fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fdb126c-c8')
Aug 26 23:16:27 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] No VIF found with MAC fa:16:3e:e0:28:c4, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.508s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG nova.compute.manager [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG nova.compute.manager [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG nova.network.neutron [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:16:27 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:16:27 user nova-compute[73497]: DEBUG nova.compute.manager [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG nova.policy [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76e923deac454ba09eb85819527eb108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546cdb5907fc494c94ea81cfcef71a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG nova.compute.manager [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:16:27 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Creating image(s)
Aug 26 23:16:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Acquiring lock "/opt/stack/data/nova/instances/a19ccf77-8c30-44af-bd19-9b879fa60942/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "/opt/stack/data/nova/instances/a19ccf77-8c30-44af-bd19-9b879fa60942/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "/opt/stack/data/nova/instances/a19ccf77-8c30-44af-bd19-9b879fa60942/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.188s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.213s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/a19ccf77-8c30-44af-bd19-9b879fa60942/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/a19ccf77-8c30-44af-bd19-9b879fa60942/disk 1073741824" returned: 0 in 0.066s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:28 user nova-compute[73497]: DEBUG nova.network.neutron [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Successfully created port: 4d4d1845-f715-4bc2-a00a-9ac1fc39da48 {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:16:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.186s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:28 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a19ccf77-8c30-44af-bd19-9b879fa60942/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:16:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19ccf77-8c30-44af-bd19-9b879fa60942/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19ccf77-8c30-44af-bd19-9b879fa60942/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:28 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Cannot resize image /opt/stack/data/nova/instances/a19ccf77-8c30-44af-bd19-9b879fa60942/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:16:28 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:16:28 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Ensure instance console log exists: /opt/stack/data/nova/instances/a19ccf77-8c30-44af-bd19-9b879fa60942/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:16:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG nova.network.neutron [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Successfully updated port: 4d4d1845-f715-4bc2-a00a-9ac1fc39da48 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Acquiring lock "refresh_cache-a19ccf77-8c30-44af-bd19-9b879fa60942" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Acquired lock "refresh_cache-a19ccf77-8c30-44af-bd19-9b879fa60942" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG nova.network.neutron [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG nova.compute.manager [req-1819fcd9-f150-45f1-aa14-62677aa59527 req-9ab07513-6343-4825-a271-0143d96e9fcb service nova] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Received event network-changed-4d4d1845-f715-4bc2-a00a-9ac1fc39da48 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG nova.compute.manager [req-1819fcd9-f150-45f1-aa14-62677aa59527 req-9ab07513-6343-4825-a271-0143d96e9fcb service nova] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Refreshing instance network info cache due to event network-changed-4d4d1845-f715-4bc2-a00a-9ac1fc39da48. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1819fcd9-f150-45f1-aa14-62677aa59527 req-9ab07513-6343-4825-a271-0143d96e9fcb service nova] Acquiring lock "refresh_cache-a19ccf77-8c30-44af-bd19-9b879fa60942" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG nova.network.neutron [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG nova.network.neutron [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Updating instance_info_cache with network_info: [{"id": "4d4d1845-f715-4bc2-a00a-9ac1fc39da48", "address": "fa:16:3e:a9:12:c2", "network": {"id": "4eb3bf86-7f68-4a81-90f9-f34da6231d59", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-299898849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "546cdb5907fc494c94ea81cfcef71a28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d4d1845-f7", "ovs_interfaceid": "4d4d1845-f715-4bc2-a00a-9ac1fc39da48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Releasing lock "refresh_cache-a19ccf77-8c30-44af-bd19-9b879fa60942" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG nova.compute.manager [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Instance network_info: |[{"id": "4d4d1845-f715-4bc2-a00a-9ac1fc39da48", "address": "fa:16:3e:a9:12:c2", "network": {"id": "4eb3bf86-7f68-4a81-90f9-f34da6231d59", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-299898849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "546cdb5907fc494c94ea81cfcef71a28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d4d1845-f7", "ovs_interfaceid": "4d4d1845-f715-4bc2-a00a-9ac1fc39da48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1819fcd9-f150-45f1-aa14-62677aa59527 req-9ab07513-6343-4825-a271-0143d96e9fcb service nova] Acquired lock "refresh_cache-a19ccf77-8c30-44af-bd19-9b879fa60942" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG nova.network.neutron [req-1819fcd9-f150-45f1-aa14-62677aa59527 req-9ab07513-6343-4825-a271-0143d96e9fcb service nova] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Refreshing network info cache for port 4d4d1845-f715-4bc2-a00a-9ac1fc39da48 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Start _get_guest_xml network_info=[{"id": "4d4d1845-f715-4bc2-a00a-9ac1fc39da48", "address": "fa:16:3e:a9:12:c2", "network": {"id": "4eb3bf86-7f68-4a81-90f9-f34da6231d59", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-299898849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "546cdb5907fc494c94ea81cfcef71a28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d4d1845-f7", "ovs_interfaceid": "4d4d1845-f715-4bc2-a00a-9ac1fc39da48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:16:29 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:16:29 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:16:29 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1431036640',display_name='tempest-VolumesAdminNegativeTest-server-1431036640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1431036640',id=14,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='546cdb5907fc494c94ea81cfcef71a28',ramdisk_id='',reservation_id='r-02rxs202',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1932002621',owner_user_name='tempest-VolumesAdminNegativeTest-1932002621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:16:28Z,user_data=None,user_id='76e923deac454ba09eb85819527eb108',uuid=a19ccf77-8c30-44af-bd19-9b879fa60942,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d4d1845-f715-4bc2-a00a-9ac1fc39da48", "address": "fa:16:3e:a9:12:c2", "network": {"id": "4eb3bf86-7f68-4a81-90f9-f34da6231d59", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-299898849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "546cdb5907fc494c94ea81cfcef71a28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d4d1845-f7", "ovs_interfaceid": "4d4d1845-f715-4bc2-a00a-9ac1fc39da48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Converting VIF {"id": "4d4d1845-f715-4bc2-a00a-9ac1fc39da48", "address": "fa:16:3e:a9:12:c2", "network": {"id": "4eb3bf86-7f68-4a81-90f9-f34da6231d59", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-299898849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "546cdb5907fc494c94ea81cfcef71a28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d4d1845-f7", "ovs_interfaceid": "4d4d1845-f715-4bc2-a00a-9ac1fc39da48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:12:c2,bridge_name='br-int',has_traffic_filtering=True,id=4d4d1845-f715-4bc2-a00a-9ac1fc39da48,network=Network(4eb3bf86-7f68-4a81-90f9-f34da6231d59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d4d1845-f7') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG nova.objects.instance [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lazy-loading 'pci_devices' on Instance uuid a19ccf77-8c30-44af-bd19-9b879fa60942 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:16:29 user nova-compute[73497]:   <uuid>a19ccf77-8c30-44af-bd19-9b879fa60942</uuid>
Aug 26 23:16:29 user nova-compute[73497]:   <name>instance-0000000e</name>
Aug 26 23:16:29 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:16:29 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:16:29 user nova-compute[73497]:   <metadata>
Aug 26 23:16:29 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:16:29 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:16:29 user nova-compute[73497]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1431036640</nova:name>
Aug 26 23:16:29 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:16:29</nova:creationTime>
Aug 26 23:16:29 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:16:29 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:16:29 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:16:29 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:16:29 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:16:29 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:16:29 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:16:29 user nova-compute[73497]:       <nova:owner>
Aug 26 23:16:29 user nova-compute[73497]:         <nova:user uuid="76e923deac454ba09eb85819527eb108">tempest-VolumesAdminNegativeTest-1932002621-project-member</nova:user>
Aug 26 23:16:29 user nova-compute[73497]:         <nova:project uuid="546cdb5907fc494c94ea81cfcef71a28">tempest-VolumesAdminNegativeTest-1932002621</nova:project>
Aug 26 23:16:29 user nova-compute[73497]:       </nova:owner>
Aug 26 23:16:29 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:16:29 user nova-compute[73497]:       <nova:ports>
Aug 26 23:16:29 user nova-compute[73497]:         <nova:port uuid="4d4d1845-f715-4bc2-a00a-9ac1fc39da48">
Aug 26 23:16:29 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 23:16:29 user nova-compute[73497]:         </nova:port>
Aug 26 23:16:29 user nova-compute[73497]:       </nova:ports>
Aug 26 23:16:29 user nova-compute[73497]:     </nova:instance>
Aug 26 23:16:29 user nova-compute[73497]:   </metadata>
Aug 26 23:16:29 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:16:29 user nova-compute[73497]:     <system>
Aug 26 23:16:29 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:16:29 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:16:29 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:16:29 user nova-compute[73497]:       <entry name="serial">a19ccf77-8c30-44af-bd19-9b879fa60942</entry>
Aug 26 23:16:29 user nova-compute[73497]:       <entry name="uuid">a19ccf77-8c30-44af-bd19-9b879fa60942</entry>
Aug 26 23:16:29 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:16:29 user nova-compute[73497]:     </system>
Aug 26 23:16:29 user nova-compute[73497]:   </sysinfo>
Aug 26 23:16:29 user nova-compute[73497]:   <os>
Aug 26 23:16:29 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:16:29 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:16:29 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:16:29 user nova-compute[73497]:   </os>
Aug 26 23:16:29 user nova-compute[73497]:   <features>
Aug 26 23:16:29 user nova-compute[73497]:     <acpi/>
Aug 26 23:16:29 user nova-compute[73497]:     <apic/>
Aug 26 23:16:29 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:16:29 user nova-compute[73497]:   </features>
Aug 26 23:16:29 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:16:29 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:16:29 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:16:29 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:16:29 user nova-compute[73497]:   </clock>
Aug 26 23:16:29 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:16:29 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:16:29 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:16:29 user nova-compute[73497]:   </cpu>
Aug 26 23:16:29 user nova-compute[73497]:   <devices>
Aug 26 23:16:29 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:16:29 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:16:29 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/a19ccf77-8c30-44af-bd19-9b879fa60942/disk"/>
Aug 26 23:16:29 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:16:29 user nova-compute[73497]:     </disk>
Aug 26 23:16:29 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:16:29 user nova-compute[73497]:       <mac address="fa:16:3e:a9:12:c2"/>
Aug 26 23:16:29 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:16:29 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:16:29 user nova-compute[73497]:       <target dev="tap4d4d1845-f7"/>
Aug 26 23:16:29 user nova-compute[73497]:     </interface>
Aug 26 23:16:29 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:16:29 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/a19ccf77-8c30-44af-bd19-9b879fa60942/console.log" append="off"/>
Aug 26 23:16:29 user nova-compute[73497]:     </serial>
Aug 26 23:16:29 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:16:29 user nova-compute[73497]:     <video>
Aug 26 23:16:29 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:16:29 user nova-compute[73497]:     </video>
Aug 26 23:16:29 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:16:29 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:16:29 user nova-compute[73497]:     </rng>
Aug 26 23:16:29 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:16:29 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:16:29 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:16:29 user nova-compute[73497]:     </memballoon>
Aug 26 23:16:29 user nova-compute[73497]:   </devices>
Aug 26 23:16:29 user nova-compute[73497]: </domain>
Aug 26 23:16:29 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1431036640',display_name='tempest-VolumesAdminNegativeTest-server-1431036640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1431036640',id=14,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='546cdb5907fc494c94ea81cfcef71a28',ramdisk_id='',reservation_id='r-02rxs202',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1932002621',owner_user_name='tempest-VolumesAdminNegativeTest-1932002621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:16:28Z,user_data=None,user_id='76e923deac454ba09eb85819527eb108',uuid=a19ccf77-8c30-44af-bd19-9b879fa60942,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d4d1845-f715-4bc2-a00a-9ac1fc39da48", "address": "fa:16:3e:a9:12:c2", "network": {"id": "4eb3bf86-7f68-4a81-90f9-f34da6231d59", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-299898849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "546cdb5907fc494c94ea81cfcef71a28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d4d1845-f7", "ovs_interfaceid": "4d4d1845-f715-4bc2-a00a-9ac1fc39da48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Converting VIF {"id": "4d4d1845-f715-4bc2-a00a-9ac1fc39da48", "address": "fa:16:3e:a9:12:c2", "network": {"id": "4eb3bf86-7f68-4a81-90f9-f34da6231d59", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-299898849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "546cdb5907fc494c94ea81cfcef71a28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d4d1845-f7", "ovs_interfaceid": "4d4d1845-f715-4bc2-a00a-9ac1fc39da48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:12:c2,bridge_name='br-int',has_traffic_filtering=True,id=4d4d1845-f715-4bc2-a00a-9ac1fc39da48,network=Network(4eb3bf86-7f68-4a81-90f9-f34da6231d59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d4d1845-f7') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG os_vif [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:12:c2,bridge_name='br-int',has_traffic_filtering=True,id=4d4d1845-f715-4bc2-a00a-9ac1fc39da48,network=Network(4eb3bf86-7f68-4a81-90f9-f34da6231d59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d4d1845-f7') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d4d1845-f7, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4d4d1845-f7, col_values=(('external_ids', {'iface-id': '4d4d1845-f715-4bc2-a00a-9ac1fc39da48', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:12:c2', 'vm-uuid': 'a19ccf77-8c30-44af-bd19-9b879fa60942'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:16:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:29 user nova-compute[73497]: INFO os_vif [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:12:c2,bridge_name='br-int',has_traffic_filtering=True,id=4d4d1845-f715-4bc2-a00a-9ac1fc39da48,network=Network(4eb3bf86-7f68-4a81-90f9-f34da6231d59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d4d1845-f7')
Aug 26 23:16:30 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:16:30 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] No VIF found with MAC fa:16:3e:a9:12:c2, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:16:30 user nova-compute[73497]: DEBUG nova.network.neutron [req-1819fcd9-f150-45f1-aa14-62677aa59527 req-9ab07513-6343-4825-a271-0143d96e9fcb service nova] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Updated VIF entry in instance network info cache for port 4d4d1845-f715-4bc2-a00a-9ac1fc39da48. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:16:30 user nova-compute[73497]: DEBUG nova.network.neutron [req-1819fcd9-f150-45f1-aa14-62677aa59527 req-9ab07513-6343-4825-a271-0143d96e9fcb service nova] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Updating instance_info_cache with network_info: [{"id": "4d4d1845-f715-4bc2-a00a-9ac1fc39da48", "address": "fa:16:3e:a9:12:c2", "network": {"id": "4eb3bf86-7f68-4a81-90f9-f34da6231d59", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-299898849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "546cdb5907fc494c94ea81cfcef71a28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d4d1845-f7", "ovs_interfaceid": "4d4d1845-f715-4bc2-a00a-9ac1fc39da48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:16:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1819fcd9-f150-45f1-aa14-62677aa59527 req-9ab07513-6343-4825-a271-0143d96e9fcb service nova] Releasing lock "refresh_cache-a19ccf77-8c30-44af-bd19-9b879fa60942" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:16:31 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Creating image(s)
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Did not create local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Ensure instance console log exists: /opt/stack/data/nova/instances/62f841d2-09e7-448b-8c1c-26c824c473ba/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Start _get_guest_xml network_info=[{"id": "ea0c8f3c-1937-4d8c-968a-21a620ff5f7d", "address": "fa:16:3e:34:77:60", "network": {"id": "52dfb1fe-f560-4f40-8594-3b13d3ff06d9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2040079808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a6bf8d596b4695a60e15661fd18352", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0c8f3c-19", "ovs_interfaceid": "ea0c8f3c-1937-4d8c-968a-21a620ff5f7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '204ff587-967c-4573-a1ec-a5cd920e0c9a', 'guest_format': None, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ONHTIbKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '62f841d2-09e7-448b-8c1c-26c824c473ba', 'attached_at': '', 'detached_at': '', 'volume_id': '2fb2814e-8af9-455e-aaba-faa885d49a3a', 'serial': '2fb2814e-8af9-455e-aaba-faa885d49a3a'}, 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:16:31 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 23:16:31 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.objects.instance [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Lazy-loading 'vcpu_model' on Instance uuid 62f841d2-09e7-448b-8c1c-26c824c473ba {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ONHTIbKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:16:31 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 23:16:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:16:31 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 23:16:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:16:31 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7dcc91-5fd9-4d5c-8479-76b50d98c3e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:16:31 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef519d9-364e-4e98-9e20-7edb29c4f942]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a] added
Aug 26 23:16:31 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d42b1c-ac67-442a-b663-4b79e0cf2b06]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c189e9c-077c-4671-90a7-7a4c039cd81a]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ONHTIbKk {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ONHTIbKk" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea917b4-9a09-4959-b12f-6ec153f00a91]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ONHTIbKk'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b19b345-22f4-4cb7-9ca8-f9b179941f5a]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[666b409e-5fb2-4d33-939e-15838c30341d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:16:31 user nova-compute[73497]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a (non-flash)
Aug 26 23:16:31 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:16:31 user nova-compute[73497]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a (non-flash)
Aug 26 23:16:31 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.compute.manager [req-0f135e77-9e95-4de8-8645-6f3489877301 req-09006b37-12a2-42bc-9b37-420a4d2ead48 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Received event network-vif-plugged-2fdb126c-c800-488a-9879-08a65e646325 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0f135e77-9e95-4de8-8645-6f3489877301 req-09006b37-12a2-42bc-9b37-420a4d2ead48 service nova] Acquiring lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0f135e77-9e95-4de8-8645-6f3489877301 req-09006b37-12a2-42bc-9b37-420a4d2ead48 service nova] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0f135e77-9e95-4de8-8645-6f3489877301 req-09006b37-12a2-42bc-9b37-420a4d2ead48 service nova] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.compute.manager [req-0f135e77-9e95-4de8-8645-6f3489877301 req-09006b37-12a2-42bc-9b37-420a4d2ead48 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] No waiting events found dispatching network-vif-plugged-2fdb126c-c800-488a-9879-08a65e646325 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:16:31 user nova-compute[73497]: WARNING nova.compute.manager [req-0f135e77-9e95-4de8-8645-6f3489877301 req-09006b37-12a2-42bc-9b37-420a4d2ead48 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Received unexpected event network-vif-plugged-2fdb126c-c800-488a-9879-08a65e646325 for instance with vm_state building and task_state spawning.
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.compute.manager [req-0f135e77-9e95-4de8-8645-6f3489877301 req-09006b37-12a2-42bc-9b37-420a4d2ead48 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Received event network-vif-plugged-2fdb126c-c800-488a-9879-08a65e646325 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0f135e77-9e95-4de8-8645-6f3489877301 req-09006b37-12a2-42bc-9b37-420a4d2ead48 service nova] Acquiring lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0f135e77-9e95-4de8-8645-6f3489877301 req-09006b37-12a2-42bc-9b37-420a4d2ead48 service nova] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0f135e77-9e95-4de8-8645-6f3489877301 req-09006b37-12a2-42bc-9b37-420a4d2ead48 service nova] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.compute.manager [req-0f135e77-9e95-4de8-8645-6f3489877301 req-09006b37-12a2-42bc-9b37-420a4d2ead48 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] No waiting events found dispatching network-vif-plugged-2fdb126c-c800-488a-9879-08a65e646325 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:16:31 user nova-compute[73497]: WARNING nova.compute.manager [req-0f135e77-9e95-4de8-8645-6f3489877301 req-09006b37-12a2-42bc-9b37-420a4d2ead48 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Received unexpected event network-vif-plugged-2fdb126c-c800-488a-9879-08a65e646325 for instance with vm_state building and task_state spawning.
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fe490e-fa24-4169-b779-e6cb2557fc3c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a, portal: 172.16.0.220,3260]
Aug 26 23:16:31 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a, portal: 172.16.0.220,3260] successful.
Aug 26 23:16:31 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfce34d-ecc7-44ad-884b-95227a61c8a3]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9adae21b-a290-47d8-90b7-c4b55e3d5428]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:16:31 user nova-compute[73497]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:16:31 user nova-compute[73497]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a (non-flash)
Aug 26 23:16:31 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:16:31 user nova-compute[73497]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:16:31 user nova-compute[73497]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a (non-flash)
Aug 26 23:16:31 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] HCTL ('35', '-', '-', 0) found on session 12 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[07eca567-699a-43f7-98c1-ed86efea42af]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Searching for a device in session 12 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ONHTIbKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091791.4502969, aebaeda6-23d1-43a1-afc8-bdc8992067e5 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:16:31 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] VM Resumed (Lifecycle Event)
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.compute.manager [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:16:31 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Instance spawned successfully.
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:16:31 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091791.4504144, aebaeda6-23d1-43a1-afc8-bdc8992067e5 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:16:31 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] VM Started (Lifecycle Event)
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:16:31 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:16:31 user nova-compute[73497]: INFO nova.compute.manager [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Took 5.99 seconds to spawn the instance on the hypervisor.
Aug 26 23:16:31 user nova-compute[73497]: DEBUG nova.compute.manager [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:16:31 user nova-compute[73497]: INFO nova.compute.manager [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Took 34.32 seconds to build instance.
Aug 26 23:16:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-cd763a81-fd39-484e-ae46-30b8d8e45724 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.814s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:16:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23239343032323433', 'path': '/dev/sdd'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:16:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239343032323433', 'path': '/dev/sdd'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:16:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T23:13:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-766701757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-474747102',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByjF8J1FTf4Yf+f0bhNilYywxbVc7jA9buhoEIOCxGzdOlcDHyYAz+iC83msNEYmiVpBnhhT5cv+65/WSDDw63y6W9k4x8IST6h+KDUrN39XmHZzLFbe/p/7dgfn+8+iA==',key_name='tempest-keypair-1496592320',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:14:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='02a6bf8d596b4695a60e15661fd18352',ramdisk_id='',reservation_id='r-lyo5f7oa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1814198428',owner_user_name='tempest-ServerActionsV293TestJSON-1814198428-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:16:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c6bce6dad6f4c1092286fa122e6ed74',uuid=62f841d2-09e7-448b-8c1c-26c824c473ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea0c8f3c-1937-4d8c-968a-21a620ff5f7d", "address": "fa:16:3e:34:77:60", "network": {"id": "52dfb1fe-f560-4f40-8594-3b13d3ff06d9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2040079808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a6bf8d596b4695a60e15661fd18352", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0c8f3c-19", "ovs_interfaceid": "ea0c8f3c-1937-4d8c-968a-21a620ff5f7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:16:32 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Converting VIF {"id": "ea0c8f3c-1937-4d8c-968a-21a620ff5f7d", "address": "fa:16:3e:34:77:60", "network": {"id": "52dfb1fe-f560-4f40-8594-3b13d3ff06d9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2040079808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a6bf8d596b4695a60e15661fd18352", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0c8f3c-19", "ovs_interfaceid": "ea0c8f3c-1937-4d8c-968a-21a620ff5f7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:16:32 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:77:60,bridge_name='br-int',has_traffic_filtering=True,id=ea0c8f3c-1937-4d8c-968a-21a620ff5f7d,network=Network(52dfb1fe-f560-4f40-8594-3b13d3ff06d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0c8f3c-19') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:16:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:16:32 user nova-compute[73497]:   <uuid>62f841d2-09e7-448b-8c1c-26c824c473ba</uuid>
Aug 26 23:16:32 user nova-compute[73497]:   <name>instance-0000000a</name>
Aug 26 23:16:32 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:16:32 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:16:32 user nova-compute[73497]:   <metadata>
Aug 26 23:16:32 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:16:32 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:16:32 user nova-compute[73497]:       <nova:name>tempest-ServerActionsV293TestJSON-server-766701757</nova:name>
Aug 26 23:16:32 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:16:31</nova:creationTime>
Aug 26 23:16:32 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:16:32 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:16:32 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:16:32 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:16:32 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:16:32 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:16:32 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:16:32 user nova-compute[73497]:       <nova:owner>
Aug 26 23:16:32 user nova-compute[73497]:         <nova:user uuid="0c6bce6dad6f4c1092286fa122e6ed74">tempest-ServerActionsV293TestJSON-1814198428-project-member</nova:user>
Aug 26 23:16:32 user nova-compute[73497]:         <nova:project uuid="02a6bf8d596b4695a60e15661fd18352">tempest-ServerActionsV293TestJSON-1814198428</nova:project>
Aug 26 23:16:32 user nova-compute[73497]:       </nova:owner>
Aug 26 23:16:32 user nova-compute[73497]:       <nova:ports>
Aug 26 23:16:32 user nova-compute[73497]:         <nova:port uuid="ea0c8f3c-1937-4d8c-968a-21a620ff5f7d">
Aug 26 23:16:32 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 23:16:32 user nova-compute[73497]:         </nova:port>
Aug 26 23:16:32 user nova-compute[73497]:       </nova:ports>
Aug 26 23:16:32 user nova-compute[73497]:     </nova:instance>
Aug 26 23:16:32 user nova-compute[73497]:   </metadata>
Aug 26 23:16:32 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:16:32 user nova-compute[73497]:     <system>
Aug 26 23:16:32 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:16:32 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:16:32 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:16:32 user nova-compute[73497]:       <entry name="serial">62f841d2-09e7-448b-8c1c-26c824c473ba</entry>
Aug 26 23:16:32 user nova-compute[73497]:       <entry name="uuid">62f841d2-09e7-448b-8c1c-26c824c473ba</entry>
Aug 26 23:16:32 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:16:32 user nova-compute[73497]:     </system>
Aug 26 23:16:32 user nova-compute[73497]:   </sysinfo>
Aug 26 23:16:32 user nova-compute[73497]:   <os>
Aug 26 23:16:32 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:16:32 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:16:32 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:16:32 user nova-compute[73497]:   </os>
Aug 26 23:16:32 user nova-compute[73497]:   <features>
Aug 26 23:16:32 user nova-compute[73497]:     <acpi/>
Aug 26 23:16:32 user nova-compute[73497]:     <apic/>
Aug 26 23:16:32 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:16:32 user nova-compute[73497]:   </features>
Aug 26 23:16:32 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:16:32 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:16:32 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:16:32 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:16:32 user nova-compute[73497]:   </clock>
Aug 26 23:16:32 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:16:32 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:16:32 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:16:32 user nova-compute[73497]:   </cpu>
Aug 26 23:16:32 user nova-compute[73497]:   <devices>
Aug 26 23:16:32 user nova-compute[73497]:     <disk type="block" device="disk">
Aug 26 23:16:32 user nova-compute[73497]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:16:32 user nova-compute[73497]:       <source dev="/dev/sdd"/>
Aug 26 23:16:32 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:16:32 user nova-compute[73497]:       <serial>2fb2814e-8af9-455e-aaba-faa885d49a3a</serial>
Aug 26 23:16:32 user nova-compute[73497]:     </disk>
Aug 26 23:16:32 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:16:32 user nova-compute[73497]:       <mac address="fa:16:3e:34:77:60"/>
Aug 26 23:16:32 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:16:32 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:16:32 user nova-compute[73497]:       <target dev="tapea0c8f3c-19"/>
Aug 26 23:16:32 user nova-compute[73497]:     </interface>
Aug 26 23:16:32 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:16:32 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/62f841d2-09e7-448b-8c1c-26c824c473ba/console.log" append="off"/>
Aug 26 23:16:32 user nova-compute[73497]:     </serial>
Aug 26 23:16:32 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:16:32 user nova-compute[73497]:     <video>
Aug 26 23:16:32 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:16:32 user nova-compute[73497]:     </video>
Aug 26 23:16:32 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:16:32 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:16:32 user nova-compute[73497]:     </rng>
Aug 26 23:16:32 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:16:32 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:16:32 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:16:32 user nova-compute[73497]:     </memballoon>
Aug 26 23:16:32 user nova-compute[73497]:   </devices>
Aug 26 23:16:32 user nova-compute[73497]: </domain>
Aug 26 23:16:32 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:16:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T23:13:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-766701757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-474747102',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByjF8J1FTf4Yf+f0bhNilYywxbVc7jA9buhoEIOCxGzdOlcDHyYAz+iC83msNEYmiVpBnhhT5cv+65/WSDDw63y6W9k4x8IST6h+KDUrN39XmHZzLFbe/p/7dgfn+8+iA==',key_name='tempest-keypair-1496592320',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:14:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='02a6bf8d596b4695a60e15661fd18352',ramdisk_id='',reservation_id='r-lyo5f7oa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1814198428',owner_user_name='tempest-ServerActionsV293TestJSON-1814198428-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:16:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c6bce6dad6f4c1092286fa122e6ed74',uuid=62f841d2-09e7-448b-8c1c-26c824c473ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea0c8f3c-1937-4d8c-968a-21a620ff5f7d", "address": "fa:16:3e:34:77:60", "network": {"id": "52dfb1fe-f560-4f40-8594-3b13d3ff06d9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2040079808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a6bf8d596b4695a60e15661fd18352", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0c8f3c-19", "ovs_interfaceid": "ea0c8f3c-1937-4d8c-968a-21a620ff5f7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:16:32 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Converting VIF {"id": "ea0c8f3c-1937-4d8c-968a-21a620ff5f7d", "address": "fa:16:3e:34:77:60", "network": {"id": "52dfb1fe-f560-4f40-8594-3b13d3ff06d9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2040079808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a6bf8d596b4695a60e15661fd18352", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0c8f3c-19", "ovs_interfaceid": "ea0c8f3c-1937-4d8c-968a-21a620ff5f7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:16:32 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:77:60,bridge_name='br-int',has_traffic_filtering=True,id=ea0c8f3c-1937-4d8c-968a-21a620ff5f7d,network=Network(52dfb1fe-f560-4f40-8594-3b13d3ff06d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0c8f3c-19') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:16:32 user nova-compute[73497]: DEBUG os_vif [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:77:60,bridge_name='br-int',has_traffic_filtering=True,id=ea0c8f3c-1937-4d8c-968a-21a620ff5f7d,network=Network(52dfb1fe-f560-4f40-8594-3b13d3ff06d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0c8f3c-19') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:16:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:16:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:16:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea0c8f3c-19, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:16:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapea0c8f3c-19, col_values=(('external_ids', {'iface-id': 'ea0c8f3c-1937-4d8c-968a-21a620ff5f7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:77:60', 'vm-uuid': '62f841d2-09e7-448b-8c1c-26c824c473ba'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:16:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:16:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:32 user nova-compute[73497]: INFO os_vif [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:77:60,bridge_name='br-int',has_traffic_filtering=True,id=ea0c8f3c-1937-4d8c-968a-21a620ff5f7d,network=Network(52dfb1fe-f560-4f40-8594-3b13d3ff06d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0c8f3c-19')
Aug 26 23:16:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:16:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] No VIF found with MAC fa:16:3e:34:77:60, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:16:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-11c08c03-ea8a-484f-b589-978dc618fa57 req-9b56a0f0-ed1f-4858-bc54-8b5d53a91666 service nova] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Received event network-vif-plugged-4d4d1845-f715-4bc2-a00a-9ac1fc39da48 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:16:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-11c08c03-ea8a-484f-b589-978dc618fa57 req-9b56a0f0-ed1f-4858-bc54-8b5d53a91666 service nova] Acquiring lock "a19ccf77-8c30-44af-bd19-9b879fa60942-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-11c08c03-ea8a-484f-b589-978dc618fa57 req-9b56a0f0-ed1f-4858-bc54-8b5d53a91666 service nova] Lock "a19ccf77-8c30-44af-bd19-9b879fa60942-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-11c08c03-ea8a-484f-b589-978dc618fa57 req-9b56a0f0-ed1f-4858-bc54-8b5d53a91666 service nova] Lock "a19ccf77-8c30-44af-bd19-9b879fa60942-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-11c08c03-ea8a-484f-b589-978dc618fa57 req-9b56a0f0-ed1f-4858-bc54-8b5d53a91666 service nova] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] No waiting events found dispatching network-vif-plugged-4d4d1845-f715-4bc2-a00a-9ac1fc39da48 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:16:33 user nova-compute[73497]: WARNING nova.compute.manager [req-11c08c03-ea8a-484f-b589-978dc618fa57 req-9b56a0f0-ed1f-4858-bc54-8b5d53a91666 service nova] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Received unexpected event network-vif-plugged-4d4d1845-f715-4bc2-a00a-9ac1fc39da48 for instance with vm_state building and task_state spawning.
Aug 26 23:16:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-11c08c03-ea8a-484f-b589-978dc618fa57 req-9b56a0f0-ed1f-4858-bc54-8b5d53a91666 service nova] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Received event network-vif-plugged-4d4d1845-f715-4bc2-a00a-9ac1fc39da48 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:16:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-11c08c03-ea8a-484f-b589-978dc618fa57 req-9b56a0f0-ed1f-4858-bc54-8b5d53a91666 service nova] Acquiring lock "a19ccf77-8c30-44af-bd19-9b879fa60942-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-11c08c03-ea8a-484f-b589-978dc618fa57 req-9b56a0f0-ed1f-4858-bc54-8b5d53a91666 service nova] Lock "a19ccf77-8c30-44af-bd19-9b879fa60942-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-11c08c03-ea8a-484f-b589-978dc618fa57 req-9b56a0f0-ed1f-4858-bc54-8b5d53a91666 service nova] Lock "a19ccf77-8c30-44af-bd19-9b879fa60942-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-11c08c03-ea8a-484f-b589-978dc618fa57 req-9b56a0f0-ed1f-4858-bc54-8b5d53a91666 service nova] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] No waiting events found dispatching network-vif-plugged-4d4d1845-f715-4bc2-a00a-9ac1fc39da48 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:16:33 user nova-compute[73497]: WARNING nova.compute.manager [req-11c08c03-ea8a-484f-b589-978dc618fa57 req-9b56a0f0-ed1f-4858-bc54-8b5d53a91666 service nova] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Received unexpected event network-vif-plugged-4d4d1845-f715-4bc2-a00a-9ac1fc39da48 for instance with vm_state building and task_state spawning.
Aug 26 23:16:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:33 user nova-compute[73497]: DEBUG nova.compute.manager [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:16:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:16:33 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091793.9964514, a19ccf77-8c30-44af-bd19-9b879fa60942 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:16:33 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] VM Resumed (Lifecycle Event)
Aug 26 23:16:34 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Instance spawned successfully.
Aug 26 23:16:34 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:16:34 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:16:34 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:16:34 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:16:34 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:16:34 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:16:34 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:16:34 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:16:34 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:16:34 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:16:34 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091793.9965389, a19ccf77-8c30-44af-bd19-9b879fa60942 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:16:34 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] VM Started (Lifecycle Event)
Aug 26 23:16:34 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:16:34 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:16:34 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:16:34 user nova-compute[73497]: INFO nova.compute.manager [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Took 6.49 seconds to spawn the instance on the hypervisor.
Aug 26 23:16:34 user nova-compute[73497]: DEBUG nova.compute.manager [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:16:34 user nova-compute[73497]: DEBUG nova.compute.manager [req-af8d9840-2d0a-4ace-a636-2e1ed517d0a1 req-0f756db9-ad96-421c-bcc2-e7298efa6ba8 service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Received event network-vif-plugged-ea0c8f3c-1937-4d8c-968a-21a620ff5f7d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:16:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-af8d9840-2d0a-4ace-a636-2e1ed517d0a1 req-0f756db9-ad96-421c-bcc2-e7298efa6ba8 service nova] Acquiring lock "62f841d2-09e7-448b-8c1c-26c824c473ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-af8d9840-2d0a-4ace-a636-2e1ed517d0a1 req-0f756db9-ad96-421c-bcc2-e7298efa6ba8 service nova] Lock "62f841d2-09e7-448b-8c1c-26c824c473ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-af8d9840-2d0a-4ace-a636-2e1ed517d0a1 req-0f756db9-ad96-421c-bcc2-e7298efa6ba8 service nova] Lock "62f841d2-09e7-448b-8c1c-26c824c473ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:34 user nova-compute[73497]: DEBUG nova.compute.manager [req-af8d9840-2d0a-4ace-a636-2e1ed517d0a1 req-0f756db9-ad96-421c-bcc2-e7298efa6ba8 service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] No waiting events found dispatching network-vif-plugged-ea0c8f3c-1937-4d8c-968a-21a620ff5f7d {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:16:34 user nova-compute[73497]: WARNING nova.compute.manager [req-af8d9840-2d0a-4ace-a636-2e1ed517d0a1 req-0f756db9-ad96-421c-bcc2-e7298efa6ba8 service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Received unexpected event network-vif-plugged-ea0c8f3c-1937-4d8c-968a-21a620ff5f7d for instance with vm_state active and task_state rebuild_spawning.
Aug 26 23:16:34 user nova-compute[73497]: INFO nova.compute.manager [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Took 7.41 seconds to build instance.
Aug 26 23:16:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b92eed7e-974a-4e24-a27e-1764b16afb9f tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "a19ccf77-8c30-44af-bd19-9b879fa60942" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.517s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:36 user nova-compute[73497]: DEBUG nova.compute.manager [req-b8949f37-5552-45d6-8394-1af289f2b549 req-3bd599f7-580b-4156-9b89-f2c7e2fdf534 service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Received event network-vif-plugged-ea0c8f3c-1937-4d8c-968a-21a620ff5f7d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:16:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b8949f37-5552-45d6-8394-1af289f2b549 req-3bd599f7-580b-4156-9b89-f2c7e2fdf534 service nova] Acquiring lock "62f841d2-09e7-448b-8c1c-26c824c473ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b8949f37-5552-45d6-8394-1af289f2b549 req-3bd599f7-580b-4156-9b89-f2c7e2fdf534 service nova] Lock "62f841d2-09e7-448b-8c1c-26c824c473ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b8949f37-5552-45d6-8394-1af289f2b549 req-3bd599f7-580b-4156-9b89-f2c7e2fdf534 service nova] Lock "62f841d2-09e7-448b-8c1c-26c824c473ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:36 user nova-compute[73497]: DEBUG nova.compute.manager [req-b8949f37-5552-45d6-8394-1af289f2b549 req-3bd599f7-580b-4156-9b89-f2c7e2fdf534 service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] No waiting events found dispatching network-vif-plugged-ea0c8f3c-1937-4d8c-968a-21a620ff5f7d {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:16:36 user nova-compute[73497]: WARNING nova.compute.manager [req-b8949f37-5552-45d6-8394-1af289f2b549 req-3bd599f7-580b-4156-9b89-f2c7e2fdf534 service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Received unexpected event network-vif-plugged-ea0c8f3c-1937-4d8c-968a-21a620ff5f7d for instance with vm_state active and task_state rebuild_spawning.
Aug 26 23:16:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:36 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091796.4863245, 62f841d2-09e7-448b-8c1c-26c824c473ba => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:16:36 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] VM Resumed (Lifecycle Event)
Aug 26 23:16:36 user nova-compute[73497]: DEBUG nova.compute.manager [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:16:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:16:36 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Instance spawned successfully.
Aug 26 23:16:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:16:36 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:16:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:16:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:16:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:16:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:16:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:16:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:16:36 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:16:36 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 23:16:36 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091796.4869707, 62f841d2-09e7-448b-8c1c-26c824c473ba => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:16:36 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] VM Started (Lifecycle Event)
Aug 26 23:16:36 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:16:36 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:16:36 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 23:16:36 user nova-compute[73497]: DEBUG nova.compute.manager [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:16:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:36 user nova-compute[73497]: DEBUG nova.objects.instance [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73497) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Aug 26 23:16:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d5b34022-6277-4a88-a1a7-2f73756cd8a8 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Acquiring lock "79d00f46-3843-4297-ba47-33557b11d489" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d5b34022-6277-4a88-a1a7-2f73756cd8a8 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Lock "79d00f46-3843-4297-ba47-33557b11d489" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d5b34022-6277-4a88-a1a7-2f73756cd8a8 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Acquiring lock "79d00f46-3843-4297-ba47-33557b11d489-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d5b34022-6277-4a88-a1a7-2f73756cd8a8 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Lock "79d00f46-3843-4297-ba47-33557b11d489-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d5b34022-6277-4a88-a1a7-2f73756cd8a8 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Lock "79d00f46-3843-4297-ba47-33557b11d489-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:36 user nova-compute[73497]: INFO nova.compute.manager [None req-d5b34022-6277-4a88-a1a7-2f73756cd8a8 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Terminating instance
Aug 26 23:16:36 user nova-compute[73497]: DEBUG nova.compute.manager [None req-d5b34022-6277-4a88-a1a7-2f73756cd8a8 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:16:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-caaa5d3f-1484-4961-aa4b-2a455216c544 tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.095s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:37 user nova-compute[73497]: DEBUG nova.compute.manager [req-940cccfb-4c54-468f-bdce-fc1381cfd985 req-c31dd34d-c2c4-4642-b140-e7d78f00facb service nova] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Received event network-vif-unplugged-d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:16:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-940cccfb-4c54-468f-bdce-fc1381cfd985 req-c31dd34d-c2c4-4642-b140-e7d78f00facb service nova] Acquiring lock "79d00f46-3843-4297-ba47-33557b11d489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-940cccfb-4c54-468f-bdce-fc1381cfd985 req-c31dd34d-c2c4-4642-b140-e7d78f00facb service nova] Lock "79d00f46-3843-4297-ba47-33557b11d489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-940cccfb-4c54-468f-bdce-fc1381cfd985 req-c31dd34d-c2c4-4642-b140-e7d78f00facb service nova] Lock "79d00f46-3843-4297-ba47-33557b11d489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:37 user nova-compute[73497]: DEBUG nova.compute.manager [req-940cccfb-4c54-468f-bdce-fc1381cfd985 req-c31dd34d-c2c4-4642-b140-e7d78f00facb service nova] [instance: 79d00f46-3843-4297-ba47-33557b11d489] No waiting events found dispatching network-vif-unplugged-d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:16:37 user nova-compute[73497]: DEBUG nova.compute.manager [req-940cccfb-4c54-468f-bdce-fc1381cfd985 req-c31dd34d-c2c4-4642-b140-e7d78f00facb service nova] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Received event network-vif-unplugged-d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:16:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:37 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Instance destroyed successfully.
Aug 26 23:16:37 user nova-compute[73497]: DEBUG nova.objects.instance [None req-d5b34022-6277-4a88-a1a7-2f73756cd8a8 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Lazy-loading 'resources' on Instance uuid 79d00f46-3843-4297-ba47-33557b11d489 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:16:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-d5b34022-6277-4a88-a1a7-2f73756cd8a8 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:14:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-465188363',display_name='tempest-ServersNegativeTestJSON-server-465188363',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-465188363',id=11,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:14:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7402b17f71d6489c9a419ac0d73abefb',ramdisk_id='',reservation_id='r-yevg8hk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1339597493',owner_user_name='tempest-ServersNegativeTestJSON-1339597493-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:14:56Z,user_data=None,user_id='8c36bef36a3e4edf97f3715472689420',uuid=79d00f46-3843-4297-ba47-33557b11d489,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a", "address": "fa:16:3e:3d:59:dd", "network": {"id": "823997b4-f108-4e9f-807b-2aa2c95f2b09", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-593185584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7402b17f71d6489c9a419ac0d73abefb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e1e0c2-da", "ovs_interfaceid": "d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:16:37 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-d5b34022-6277-4a88-a1a7-2f73756cd8a8 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Converting VIF {"id": "d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a", "address": "fa:16:3e:3d:59:dd", "network": {"id": "823997b4-f108-4e9f-807b-2aa2c95f2b09", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-593185584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7402b17f71d6489c9a419ac0d73abefb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e1e0c2-da", "ovs_interfaceid": "d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:16:37 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-d5b34022-6277-4a88-a1a7-2f73756cd8a8 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:59:dd,bridge_name='br-int',has_traffic_filtering=True,id=d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a,network=Network(823997b4-f108-4e9f-807b-2aa2c95f2b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3e1e0c2-da') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:16:37 user nova-compute[73497]: DEBUG os_vif [None req-d5b34022-6277-4a88-a1a7-2f73756cd8a8 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:59:dd,bridge_name='br-int',has_traffic_filtering=True,id=d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a,network=Network(823997b4-f108-4e9f-807b-2aa2c95f2b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3e1e0c2-da') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:16:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3e1e0c2-da, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:16:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:16:37 user nova-compute[73497]: INFO os_vif [None req-d5b34022-6277-4a88-a1a7-2f73756cd8a8 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:59:dd,bridge_name='br-int',has_traffic_filtering=True,id=d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a,network=Network(823997b4-f108-4e9f-807b-2aa2c95f2b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3e1e0c2-da')
Aug 26 23:16:37 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-d5b34022-6277-4a88-a1a7-2f73756cd8a8 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Deleting instance files /opt/stack/data/nova/instances/79d00f46-3843-4297-ba47-33557b11d489_del
Aug 26 23:16:37 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-d5b34022-6277-4a88-a1a7-2f73756cd8a8 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Deletion of /opt/stack/data/nova/instances/79d00f46-3843-4297-ba47-33557b11d489_del complete
Aug 26 23:16:37 user nova-compute[73497]: INFO nova.compute.manager [None req-d5b34022-6277-4a88-a1a7-2f73756cd8a8 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 26 23:16:37 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-d5b34022-6277-4a88-a1a7-2f73756cd8a8 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:16:37 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:16:37 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 79d00f46-3843-4297-ba47-33557b11d489] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:16:38 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:16:38 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Took 0.59 seconds to deallocate network for instance.
Aug 26 23:16:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d5b34022-6277-4a88-a1a7-2f73756cd8a8 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d5b34022-6277-4a88-a1a7-2f73756cd8a8 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:38 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-d5b34022-6277-4a88-a1a7-2f73756cd8a8 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:16:38 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-d5b34022-6277-4a88-a1a7-2f73756cd8a8 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:16:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d5b34022-6277-4a88-a1a7-2f73756cd8a8 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.452s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:38 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-d5b34022-6277-4a88-a1a7-2f73756cd8a8 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Deleted allocations for instance 79d00f46-3843-4297-ba47-33557b11d489
Aug 26 23:16:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d5b34022-6277-4a88-a1a7-2f73756cd8a8 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Lock "79d00f46-3843-4297-ba47-33557b11d489" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.204s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG nova.compute.manager [req-8b215470-fa66-4e3a-89e2-ce9c168462e8 req-81c5d82c-faa9-44ee-a55a-0a6780762176 service nova] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Received event network-vif-plugged-d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8b215470-fa66-4e3a-89e2-ce9c168462e8 req-81c5d82c-faa9-44ee-a55a-0a6780762176 service nova] Acquiring lock "79d00f46-3843-4297-ba47-33557b11d489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8b215470-fa66-4e3a-89e2-ce9c168462e8 req-81c5d82c-faa9-44ee-a55a-0a6780762176 service nova] Lock "79d00f46-3843-4297-ba47-33557b11d489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8b215470-fa66-4e3a-89e2-ce9c168462e8 req-81c5d82c-faa9-44ee-a55a-0a6780762176 service nova] Lock "79d00f46-3843-4297-ba47-33557b11d489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG nova.compute.manager [req-8b215470-fa66-4e3a-89e2-ce9c168462e8 req-81c5d82c-faa9-44ee-a55a-0a6780762176 service nova] [instance: 79d00f46-3843-4297-ba47-33557b11d489] No waiting events found dispatching network-vif-plugged-d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:16:39 user nova-compute[73497]: WARNING nova.compute.manager [req-8b215470-fa66-4e3a-89e2-ce9c168462e8 req-81c5d82c-faa9-44ee-a55a-0a6780762176 service nova] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Received unexpected event network-vif-plugged-d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a for instance with vm_state deleted and task_state None.
Aug 26 23:16:39 user nova-compute[73497]: DEBUG nova.compute.manager [req-8b215470-fa66-4e3a-89e2-ce9c168462e8 req-81c5d82c-faa9-44ee-a55a-0a6780762176 service nova] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Received event network-vif-deleted-d3e1e0c2-daf5-4e6e-bd6b-8f790b33529a {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lQKeEtSk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ab745e33-a11e-4ee4-a442-1e7893448d27', 'attached_at': '', 'detached_at': '', 'volume_id': '8bbc3abb-c6d3-471c-b47f-e9a43806dfac', 'serial': '8bbc3abb-c6d3-471c-b47f-e9a43806dfac'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wSCatUur', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '4dac4890-c469-48e1-a4df-bef84bc6e46a'}, 'status': 'reserved', 'instance': 'ab745e33-a11e-4ee4-a442-1e7893448d27', 'attached_at': '', 'detached_at': '', 'volume_id': '4dac4890-c469-48e1-a4df-bef84bc6e46a', 'serial'} {{(pid=73497) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lQKeEtSk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:16:39 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:16:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:16:39 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:16:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:16:39 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:16:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0400a819-3e1e-47bb-a04a-f4c3b41fa7ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:16:39 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2777d9-6fd5-4ac1-b7f7-c11ecefccf00]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac] added
Aug 26 23:16:39 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[497fef69-074e-4490-81e6-7252541871c7]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1bf0a9-3111-476f-9987-afe9b2dc8517]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lQKeEtSk {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lQKeEtSk" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6507e85-f97d-4bb4-a268-6467526b32bb]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lQKeEtSk'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[237ec516-ac5f-4c2b-b8de-d7f26bd25895]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e4a582-b763-4d54-bfbe-43a20284fb71]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:16:39 user nova-compute[73497]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:16:39 user nova-compute[73497]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a (non-flash)
Aug 26 23:16:39 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:16:39 user nova-compute[73497]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:16:39 user nova-compute[73497]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a (non-flash)
Aug 26 23:16:39 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f254a47a-a1b6-4c93-8750-cdfde8ad533d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac, portal: 172.16.0.220,3260]
Aug 26 23:16:39 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac, portal: 172.16.0.220,3260] successful.
Aug 26 23:16:39 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa822688-e856-4e37-81d5-6251f0855382]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b847868e-c125-4cbf-b35e-ac2b25708887]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:16:39 user nova-compute[73497]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:16:39 user nova-compute[73497]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)
Aug 26 23:16:39 user nova-compute[73497]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a (non-flash)
Aug 26 23:16:39 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:16:39 user nova-compute[73497]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:16:39 user nova-compute[73497]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)
Aug 26 23:16:39 user nova-compute[73497]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a (non-flash)
Aug 26 23:16:39 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] HCTL ('36', '-', '-', 0) found on session 13 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.028s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5c7eba-9fda-464b-940a-9bdba6f39113]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Searching for a device in session 13 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:16:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lQKeEtSk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:16:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:16:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] <== connect_volume: return (1405ms) {'type': 'block', 'scsi_wwn': '23033303261346634', 'path': '/dev/sde'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:16:40 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033303261346634', 'path': '/dev/sde'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:16:40 user nova-compute[73497]: DEBUG nova.objects.instance [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Lazy-loading 'flavor' on Instance uuid ab745e33-a11e-4ee4-a442-1e7893448d27 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:16:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73497) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 23:16:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-43cb675a-a7ae-496f-886d-8acb10457af7 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Acquiring lock "ba3de574-ae62-4e9d-87f8-434c163d9897" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-43cb675a-a7ae-496f-886d-8acb10457af7 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lock "ba3de574-ae62-4e9d-87f8-434c163d9897" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-43cb675a-a7ae-496f-886d-8acb10457af7 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Acquiring lock "ba3de574-ae62-4e9d-87f8-434c163d9897-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-43cb675a-a7ae-496f-886d-8acb10457af7 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lock "ba3de574-ae62-4e9d-87f8-434c163d9897-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-43cb675a-a7ae-496f-886d-8acb10457af7 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lock "ba3de574-ae62-4e9d-87f8-434c163d9897-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.003s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:41 user nova-compute[73497]: INFO nova.compute.manager [None req-43cb675a-a7ae-496f-886d-8acb10457af7 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Terminating instance
Aug 26 23:16:41 user nova-compute[73497]: DEBUG nova.compute.manager [None req-43cb675a-a7ae-496f-886d-8acb10457af7 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:16:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] COPY block job progress, current cursor: 83886080 final cursor: 1073741824 {{(pid=73497) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 23:16:42 user nova-compute[73497]: DEBUG nova.compute.manager [req-d74e0fc8-5c86-4cb1-958f-09864013859e req-6e2c4c79-2879-41d2-9b37-9048066bf0f6 service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Received event network-vif-unplugged-ca3ccf3a-86b0-492c-99ae-9cdca5df9336 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:16:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d74e0fc8-5c86-4cb1-958f-09864013859e req-6e2c4c79-2879-41d2-9b37-9048066bf0f6 service nova] Acquiring lock "ba3de574-ae62-4e9d-87f8-434c163d9897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d74e0fc8-5c86-4cb1-958f-09864013859e req-6e2c4c79-2879-41d2-9b37-9048066bf0f6 service nova] Lock "ba3de574-ae62-4e9d-87f8-434c163d9897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d74e0fc8-5c86-4cb1-958f-09864013859e req-6e2c4c79-2879-41d2-9b37-9048066bf0f6 service nova] Lock "ba3de574-ae62-4e9d-87f8-434c163d9897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:42 user nova-compute[73497]: DEBUG nova.compute.manager [req-d74e0fc8-5c86-4cb1-958f-09864013859e req-6e2c4c79-2879-41d2-9b37-9048066bf0f6 service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] No waiting events found dispatching network-vif-unplugged-ca3ccf3a-86b0-492c-99ae-9cdca5df9336 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:16:42 user nova-compute[73497]: DEBUG nova.compute.manager [req-d74e0fc8-5c86-4cb1-958f-09864013859e req-6e2c4c79-2879-41d2-9b37-9048066bf0f6 service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Received event network-vif-unplugged-ca3ccf3a-86b0-492c-99ae-9cdca5df9336 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:16:42 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] COPY block job progress, current cursor: 225443840 final cursor: 1073741824 {{(pid=73497) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 23:16:42 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Instance destroyed successfully.
Aug 26 23:16:42 user nova-compute[73497]: DEBUG nova.objects.instance [None req-43cb675a-a7ae-496f-886d-8acb10457af7 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lazy-loading 'resources' on Instance uuid ba3de574-ae62-4e9d-87f8-434c163d9897 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:16:42 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-43cb675a-a7ae-496f-886d-8acb10457af7 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:13:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1306226483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1306226483',id=7,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGe8nVo8i9dIVTRdjLRLAe5YZ0C6xyesogGuomHtses/n0zpuFh2lyzmy4UGl4SR+46J+vpwNqJeLYiNhrlPlaBcbP0iXsCzU1gcnZhT083Y39OsqxeF8liKiCYtA2+jQ==',key_name='tempest-keypair-411871039',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:13:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e456078921734435bd38b72c5266d50e',ramdisk_id='',reservation_id='r-hw890ap9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-200456857',owner_user_name='tempest-TaggedAttachmentsTest-200456857-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:13:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a73eb19d92254c56b126c555a94c9457',uuid=ba3de574-ae62-4e9d-87f8-434c163d9897,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca3ccf3a-86b0-492c-99ae-9cdca5df9336", "address": "fa:16:3e:48:b6:d8", "network": {"id": "ab1acb2f-a437-49f1-a450-c4001cb8a037", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1785575264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e456078921734435bd38b72c5266d50e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3ccf3a-86", "ovs_interfaceid": "ca3ccf3a-86b0-492c-99ae-9cdca5df9336", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:16:42 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-43cb675a-a7ae-496f-886d-8acb10457af7 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Converting VIF {"id": "ca3ccf3a-86b0-492c-99ae-9cdca5df9336", "address": "fa:16:3e:48:b6:d8", "network": {"id": "ab1acb2f-a437-49f1-a450-c4001cb8a037", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1785575264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e456078921734435bd38b72c5266d50e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3ccf3a-86", "ovs_interfaceid": "ca3ccf3a-86b0-492c-99ae-9cdca5df9336", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:16:42 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-43cb675a-a7ae-496f-886d-8acb10457af7 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:b6:d8,bridge_name='br-int',has_traffic_filtering=True,id=ca3ccf3a-86b0-492c-99ae-9cdca5df9336,network=Network(ab1acb2f-a437-49f1-a450-c4001cb8a037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca3ccf3a-86') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:16:42 user nova-compute[73497]: DEBUG os_vif [None req-43cb675a-a7ae-496f-886d-8acb10457af7 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:b6:d8,bridge_name='br-int',has_traffic_filtering=True,id=ca3ccf3a-86b0-492c-99ae-9cdca5df9336,network=Network(ab1acb2f-a437-49f1-a450-c4001cb8a037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca3ccf3a-86') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:16:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca3ccf3a-86, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:16:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:16:42 user nova-compute[73497]: INFO os_vif [None req-43cb675a-a7ae-496f-886d-8acb10457af7 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:b6:d8,bridge_name='br-int',has_traffic_filtering=True,id=ca3ccf3a-86b0-492c-99ae-9cdca5df9336,network=Network(ab1acb2f-a437-49f1-a450-c4001cb8a037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca3ccf3a-86')
Aug 26 23:16:42 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-43cb675a-a7ae-496f-886d-8acb10457af7 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Deleting instance files /opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897_del
Aug 26 23:16:42 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-43cb675a-a7ae-496f-886d-8acb10457af7 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Deletion of /opt/stack/data/nova/instances/ba3de574-ae62-4e9d-87f8-434c163d9897_del complete
Aug 26 23:16:42 user nova-compute[73497]: INFO nova.compute.manager [None req-43cb675a-a7ae-496f-886d-8acb10457af7 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 26 23:16:42 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-43cb675a-a7ae-496f-886d-8acb10457af7 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:16:42 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:16:42 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:16:42 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] COPY block job progress, current cursor: 368050176 final cursor: 1073741824 {{(pid=73497) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 23:16:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] COPY block job progress, current cursor: 509607936 final cursor: 1073741824 {{(pid=73497) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 23:16:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] COPY block job progress, current cursor: 655360000 final cursor: 1073741824 {{(pid=73497) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 23:16:44 user nova-compute[73497]: DEBUG nova.compute.manager [req-fbff712e-2327-4460-bd71-cfe684c16db8 req-e9d4f407-7516-4b64-9dee-7de42bd56969 service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Received event network-vif-plugged-ca3ccf3a-86b0-492c-99ae-9cdca5df9336 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:16:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-fbff712e-2327-4460-bd71-cfe684c16db8 req-e9d4f407-7516-4b64-9dee-7de42bd56969 service nova] Acquiring lock "ba3de574-ae62-4e9d-87f8-434c163d9897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-fbff712e-2327-4460-bd71-cfe684c16db8 req-e9d4f407-7516-4b64-9dee-7de42bd56969 service nova] Lock "ba3de574-ae62-4e9d-87f8-434c163d9897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-fbff712e-2327-4460-bd71-cfe684c16db8 req-e9d4f407-7516-4b64-9dee-7de42bd56969 service nova] Lock "ba3de574-ae62-4e9d-87f8-434c163d9897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:44 user nova-compute[73497]: DEBUG nova.compute.manager [req-fbff712e-2327-4460-bd71-cfe684c16db8 req-e9d4f407-7516-4b64-9dee-7de42bd56969 service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] No waiting events found dispatching network-vif-plugged-ca3ccf3a-86b0-492c-99ae-9cdca5df9336 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:16:44 user nova-compute[73497]: WARNING nova.compute.manager [req-fbff712e-2327-4460-bd71-cfe684c16db8 req-e9d4f407-7516-4b64-9dee-7de42bd56969 service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Received unexpected event network-vif-plugged-ca3ccf3a-86b0-492c-99ae-9cdca5df9336 for instance with vm_state active and task_state deleting.
Aug 26 23:16:44 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] COPY block job progress, current cursor: 805306368 final cursor: 1073741824 {{(pid=73497) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 23:16:44 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:16:44 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Took 1.99 seconds to deallocate network for instance.
Aug 26 23:16:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-43cb675a-a7ae-496f-886d-8acb10457af7 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-43cb675a-a7ae-496f-886d-8acb10457af7 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:44 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] COPY block job progress, current cursor: 876609536 final cursor: 1073741824 {{(pid=73497) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 23:16:45 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-43cb675a-a7ae-496f-886d-8acb10457af7 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:16:45 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-43cb675a-a7ae-496f-886d-8acb10457af7 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:16:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-43cb675a-a7ae-496f-886d-8acb10457af7 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.635s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:45 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] COPY block job progress, current cursor: 1019215872 final cursor: 1073741824 {{(pid=73497) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 23:16:45 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-43cb675a-a7ae-496f-886d-8acb10457af7 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Deleted allocations for instance ba3de574-ae62-4e9d-87f8-434c163d9897
Aug 26 23:16:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-43cb675a-a7ae-496f-886d-8acb10457af7 tempest-TaggedAttachmentsTest-200456857 tempest-TaggedAttachmentsTest-200456857-project-member] Lock "ba3de574-ae62-4e9d-87f8-434c163d9897" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.189s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:45 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73497) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG nova.compute.manager [req-d8f1207f-17e4-482d-b2f9-2f4165b3e100 req-d5471bdf-1aff-4d5e-b452-3d875861a19f service nova] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Received event network-vif-deleted-ca3ccf3a-86b0-492c-99ae-9cdca5df9336 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wSCatUur', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '4dac4890-c469-48e1-a4df-bef84bc6e46a'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:16:46 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:16:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5eb6dea-d0f4-4379-8c6e-ee4960f6c949]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3dc47b-6033-4a42-8649-f1db303e0c58]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:16:46 user nova-compute[73497]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:16:46 user nova-compute[73497]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)
Aug 26 23:16:46 user nova-compute[73497]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a (non-flash)
Aug 26 23:16:46 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:16:46 user nova-compute[73497]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:16:46 user nova-compute[73497]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)
Aug 26 23:16:46 user nova-compute[73497]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a (non-flash)
Aug 26 23:16:46 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282c53d240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a'): ({'sdb'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Removing single pathed devices sdb {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad93b605-d0f6-4380-ada8-77c154ddb511]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7274f7b3-d3d6-446d-abf8-4b6ffb1a0032]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Flushing IO for device /dev/sdb {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea9f774-7cf5-4da2-ae92-2dffeab03681]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ac224c-dcfa-40e5-948d-ca1c6f15be7c]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a229580-8041-4105-86fc-fe33dcb814e3]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7d2a11-477d-4918-9da4-bca387aa7d4b]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a, portal: 172.16.0.220,3260]
Aug 26 23:16:46 user nova-compute[73497]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a, portal: 172.16.0.220,3260] successful.
Aug 26 23:16:46 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dac4890-c469-48e1-a4df-bef84bc6e46a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3edb216-3383-46a8-b2e0-9258fe5db688]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] <== disconnect_volume: return (345ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lQKeEtSk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'ab745e33-a11e-4ee4-a442-1e7893448d27', 'attached_at': '', 'detached_at': '', 'volume_id': '8bbc3abb-c6d3-471c-b47f-e9a43806dfac', 'serial'} {{(pid=73497) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 26 23:16:46 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] swap_volume: removing Cinder connection for volume 4dac4890-c469-48e1-a4df-bef84bc6e46a {{(pid=73497) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 26 23:16:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:47 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] swap_volume: Updating volume 4dac4890-c469-48e1-a4df-bef84bc6e46a BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "lQKeEtSk", "auth_password": "B4RIdfSvD9Cjhl", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "8bbc3abb-c6d3-471c-b47f-e9a43806dfac"}, "status": "reserved", "instance": "ab745e33-a11e-4ee4-a442-1e7893448d27", "attached_at": "", "detached_at": "", "volume_id": "8bbc3abb-c6d3-471c-b47f-e9a43806dfac", "serial": "8bbc3abb-c6d3-471c-b47f-e9a43806dfac"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '8bbc3abb-c6d3-471c-b47f-e9a43806dfac', 'no_device': None, 'attachment_id': '5ed69437-75ad-459f-909e-f40038c11a02'} {{(pid=73497) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 26 23:16:47 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4ed6fba7-13f6-4641-9560-2ab6ca431717 tempest-TestVolumeSwap-1994105229 tempest-TestVolumeSwap-1994105229-project-admin] Lock "ab745e33-a11e-4ee4-a442-1e7893448d27" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 21.732s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:48 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:16:48 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:16:48 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:16:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:48 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:16:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865d6369-32ac-46ac-b6df-37d8fa4bf440/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865d6369-32ac-46ac-b6df-37d8fa4bf440/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865d6369-32ac-46ac-b6df-37d8fa4bf440/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-88f2f23f-0109-4ded-9e19-f26538386cf1 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Acquiring lock "ab745e33-a11e-4ee4-a442-1e7893448d27" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-88f2f23f-0109-4ded-9e19-f26538386cf1 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Lock "ab745e33-a11e-4ee4-a442-1e7893448d27" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:48 user nova-compute[73497]: INFO nova.compute.manager [None req-88f2f23f-0109-4ded-9e19-f26538386cf1 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Detaching volume 8bbc3abb-c6d3-471c-b47f-e9a43806dfac
Aug 26 23:16:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865d6369-32ac-46ac-b6df-37d8fa4bf440/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:49 user nova-compute[73497]: INFO nova.virt.block_device [None req-88f2f23f-0109-4ded-9e19-f26538386cf1 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Attempting to driver detach volume 8bbc3abb-c6d3-471c-b47f-e9a43806dfac from mountpoint /dev/vdb
Aug 26 23:16:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab745e33-a11e-4ee4-a442-1e7893448d27/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-af22697f-a443-4379-a507-3ebdd5df798c tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Acquiring lock "865d6369-32ac-46ac-b6df-37d8fa4bf440" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-af22697f-a443-4379-a507-3ebdd5df798c tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Lock "865d6369-32ac-46ac-b6df-37d8fa4bf440" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-af22697f-a443-4379-a507-3ebdd5df798c tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Acquiring lock "865d6369-32ac-46ac-b6df-37d8fa4bf440-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-af22697f-a443-4379-a507-3ebdd5df798c tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Lock "865d6369-32ac-46ac-b6df-37d8fa4bf440-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-af22697f-a443-4379-a507-3ebdd5df798c tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Lock "865d6369-32ac-46ac-b6df-37d8fa4bf440-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:49 user nova-compute[73497]: INFO nova.compute.manager [None req-af22697f-a443-4379-a507-3ebdd5df798c tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Terminating instance
Aug 26 23:16:49 user nova-compute[73497]: DEBUG nova.compute.manager [None req-af22697f-a443-4379-a507-3ebdd5df798c tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-88f2f23f-0109-4ded-9e19-f26538386cf1 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Attempting to detach device vdb from instance ab745e33-a11e-4ee4-a442-1e7893448d27 from the persistent domain config. {{(pid=73497) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-88f2f23f-0109-4ded-9e19-f26538386cf1 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:16:49 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:16:49 user nova-compute[73497]:   <source dev="/dev/sde"/>
Aug 26 23:16:49 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:16:49 user nova-compute[73497]:   <serial>8bbc3abb-c6d3-471c-b47f-e9a43806dfac</serial>
Aug 26 23:16:49 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:16:49 user nova-compute[73497]: </disk>
Aug 26 23:16:49 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:16:49 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-88f2f23f-0109-4ded-9e19-f26538386cf1 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Successfully detached device vdb from instance ab745e33-a11e-4ee4-a442-1e7893448d27 from the persistent domain config.
Aug 26 23:16:49 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-88f2f23f-0109-4ded-9e19-f26538386cf1 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ab745e33-a11e-4ee4-a442-1e7893448d27 from the live domain config. {{(pid=73497) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-88f2f23f-0109-4ded-9e19-f26538386cf1 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:16:49 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:16:49 user nova-compute[73497]:   <source dev="/dev/sde"/>
Aug 26 23:16:49 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:16:49 user nova-compute[73497]:   <serial>8bbc3abb-c6d3-471c-b47f-e9a43806dfac</serial>
Aug 26 23:16:49 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:16:49 user nova-compute[73497]: </disk>
Aug 26 23:16:49 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab745e33-a11e-4ee4-a442-1e7893448d27/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab745e33-a11e-4ee4-a442-1e7893448d27/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab745e33-a11e-4ee4-a442-1e7893448d27/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Received event <DeviceRemovedEvent: 1693091809.7203064, ab745e33-a11e-4ee4-a442-1e7893448d27 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73497) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-88f2f23f-0109-4ded-9e19-f26538386cf1 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ab745e33-a11e-4ee4-a442-1e7893448d27 {{(pid=73497) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 23:16:49 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-88f2f23f-0109-4ded-9e19-f26538386cf1 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Successfully detached device vdb from instance ab745e33-a11e-4ee4-a442-1e7893448d27 from the live domain config.
Aug 26 23:16:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88f2f23f-0109-4ded-9e19-f26538386cf1 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f2f23f-0109-4ded-9e19-f26538386cf1 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lQKeEtSk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '8bbc3abb-c6d3-471c-b47f-e9a43806dfac'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:16:49 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-88f2f23f-0109-4ded-9e19-f26538386cf1 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:16:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-88f2f23f-0109-4ded-9e19-f26538386cf1 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-88f2f23f-0109-4ded-9e19-f26538386cf1 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f2f23f-0109-4ded-9e19-f26538386cf1 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.035s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[334331d0-1aba-49bb-874a-1b95c3ce1a63]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8dced6-f353-40fc-884f-5917f307f9ba]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f2f23f-0109-4ded-9e19-f26538386cf1 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:16:49 user nova-compute[73497]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:16:49 user nova-compute[73497]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)
Aug 26 23:16:49 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f2f23f-0109-4ded-9e19-f26538386cf1 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:16:49 user nova-compute[73497]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:16:49 user nova-compute[73497]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac (non-flash)
Aug 26 23:16:49 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f2f23f-0109-4ded-9e19-f26538386cf1 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281c572710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac'): ({'sde'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-88f2f23f-0109-4ded-9e19-f26538386cf1 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Removing single pathed devices sde {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cdaf81-1408-480d-8a1b-7e3a038d24da]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15eb49d-ca6d-48fc-a2dc-264b1e79da48]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-88f2f23f-0109-4ded-9e19-f26538386cf1 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Flushing IO for device /dev/sde {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[637f3c7f-883d-4b8c-8702-d476659cf1fd]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-88f2f23f-0109-4ded-9e19-f26538386cf1 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:16:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92e660c-7b02-4c60-baba-c97ffffc7f81]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-88f2f23f-0109-4ded-9e19-f26538386cf1 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-88f2f23f-0109-4ded-9e19-f26538386cf1 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] SCSI volumes sde have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f2f23f-0109-4ded-9e19-f26538386cf1 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c693e57-4bf0-47b6-a509-251b555201ec]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f2f23f-0109-4ded-9e19-f26538386cf1 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG nova.compute.manager [req-f510176d-e9f7-4a05-a442-4170936567a5 req-92b24f03-2bbd-4122-b968-e5d258be3d4f service nova] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Received event network-vif-unplugged-1aecc224-deb4-4bb2-90e4-21471146ebf4 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f510176d-e9f7-4a05-a442-4170936567a5 req-92b24f03-2bbd-4122-b968-e5d258be3d4f service nova] Acquiring lock "865d6369-32ac-46ac-b6df-37d8fa4bf440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f510176d-e9f7-4a05-a442-4170936567a5 req-92b24f03-2bbd-4122-b968-e5d258be3d4f service nova] Lock "865d6369-32ac-46ac-b6df-37d8fa4bf440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f510176d-e9f7-4a05-a442-4170936567a5 req-92b24f03-2bbd-4122-b968-e5d258be3d4f service nova] Lock "865d6369-32ac-46ac-b6df-37d8fa4bf440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG nova.compute.manager [req-f510176d-e9f7-4a05-a442-4170936567a5 req-92b24f03-2bbd-4122-b968-e5d258be3d4f service nova] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] No waiting events found dispatching network-vif-unplugged-1aecc224-deb4-4bb2-90e4-21471146ebf4 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG nova.compute.manager [req-f510176d-e9f7-4a05-a442-4170936567a5 req-92b24f03-2bbd-4122-b968-e5d258be3d4f service nova] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Received event network-vif-unplugged-1aecc224-deb4-4bb2-90e4-21471146ebf4 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:50 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Instance destroyed successfully.
Aug 26 23:16:50 user nova-compute[73497]: DEBUG nova.objects.instance [None req-af22697f-a443-4379-a507-3ebdd5df798c tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Lazy-loading 'resources' on Instance uuid 865d6369-32ac-46ac-b6df-37d8fa4bf440 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-af22697f-a443-4379-a507-3ebdd5df798c tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1241197533',display_name='tempest-VolumesAssistedSnapshotsTest-server-1241197533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1241197533',id=9,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQja4DpaIKnp1nqOP0IgYa2V1RBUkZDhXbt+e0ISMPoh6h903YMqf7oYMfAqXUSWdteNxRkONCSi1YFfeCcrtEC14xwytXJyfapALGlIbKVCJ+xUtl4ZxduTS+6Xk8WqA==',key_name='tempest-keypair-264287436',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:13:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c79abf19d9b1457bb5cb22c1072526d4',ramdisk_id='',reservation_id='r-nl7lci7t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1703564551',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1703564551-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:13:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e76a569cfcf40aeb6d07818a6cd8401',uuid=865d6369-32ac-46ac-b6df-37d8fa4bf440,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1aecc224-deb4-4bb2-90e4-21471146ebf4", "address": "fa:16:3e:4a:4b:6c", "network": {"id": "3aab5362-39c3-4ee6-9e1d-13e88d7dfa0b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-8435068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c79abf19d9b1457bb5cb22c1072526d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aecc224-de", "ovs_interfaceid": "1aecc224-deb4-4bb2-90e4-21471146ebf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-af22697f-a443-4379-a507-3ebdd5df798c tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Converting VIF {"id": "1aecc224-deb4-4bb2-90e4-21471146ebf4", "address": "fa:16:3e:4a:4b:6c", "network": {"id": "3aab5362-39c3-4ee6-9e1d-13e88d7dfa0b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-8435068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c79abf19d9b1457bb5cb22c1072526d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aecc224-de", "ovs_interfaceid": "1aecc224-deb4-4bb2-90e4-21471146ebf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-af22697f-a443-4379-a507-3ebdd5df798c tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:4b:6c,bridge_name='br-int',has_traffic_filtering=True,id=1aecc224-deb4-4bb2-90e4-21471146ebf4,network=Network(3aab5362-39c3-4ee6-9e1d-13e88d7dfa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aecc224-de') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG os_vif [None req-af22697f-a443-4379-a507-3ebdd5df798c tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:4b:6c,bridge_name='br-int',has_traffic_filtering=True,id=1aecc224-deb4-4bb2-90e4-21471146ebf4,network=Network(3aab5362-39c3-4ee6-9e1d-13e88d7dfa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aecc224-de') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1aecc224-de, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:16:50 user nova-compute[73497]: INFO os_vif [None req-af22697f-a443-4379-a507-3ebdd5df798c tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:4b:6c,bridge_name='br-int',has_traffic_filtering=True,id=1aecc224-deb4-4bb2-90e4-21471146ebf4,network=Network(3aab5362-39c3-4ee6-9e1d-13e88d7dfa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aecc224-de')
Aug 26 23:16:50 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-af22697f-a443-4379-a507-3ebdd5df798c tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Deleting instance files /opt/stack/data/nova/instances/865d6369-32ac-46ac-b6df-37d8fa4bf440_del
Aug 26 23:16:50 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-af22697f-a443-4379-a507-3ebdd5df798c tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Deletion of /opt/stack/data/nova/instances/865d6369-32ac-46ac-b6df-37d8fa4bf440_del complete
Aug 26 23:16:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c3bead-68ee-43b0-bb87-4cc13befa9bb]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f2f23f-0109-4ded-9e19-f26538386cf1 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac, portal: 172.16.0.220,3260]
Aug 26 23:16:50 user nova-compute[73497]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac, portal: 172.16.0.220,3260] successful.
Aug 26 23:16:50 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbc3abb-c6d3-471c-b47f-e9a43806dfac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[99234ebd-5585-473a-8476-f8cebb64992f]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f2f23f-0109-4ded-9e19-f26538386cf1 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-88f2f23f-0109-4ded-9e19-f26538386cf1 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.478s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f2f23f-0109-4ded-9e19-f26538386cf1 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] <== disconnect_volume: return (481ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88f2f23f-0109-4ded-9e19-f26538386cf1 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:50 user nova-compute[73497]: INFO nova.compute.manager [None req-af22697f-a443-4379-a507-3ebdd5df798c tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Took 1.27 seconds to destroy the instance on the hypervisor.
Aug 26 23:16:50 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-af22697f-a443-4379-a507-3ebdd5df798c tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "b68b6975-a24a-4861-a583-406b02446ea0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "b68b6975-a24a-4861-a583-406b02446ea0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG nova.compute.manager [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:16:50 user nova-compute[73497]: INFO nova.compute.claims [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Claim successful on node user
Aug 26 23:16:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:51 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:16:51 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:16:51 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:16:51 user nova-compute[73497]: DEBUG nova.compute.manager [req-666a7283-03d5-41ab-91c1-03826695e09b req-7677232d-0c18-4b66-8bbf-32e3073d2fce service nova] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Received event network-vif-deleted-1aecc224-deb4-4bb2-90e4-21471146ebf4 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:16:51 user nova-compute[73497]: INFO nova.compute.manager [req-666a7283-03d5-41ab-91c1-03826695e09b req-7677232d-0c18-4b66-8bbf-32e3073d2fce service nova] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Neutron deleted interface 1aecc224-deb4-4bb2-90e4-21471146ebf4; detaching it from the instance and deleting it from the info cache
Aug 26 23:16:51 user nova-compute[73497]: DEBUG nova.network.neutron [req-666a7283-03d5-41ab-91c1-03826695e09b req-7677232d-0c18-4b66-8bbf-32e3073d2fce service nova] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:16:51 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Took 1.05 seconds to deallocate network for instance.
Aug 26 23:16:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.813s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:51 user nova-compute[73497]: DEBUG nova.compute.manager [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:16:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:51 user nova-compute[73497]: DEBUG nova.compute.manager [req-666a7283-03d5-41ab-91c1-03826695e09b req-7677232d-0c18-4b66-8bbf-32e3073d2fce service nova] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Detach interface failed, port_id=1aecc224-deb4-4bb2-90e4-21471146ebf4, reason: Instance 865d6369-32ac-46ac-b6df-37d8fa4bf440 could not be found. {{(pid=73497) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 23:16:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-af22697f-a443-4379-a507-3ebdd5df798c tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-af22697f-a443-4379-a507-3ebdd5df798c tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:51 user nova-compute[73497]: DEBUG nova.compute.manager [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:16:51 user nova-compute[73497]: DEBUG nova.network.neutron [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:16:51 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:16:51 user nova-compute[73497]: DEBUG nova.compute.manager [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:16:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:51 user nova-compute[73497]: DEBUG nova.policy [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '935b8635557949cfba9b6528b97da95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c212cbb083450ea15ec54a96f12510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:16:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:51 user nova-compute[73497]: DEBUG nova.compute.manager [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:16:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:16:51 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Creating image(s)
Aug 26 23:16:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "/opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "/opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "/opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.020s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19ccf77-8c30-44af-bd19-9b879fa60942/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19ccf77-8c30-44af-bd19-9b879fa60942/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19ccf77-8c30-44af-bd19-9b879fa60942/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:52 user nova-compute[73497]: DEBUG nova.compute.manager [req-97dac1c6-f3cf-4aa6-9400-050e9fcfda91 req-ad3d92c7-6ccc-4b9b-a8a3-b52d62d49609 service nova] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Received event network-vif-plugged-1aecc224-deb4-4bb2-90e4-21471146ebf4 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:16:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-97dac1c6-f3cf-4aa6-9400-050e9fcfda91 req-ad3d92c7-6ccc-4b9b-a8a3-b52d62d49609 service nova] Acquiring lock "865d6369-32ac-46ac-b6df-37d8fa4bf440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-97dac1c6-f3cf-4aa6-9400-050e9fcfda91 req-ad3d92c7-6ccc-4b9b-a8a3-b52d62d49609 service nova] Lock "865d6369-32ac-46ac-b6df-37d8fa4bf440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-97dac1c6-f3cf-4aa6-9400-050e9fcfda91 req-ad3d92c7-6ccc-4b9b-a8a3-b52d62d49609 service nova] Lock "865d6369-32ac-46ac-b6df-37d8fa4bf440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:52 user nova-compute[73497]: DEBUG nova.compute.manager [req-97dac1c6-f3cf-4aa6-9400-050e9fcfda91 req-ad3d92c7-6ccc-4b9b-a8a3-b52d62d49609 service nova] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] No waiting events found dispatching network-vif-plugged-1aecc224-deb4-4bb2-90e4-21471146ebf4 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:16:52 user nova-compute[73497]: WARNING nova.compute.manager [req-97dac1c6-f3cf-4aa6-9400-050e9fcfda91 req-ad3d92c7-6ccc-4b9b-a8a3-b52d62d49609 service nova] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Received unexpected event network-vif-plugged-1aecc224-deb4-4bb2-90e4-21471146ebf4 for instance with vm_state deleted and task_state None.
Aug 26 23:16:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.243s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:52 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-af22697f-a443-4379-a507-3ebdd5df798c tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:16:52 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-af22697f-a443-4379-a507-3ebdd5df798c tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:16:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19ccf77-8c30-44af-bd19-9b879fa60942/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:52 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:16:52 user nova-compute[73497]: DEBUG nova.network.neutron [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Successfully created port: 744f8df2-5712-4df4-a4e6-d7705b4d3cc7 {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:16:52 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693091797.6200023, 79d00f46-3843-4297-ba47-33557b11d489 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:16:52 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 79d00f46-3843-4297-ba47-33557b11d489] VM Stopped (Lifecycle Event)
Aug 26 23:16:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-af22697f-a443-4379-a507-3ebdd5df798c tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.436s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.742s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:53 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-af22697f-a443-4379-a507-3ebdd5df798c tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Deleted allocations for instance 865d6369-32ac-46ac-b6df-37d8fa4bf440
Aug 26 23:16:53 user nova-compute[73497]: DEBUG nova.compute.manager [None req-d420a7f4-8d91-4c13-96ea-b73ad57f7d8e None None] [instance: 79d00f46-3843-4297-ba47-33557b11d489] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk 1073741824" returned: 0 in 0.065s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:53 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:16:53 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:16:53 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=7445MB free_disk=25.535030364990234GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.818s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-af22697f-a443-4379-a507-3ebdd5df798c tempest-VolumesAssistedSnapshotsTest-1703564551 tempest-VolumesAssistedSnapshotsTest-1703564551-project-member] Lock "865d6369-32ac-46ac-b6df-37d8fa4bf440" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.095s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 926f8e5c-8d8a-4f07-bf08-e60700ce4698 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 994093f0-e6b2-4c96-b259-c559ef2b1fbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 171985a3-358d-4b26-a66c-372b9b99b386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 1a58c5e7-b4c7-4bd5-8dd1-a98492139240 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance ab745e33-a11e-4ee4-a442-1e7893448d27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 62f841d2-09e7-448b-8c1c-26c824c473ba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance aebaeda6-23d1-43a1-afc8-bdc8992067e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance ee6283d5-40de-432d-997c-0be52ff673ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance a19ccf77-8c30-44af-bd19-9b879fa60942 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance b68b6975-a24a-4861-a583-406b02446ea0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.214s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Cannot resize image /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Ensure instance console log exists: /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.609s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG nova.network.neutron [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Successfully updated port: 744f8df2-5712-4df4-a4e6-d7705b4d3cc7 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "refresh_cache-b68b6975-a24a-4861-a583-406b02446ea0" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquired lock "refresh_cache-b68b6975-a24a-4861-a583-406b02446ea0" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG nova.network.neutron [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG nova.compute.manager [req-d113d441-1b1d-451c-a954-0c33cb5b1423 req-02b46b9b-f22f-4f79-8f82-1e9a47958d6b service nova] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Received event network-changed-744f8df2-5712-4df4-a4e6-d7705b4d3cc7 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG nova.compute.manager [req-d113d441-1b1d-451c-a954-0c33cb5b1423 req-02b46b9b-f22f-4f79-8f82-1e9a47958d6b service nova] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Refreshing instance network info cache due to event network-changed-744f8df2-5712-4df4-a4e6-d7705b4d3cc7. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d113d441-1b1d-451c-a954-0c33cb5b1423 req-02b46b9b-f22f-4f79-8f82-1e9a47958d6b service nova] Acquiring lock "refresh_cache-b68b6975-a24a-4861-a583-406b02446ea0" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:16:53 user nova-compute[73497]: DEBUG nova.network.neutron [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG nova.objects.instance [None req-88f2f23f-0109-4ded-9e19-f26538386cf1 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Lazy-loading 'flavor' on Instance uuid ab745e33-a11e-4ee4-a442-1e7893448d27 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-88f2f23f-0109-4ded-9e19-f26538386cf1 tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Lock "ab745e33-a11e-4ee4-a442-1e7893448d27" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.404s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG nova.network.neutron [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Updating instance_info_cache with network_info: [{"id": "744f8df2-5712-4df4-a4e6-d7705b4d3cc7", "address": "fa:16:3e:03:fd:29", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744f8df2-57", "ovs_interfaceid": "744f8df2-5712-4df4-a4e6-d7705b4d3cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Releasing lock "refresh_cache-b68b6975-a24a-4861-a583-406b02446ea0" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG nova.compute.manager [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Instance network_info: |[{"id": "744f8df2-5712-4df4-a4e6-d7705b4d3cc7", "address": "fa:16:3e:03:fd:29", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744f8df2-57", "ovs_interfaceid": "744f8df2-5712-4df4-a4e6-d7705b4d3cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d113d441-1b1d-451c-a954-0c33cb5b1423 req-02b46b9b-f22f-4f79-8f82-1e9a47958d6b service nova] Acquired lock "refresh_cache-b68b6975-a24a-4861-a583-406b02446ea0" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG nova.network.neutron [req-d113d441-1b1d-451c-a954-0c33cb5b1423 req-02b46b9b-f22f-4f79-8f82-1e9a47958d6b service nova] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Refreshing network info cache for port 744f8df2-5712-4df4-a4e6-d7705b4d3cc7 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Start _get_guest_xml network_info=[{"id": "744f8df2-5712-4df4-a4e6-d7705b4d3cc7", "address": "fa:16:3e:03:fd:29", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744f8df2-57", "ovs_interfaceid": "744f8df2-5712-4df4-a4e6-d7705b4d3cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:16:54 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:16:54 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:16:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:16:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-625758251',display_name='tempest-tempest.common.compute-instance-625758251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-625758251',id=15,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmg/g6/JqH0YLHZCpkD8rdnvMd23HQeTLvjge/Sh0DkE/Wj5zHdvAQ5fV67GK4vLmc3pz0PLw+2ofNRJAaMibeeNwiocztzy0e4AyExGxeymNeWH40DsExDFkx2358gAQ==',key_name='tempest-keypair-2050586917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80c212cbb083450ea15ec54a96f12510',ramdisk_id='',reservation_id='r-3tzokivj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-81910947',owner_user_name='tempest-ServerActionsTestOtherA-81910947-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:16:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='935b8635557949cfba9b6528b97da95f',uuid=b68b6975-a24a-4861-a583-406b02446ea0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "744f8df2-5712-4df4-a4e6-d7705b4d3cc7", "address": "fa:16:3e:03:fd:29", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744f8df2-57", "ovs_interfaceid": "744f8df2-5712-4df4-a4e6-d7705b4d3cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Converting VIF {"id": "744f8df2-5712-4df4-a4e6-d7705b4d3cc7", "address": "fa:16:3e:03:fd:29", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744f8df2-57", "ovs_interfaceid": "744f8df2-5712-4df4-a4e6-d7705b4d3cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:fd:29,bridge_name='br-int',has_traffic_filtering=True,id=744f8df2-5712-4df4-a4e6-d7705b4d3cc7,network=Network(bf99a38a-faaf-4f1e-a161-736ce9089919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744f8df2-57') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG nova.objects.instance [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lazy-loading 'pci_devices' on Instance uuid b68b6975-a24a-4861-a583-406b02446ea0 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:16:54 user nova-compute[73497]:   <uuid>b68b6975-a24a-4861-a583-406b02446ea0</uuid>
Aug 26 23:16:54 user nova-compute[73497]:   <name>instance-0000000f</name>
Aug 26 23:16:54 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:16:54 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:16:54 user nova-compute[73497]:   <metadata>
Aug 26 23:16:54 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:16:54 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:16:54 user nova-compute[73497]:       <nova:name>tempest-tempest.common.compute-instance-625758251</nova:name>
Aug 26 23:16:54 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:16:54</nova:creationTime>
Aug 26 23:16:54 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:16:54 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:16:54 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:16:54 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:16:54 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:16:54 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:16:54 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:16:54 user nova-compute[73497]:       <nova:owner>
Aug 26 23:16:54 user nova-compute[73497]:         <nova:user uuid="935b8635557949cfba9b6528b97da95f">tempest-ServerActionsTestOtherA-81910947-project-member</nova:user>
Aug 26 23:16:54 user nova-compute[73497]:         <nova:project uuid="80c212cbb083450ea15ec54a96f12510">tempest-ServerActionsTestOtherA-81910947</nova:project>
Aug 26 23:16:54 user nova-compute[73497]:       </nova:owner>
Aug 26 23:16:54 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:16:54 user nova-compute[73497]:       <nova:ports>
Aug 26 23:16:54 user nova-compute[73497]:         <nova:port uuid="744f8df2-5712-4df4-a4e6-d7705b4d3cc7">
Aug 26 23:16:54 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 23:16:54 user nova-compute[73497]:         </nova:port>
Aug 26 23:16:54 user nova-compute[73497]:       </nova:ports>
Aug 26 23:16:54 user nova-compute[73497]:     </nova:instance>
Aug 26 23:16:54 user nova-compute[73497]:   </metadata>
Aug 26 23:16:54 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:16:54 user nova-compute[73497]:     <system>
Aug 26 23:16:54 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:16:54 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:16:54 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:16:54 user nova-compute[73497]:       <entry name="serial">b68b6975-a24a-4861-a583-406b02446ea0</entry>
Aug 26 23:16:54 user nova-compute[73497]:       <entry name="uuid">b68b6975-a24a-4861-a583-406b02446ea0</entry>
Aug 26 23:16:54 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:16:54 user nova-compute[73497]:     </system>
Aug 26 23:16:54 user nova-compute[73497]:   </sysinfo>
Aug 26 23:16:54 user nova-compute[73497]:   <os>
Aug 26 23:16:54 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:16:54 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:16:54 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:16:54 user nova-compute[73497]:   </os>
Aug 26 23:16:54 user nova-compute[73497]:   <features>
Aug 26 23:16:54 user nova-compute[73497]:     <acpi/>
Aug 26 23:16:54 user nova-compute[73497]:     <apic/>
Aug 26 23:16:54 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:16:54 user nova-compute[73497]:   </features>
Aug 26 23:16:54 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:16:54 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:16:54 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:16:54 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:16:54 user nova-compute[73497]:   </clock>
Aug 26 23:16:54 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:16:54 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:16:54 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:16:54 user nova-compute[73497]:   </cpu>
Aug 26 23:16:54 user nova-compute[73497]:   <devices>
Aug 26 23:16:54 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:16:54 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:16:54 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk"/>
Aug 26 23:16:54 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:16:54 user nova-compute[73497]:     </disk>
Aug 26 23:16:54 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:16:54 user nova-compute[73497]:       <mac address="fa:16:3e:03:fd:29"/>
Aug 26 23:16:54 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:16:54 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:16:54 user nova-compute[73497]:       <target dev="tap744f8df2-57"/>
Aug 26 23:16:54 user nova-compute[73497]:     </interface>
Aug 26 23:16:54 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:16:54 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/console.log" append="off"/>
Aug 26 23:16:54 user nova-compute[73497]:     </serial>
Aug 26 23:16:54 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:16:54 user nova-compute[73497]:     <video>
Aug 26 23:16:54 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:16:54 user nova-compute[73497]:     </video>
Aug 26 23:16:54 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:16:54 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:16:54 user nova-compute[73497]:     </rng>
Aug 26 23:16:54 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:16:54 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:16:54 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:16:54 user nova-compute[73497]:     </memballoon>
Aug 26 23:16:54 user nova-compute[73497]:   </devices>
Aug 26 23:16:54 user nova-compute[73497]: </domain>
Aug 26 23:16:54 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:16:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-625758251',display_name='tempest-tempest.common.compute-instance-625758251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-625758251',id=15,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmg/g6/JqH0YLHZCpkD8rdnvMd23HQeTLvjge/Sh0DkE/Wj5zHdvAQ5fV67GK4vLmc3pz0PLw+2ofNRJAaMibeeNwiocztzy0e4AyExGxeymNeWH40DsExDFkx2358gAQ==',key_name='tempest-keypair-2050586917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80c212cbb083450ea15ec54a96f12510',ramdisk_id='',reservation_id='r-3tzokivj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-81910947',owner_user_name='tempest-ServerActionsTestOtherA-81910947-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:16:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='935b8635557949cfba9b6528b97da95f',uuid=b68b6975-a24a-4861-a583-406b02446ea0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "744f8df2-5712-4df4-a4e6-d7705b4d3cc7", "address": "fa:16:3e:03:fd:29", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744f8df2-57", "ovs_interfaceid": "744f8df2-5712-4df4-a4e6-d7705b4d3cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Converting VIF {"id": "744f8df2-5712-4df4-a4e6-d7705b4d3cc7", "address": "fa:16:3e:03:fd:29", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744f8df2-57", "ovs_interfaceid": "744f8df2-5712-4df4-a4e6-d7705b4d3cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:fd:29,bridge_name='br-int',has_traffic_filtering=True,id=744f8df2-5712-4df4-a4e6-d7705b4d3cc7,network=Network(bf99a38a-faaf-4f1e-a161-736ce9089919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744f8df2-57') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG os_vif [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:fd:29,bridge_name='br-int',has_traffic_filtering=True,id=744f8df2-5712-4df4-a4e6-d7705b4d3cc7,network=Network(bf99a38a-faaf-4f1e-a161-736ce9089919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744f8df2-57') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap744f8df2-57, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap744f8df2-57, col_values=(('external_ids', {'iface-id': '744f8df2-5712-4df4-a4e6-d7705b4d3cc7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:fd:29', 'vm-uuid': 'b68b6975-a24a-4861-a583-406b02446ea0'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:54 user nova-compute[73497]: INFO os_vif [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:fd:29,bridge_name='br-int',has_traffic_filtering=True,id=744f8df2-5712-4df4-a4e6-d7705b4d3cc7,network=Network(bf99a38a-faaf-4f1e-a161-736ce9089919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744f8df2-57')
Aug 26 23:16:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] No VIF found with MAC fa:16:3e:03:fd:29, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-171985a3-358d-4b26-a66c-372b9b99b386" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-171985a3-358d-4b26-a66c-372b9b99b386" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG nova.network.neutron [req-d113d441-1b1d-451c-a954-0c33cb5b1423 req-02b46b9b-f22f-4f79-8f82-1e9a47958d6b service nova] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Updated VIF entry in instance network info cache for port 744f8df2-5712-4df4-a4e6-d7705b4d3cc7. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG nova.network.neutron [req-d113d441-1b1d-451c-a954-0c33cb5b1423 req-02b46b9b-f22f-4f79-8f82-1e9a47958d6b service nova] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Updating instance_info_cache with network_info: [{"id": "744f8df2-5712-4df4-a4e6-d7705b4d3cc7", "address": "fa:16:3e:03:fd:29", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744f8df2-57", "ovs_interfaceid": "744f8df2-5712-4df4-a4e6-d7705b4d3cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:16:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d113d441-1b1d-451c-a954-0c33cb5b1423 req-02b46b9b-f22f-4f79-8f82-1e9a47958d6b service nova] Releasing lock "refresh_cache-b68b6975-a24a-4861-a583-406b02446ea0" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:16:55 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Updating instance_info_cache with network_info: [{"id": "1772e978-02b5-4c0b-a99c-67f6c6f91d58", "address": "fa:16:3e:a7:28:86", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1772e978-02", "ovs_interfaceid": "1772e978-02b5-4c0b-a99c-67f6c6f91d58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:16:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-171985a3-358d-4b26-a66c-372b9b99b386" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:16:55 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:16:55 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:16:55 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:16:55 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:16:55 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:16:55 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:16:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:56 user nova-compute[73497]: DEBUG nova.compute.manager [req-72974537-b309-44ee-b900-90a597f29505 req-39536ac3-9413-4540-bf73-1414190d2dba service nova] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Received event network-vif-plugged-744f8df2-5712-4df4-a4e6-d7705b4d3cc7 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:16:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-72974537-b309-44ee-b900-90a597f29505 req-39536ac3-9413-4540-bf73-1414190d2dba service nova] Acquiring lock "b68b6975-a24a-4861-a583-406b02446ea0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-72974537-b309-44ee-b900-90a597f29505 req-39536ac3-9413-4540-bf73-1414190d2dba service nova] Lock "b68b6975-a24a-4861-a583-406b02446ea0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-72974537-b309-44ee-b900-90a597f29505 req-39536ac3-9413-4540-bf73-1414190d2dba service nova] Lock "b68b6975-a24a-4861-a583-406b02446ea0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:56 user nova-compute[73497]: DEBUG nova.compute.manager [req-72974537-b309-44ee-b900-90a597f29505 req-39536ac3-9413-4540-bf73-1414190d2dba service nova] [instance: b68b6975-a24a-4861-a583-406b02446ea0] No waiting events found dispatching network-vif-plugged-744f8df2-5712-4df4-a4e6-d7705b4d3cc7 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:16:56 user nova-compute[73497]: WARNING nova.compute.manager [req-72974537-b309-44ee-b900-90a597f29505 req-39536ac3-9413-4540-bf73-1414190d2dba service nova] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Received unexpected event network-vif-plugged-744f8df2-5712-4df4-a4e6-d7705b4d3cc7 for instance with vm_state building and task_state spawning.
Aug 26 23:16:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:16:57 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693091802.3422613, ba3de574-ae62-4e9d-87f8-434c163d9897 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:16:57 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] VM Stopped (Lifecycle Event)
Aug 26 23:16:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-39dac65e-613f-44e6-9af6-a225aa841305 None None] [instance: ba3de574-ae62-4e9d-87f8-434c163d9897] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:16:58 user nova-compute[73497]: DEBUG nova.compute.manager [req-65b1109f-1803-450e-99cd-5de6cb16d36a req-e26ed736-3412-4a7f-bcd7-f10b7312f99d service nova] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Received event network-vif-plugged-744f8df2-5712-4df4-a4e6-d7705b4d3cc7 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:16:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-65b1109f-1803-450e-99cd-5de6cb16d36a req-e26ed736-3412-4a7f-bcd7-f10b7312f99d service nova] Acquiring lock "b68b6975-a24a-4861-a583-406b02446ea0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:16:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-65b1109f-1803-450e-99cd-5de6cb16d36a req-e26ed736-3412-4a7f-bcd7-f10b7312f99d service nova] Lock "b68b6975-a24a-4861-a583-406b02446ea0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:16:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-65b1109f-1803-450e-99cd-5de6cb16d36a req-e26ed736-3412-4a7f-bcd7-f10b7312f99d service nova] Lock "b68b6975-a24a-4861-a583-406b02446ea0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:58 user nova-compute[73497]: DEBUG nova.compute.manager [req-65b1109f-1803-450e-99cd-5de6cb16d36a req-e26ed736-3412-4a7f-bcd7-f10b7312f99d service nova] [instance: b68b6975-a24a-4861-a583-406b02446ea0] No waiting events found dispatching network-vif-plugged-744f8df2-5712-4df4-a4e6-d7705b4d3cc7 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:16:58 user nova-compute[73497]: WARNING nova.compute.manager [req-65b1109f-1803-450e-99cd-5de6cb16d36a req-e26ed736-3412-4a7f-bcd7-f10b7312f99d service nova] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Received unexpected event network-vif-plugged-744f8df2-5712-4df4-a4e6-d7705b4d3cc7 for instance with vm_state building and task_state spawning.
Aug 26 23:16:58 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091818.3233657, b68b6975-a24a-4861-a583-406b02446ea0 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:16:58 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b68b6975-a24a-4861-a583-406b02446ea0] VM Resumed (Lifecycle Event)
Aug 26 23:16:58 user nova-compute[73497]: DEBUG nova.compute.manager [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:16:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:16:58 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Instance spawned successfully.
Aug 26 23:16:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:16:58 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:16:58 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:16:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:16:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:16:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:16:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:16:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:16:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:16:58 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b68b6975-a24a-4861-a583-406b02446ea0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:16:58 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091818.3248382, b68b6975-a24a-4861-a583-406b02446ea0 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:16:58 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b68b6975-a24a-4861-a583-406b02446ea0] VM Started (Lifecycle Event)
Aug 26 23:16:58 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:16:58 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:16:58 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b68b6975-a24a-4861-a583-406b02446ea0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:16:58 user nova-compute[73497]: INFO nova.compute.manager [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Took 6.57 seconds to spawn the instance on the hypervisor.
Aug 26 23:16:58 user nova-compute[73497]: DEBUG nova.compute.manager [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:16:58 user nova-compute[73497]: INFO nova.compute.manager [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Took 7.95 seconds to build instance.
Aug 26 23:16:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-7465bfdc-6f79-4272-a384-1c4d17b235dd tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "b68b6975-a24a-4861-a583-406b02446ea0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.131s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:16:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:05 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693091810.1137266, 865d6369-32ac-46ac-b6df-37d8fa4bf440 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:17:05 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] VM Stopped (Lifecycle Event)
Aug 26 23:17:05 user nova-compute[73497]: DEBUG nova.compute.manager [None req-cd026b1f-12dd-49aa-afb2-51aff1250efc None None] [instance: 865d6369-32ac-46ac-b6df-37d8fa4bf440] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:17:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:30 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9aa92039-e5d8-429e-b359-b97920a556fe tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Acquiring lock "ab745e33-a11e-4ee4-a442-1e7893448d27" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:17:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9aa92039-e5d8-429e-b359-b97920a556fe tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Lock "ab745e33-a11e-4ee4-a442-1e7893448d27" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:17:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9aa92039-e5d8-429e-b359-b97920a556fe tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Acquiring lock "ab745e33-a11e-4ee4-a442-1e7893448d27-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:17:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9aa92039-e5d8-429e-b359-b97920a556fe tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Lock "ab745e33-a11e-4ee4-a442-1e7893448d27-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:17:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9aa92039-e5d8-429e-b359-b97920a556fe tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Lock "ab745e33-a11e-4ee4-a442-1e7893448d27-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:17:39 user nova-compute[73497]: INFO nova.compute.manager [None req-9aa92039-e5d8-429e-b359-b97920a556fe tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Terminating instance
Aug 26 23:17:39 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9aa92039-e5d8-429e-b359-b97920a556fe tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:17:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:39 user nova-compute[73497]: DEBUG nova.compute.manager [req-8dafc367-4436-4712-a153-757e0dcbf2d0 req-cd23d0f9-3356-4f7f-adbc-97fdac047ef2 service nova] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Received event network-vif-unplugged-227712b4-3763-41dd-ab89-b42888471e7d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:17:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8dafc367-4436-4712-a153-757e0dcbf2d0 req-cd23d0f9-3356-4f7f-adbc-97fdac047ef2 service nova] Acquiring lock "ab745e33-a11e-4ee4-a442-1e7893448d27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:17:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8dafc367-4436-4712-a153-757e0dcbf2d0 req-cd23d0f9-3356-4f7f-adbc-97fdac047ef2 service nova] Lock "ab745e33-a11e-4ee4-a442-1e7893448d27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:17:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8dafc367-4436-4712-a153-757e0dcbf2d0 req-cd23d0f9-3356-4f7f-adbc-97fdac047ef2 service nova] Lock "ab745e33-a11e-4ee4-a442-1e7893448d27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:17:39 user nova-compute[73497]: DEBUG nova.compute.manager [req-8dafc367-4436-4712-a153-757e0dcbf2d0 req-cd23d0f9-3356-4f7f-adbc-97fdac047ef2 service nova] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] No waiting events found dispatching network-vif-unplugged-227712b4-3763-41dd-ab89-b42888471e7d {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:17:39 user nova-compute[73497]: DEBUG nova.compute.manager [req-8dafc367-4436-4712-a153-757e0dcbf2d0 req-cd23d0f9-3356-4f7f-adbc-97fdac047ef2 service nova] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Received event network-vif-unplugged-227712b4-3763-41dd-ab89-b42888471e7d for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:17:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:39 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Instance destroyed successfully.
Aug 26 23:17:39 user nova-compute[73497]: DEBUG nova.objects.instance [None req-9aa92039-e5d8-429e-b359-b97920a556fe tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Lazy-loading 'resources' on Instance uuid ab745e33-a11e-4ee4-a442-1e7893448d27 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:17:39 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-9aa92039-e5d8-429e-b359-b97920a556fe tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:13:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-920335000',display_name='tempest-TestVolumeSwap-server-920335000',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-920335000',id=8,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmo/S9wbuYPbStOUG13fAoNZNonxRNeLxjpw3lZeN/u7axEJtyRoDbSWqIXHpCJvLb54/pRAaSUiG6bnxcSae/huXThCTMh68URDqByQ0AIvjhhyzwWwcxIEtyE99YWqA==',key_name='tempest-keypair-1523273356',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:13:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b86400102fe46bea973847594aeb2f3',ramdisk_id='',reservation_id='r-a1ks8u97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-917824940',owner_user_name='tempest-TestVolumeSwap-917824940-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:13:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4acb42d22b640f09a1090d895f78dfc',uuid=ab745e33-a11e-4ee4-a442-1e7893448d27,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "227712b4-3763-41dd-ab89-b42888471e7d", "address": "fa:16:3e:bc:5b:4b", "network": {"id": "d4bf6de0-149b-43b1-904c-1c0bcaa629f4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1964773456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b86400102fe46bea973847594aeb2f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap227712b4-37", "ovs_interfaceid": "227712b4-3763-41dd-ab89-b42888471e7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:17:39 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-9aa92039-e5d8-429e-b359-b97920a556fe tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Converting VIF {"id": "227712b4-3763-41dd-ab89-b42888471e7d", "address": "fa:16:3e:bc:5b:4b", "network": {"id": "d4bf6de0-149b-43b1-904c-1c0bcaa629f4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1964773456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b86400102fe46bea973847594aeb2f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap227712b4-37", "ovs_interfaceid": "227712b4-3763-41dd-ab89-b42888471e7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:17:39 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-9aa92039-e5d8-429e-b359-b97920a556fe tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:5b:4b,bridge_name='br-int',has_traffic_filtering=True,id=227712b4-3763-41dd-ab89-b42888471e7d,network=Network(d4bf6de0-149b-43b1-904c-1c0bcaa629f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap227712b4-37') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:17:40 user nova-compute[73497]: DEBUG os_vif [None req-9aa92039-e5d8-429e-b359-b97920a556fe tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:5b:4b,bridge_name='br-int',has_traffic_filtering=True,id=227712b4-3763-41dd-ab89-b42888471e7d,network=Network(d4bf6de0-149b-43b1-904c-1c0bcaa629f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap227712b4-37') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:17:40 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:40 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap227712b4-37, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:17:40 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:40 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:40 user nova-compute[73497]: INFO os_vif [None req-9aa92039-e5d8-429e-b359-b97920a556fe tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:5b:4b,bridge_name='br-int',has_traffic_filtering=True,id=227712b4-3763-41dd-ab89-b42888471e7d,network=Network(d4bf6de0-149b-43b1-904c-1c0bcaa629f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap227712b4-37')
Aug 26 23:17:40 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-9aa92039-e5d8-429e-b359-b97920a556fe tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Deleting instance files /opt/stack/data/nova/instances/ab745e33-a11e-4ee4-a442-1e7893448d27_del
Aug 26 23:17:40 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-9aa92039-e5d8-429e-b359-b97920a556fe tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Deletion of /opt/stack/data/nova/instances/ab745e33-a11e-4ee4-a442-1e7893448d27_del complete
Aug 26 23:17:40 user nova-compute[73497]: INFO nova.compute.manager [None req-9aa92039-e5d8-429e-b359-b97920a556fe tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 26 23:17:40 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-9aa92039-e5d8-429e-b359-b97920a556fe tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:17:40 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:17:40 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:17:41 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:17:41 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Took 1.37 seconds to deallocate network for instance.
Aug 26 23:17:41 user nova-compute[73497]: DEBUG nova.compute.manager [req-7b67217f-4a05-4137-873a-57f53773d681 req-aeb6df12-87dc-4845-a02f-cded8becc0a3 service nova] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Received event network-vif-deleted-227712b4-3763-41dd-ab89-b42888471e7d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:17:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9aa92039-e5d8-429e-b359-b97920a556fe tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:17:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9aa92039-e5d8-429e-b359-b97920a556fe tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:17:41 user nova-compute[73497]: DEBUG nova.compute.manager [req-78d970ca-8f38-4ae9-bd1e-faaecdcb8ae1 req-daea0d28-b009-4e59-93e7-9ee98b8dc27d service nova] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Received event network-vif-plugged-227712b4-3763-41dd-ab89-b42888471e7d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:17:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-78d970ca-8f38-4ae9-bd1e-faaecdcb8ae1 req-daea0d28-b009-4e59-93e7-9ee98b8dc27d service nova] Acquiring lock "ab745e33-a11e-4ee4-a442-1e7893448d27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:17:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-78d970ca-8f38-4ae9-bd1e-faaecdcb8ae1 req-daea0d28-b009-4e59-93e7-9ee98b8dc27d service nova] Lock "ab745e33-a11e-4ee4-a442-1e7893448d27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:17:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-78d970ca-8f38-4ae9-bd1e-faaecdcb8ae1 req-daea0d28-b009-4e59-93e7-9ee98b8dc27d service nova] Lock "ab745e33-a11e-4ee4-a442-1e7893448d27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:17:41 user nova-compute[73497]: DEBUG nova.compute.manager [req-78d970ca-8f38-4ae9-bd1e-faaecdcb8ae1 req-daea0d28-b009-4e59-93e7-9ee98b8dc27d service nova] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] No waiting events found dispatching network-vif-plugged-227712b4-3763-41dd-ab89-b42888471e7d {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:17:41 user nova-compute[73497]: WARNING nova.compute.manager [req-78d970ca-8f38-4ae9-bd1e-faaecdcb8ae1 req-daea0d28-b009-4e59-93e7-9ee98b8dc27d service nova] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Received unexpected event network-vif-plugged-227712b4-3763-41dd-ab89-b42888471e7d for instance with vm_state deleted and task_state None.
Aug 26 23:17:41 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-9aa92039-e5d8-429e-b359-b97920a556fe tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:17:41 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-9aa92039-e5d8-429e-b359-b97920a556fe tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:17:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9aa92039-e5d8-429e-b359-b97920a556fe tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:17:41 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-9aa92039-e5d8-429e-b359-b97920a556fe tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Deleted allocations for instance ab745e33-a11e-4ee4-a442-1e7893448d27
Aug 26 23:17:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9aa92039-e5d8-429e-b359-b97920a556fe tempest-TestVolumeSwap-917824940 tempest-TestVolumeSwap-917824940-project-member] Lock "ab745e33-a11e-4ee4-a442-1e7893448d27" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.794s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:17:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Acquiring lock "62f841d2-09e7-448b-8c1c-26c824c473ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:17:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Lock "62f841d2-09e7-448b-8c1c-26c824c473ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:17:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Acquiring lock "62f841d2-09e7-448b-8c1c-26c824c473ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:17:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Lock "62f841d2-09e7-448b-8c1c-26c824c473ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:17:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Lock "62f841d2-09e7-448b-8c1c-26c824c473ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:17:42 user nova-compute[73497]: INFO nova.compute.manager [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Terminating instance
Aug 26 23:17:42 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:17:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:42 user nova-compute[73497]: DEBUG nova.compute.manager [req-1a1d8006-3815-4664-bfa4-5b0dcb2fd979 req-86b14971-79d3-4ae2-b498-4b50426b0af1 service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Received event network-vif-unplugged-ea0c8f3c-1937-4d8c-968a-21a620ff5f7d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:17:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1a1d8006-3815-4664-bfa4-5b0dcb2fd979 req-86b14971-79d3-4ae2-b498-4b50426b0af1 service nova] Acquiring lock "62f841d2-09e7-448b-8c1c-26c824c473ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:17:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1a1d8006-3815-4664-bfa4-5b0dcb2fd979 req-86b14971-79d3-4ae2-b498-4b50426b0af1 service nova] Lock "62f841d2-09e7-448b-8c1c-26c824c473ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:17:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1a1d8006-3815-4664-bfa4-5b0dcb2fd979 req-86b14971-79d3-4ae2-b498-4b50426b0af1 service nova] Lock "62f841d2-09e7-448b-8c1c-26c824c473ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:17:42 user nova-compute[73497]: DEBUG nova.compute.manager [req-1a1d8006-3815-4664-bfa4-5b0dcb2fd979 req-86b14971-79d3-4ae2-b498-4b50426b0af1 service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] No waiting events found dispatching network-vif-unplugged-ea0c8f3c-1937-4d8c-968a-21a620ff5f7d {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:17:42 user nova-compute[73497]: DEBUG nova.compute.manager [req-1a1d8006-3815-4664-bfa4-5b0dcb2fd979 req-86b14971-79d3-4ae2-b498-4b50426b0af1 service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Received event network-vif-unplugged-ea0c8f3c-1937-4d8c-968a-21a620ff5f7d for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:17:43 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Instance destroyed successfully.
Aug 26 23:17:43 user nova-compute[73497]: DEBUG nova.objects.instance [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Lazy-loading 'resources' on Instance uuid 62f841d2-09e7-448b-8c1c-26c824c473ba {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T23:13:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-766701757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-474747102',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByjF8J1FTf4Yf+f0bhNilYywxbVc7jA9buhoEIOCxGzdOlcDHyYAz+iC83msNEYmiVpBnhhT5cv+65/WSDDw63y6W9k4x8IST6h+KDUrN39XmHZzLFbe/p/7dgfn+8+iA==',key_name='tempest-keypair-1496592320',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:16:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02a6bf8d596b4695a60e15661fd18352',ramdisk_id='',reservation_id='r-lyo5f7oa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1814198428',owner_user_name='tempest-ServerActionsV293TestJSON-1814198428-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:16:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c6bce6dad6f4c1092286fa122e6ed74',uuid=62f841d2-09e7-448b-8c1c-26c824c473ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea0c8f3c-1937-4d8c-968a-21a620ff5f7d", "address": "fa:16:3e:34:77:60", "network": {"id": "52dfb1fe-f560-4f40-8594-3b13d3ff06d9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2040079808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a6bf8d596b4695a60e15661fd18352", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0c8f3c-19", "ovs_interfaceid": "ea0c8f3c-1937-4d8c-968a-21a620ff5f7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Converting VIF {"id": "ea0c8f3c-1937-4d8c-968a-21a620ff5f7d", "address": "fa:16:3e:34:77:60", "network": {"id": "52dfb1fe-f560-4f40-8594-3b13d3ff06d9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2040079808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a6bf8d596b4695a60e15661fd18352", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0c8f3c-19", "ovs_interfaceid": "ea0c8f3c-1937-4d8c-968a-21a620ff5f7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:77:60,bridge_name='br-int',has_traffic_filtering=True,id=ea0c8f3c-1937-4d8c-968a-21a620ff5f7d,network=Network(52dfb1fe-f560-4f40-8594-3b13d3ff06d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0c8f3c-19') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG os_vif [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:77:60,bridge_name='br-int',has_traffic_filtering=True,id=ea0c8f3c-1937-4d8c-968a-21a620ff5f7d,network=Network(52dfb1fe-f560-4f40-8594-3b13d3ff06d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0c8f3c-19') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea0c8f3c-19, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:43 user nova-compute[73497]: INFO os_vif [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:77:60,bridge_name='br-int',has_traffic_filtering=True,id=ea0c8f3c-1937-4d8c-968a-21a620ff5f7d,network=Network(52dfb1fe-f560-4f40-8594-3b13d3ff06d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0c8f3c-19')
Aug 26 23:17:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ONHTIbKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:17:43 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:17:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b867d48-2615-4e10-a89b-fa664006cf3e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[37faf19b-69fb-452a-bd6f-bf2630a1d379]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:17:43 user nova-compute[73497]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:17:43 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:17:43 user nova-compute[73497]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a (non-flash)
Aug 26 23:17:43 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281c5e0550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a'): ({'sdd'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Removing single pathed devices sdd {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc87bef-a228-486a-bcef-8e6da601b046]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4ef62f-6a41-4005-958e-a85e2ed7f7e6]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Flushing IO for device /dev/sdd {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79dff91-2316-4722-aae6-01f13dbe4449]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1edaa1e8-c741-4f80-8489-96766b82b70d]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] SCSI volumes sdd have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23239343032323433', '/dev/disk/by-id/scsi-1SCST_BIOc88019dc-294022434868fec0', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c88019dc') {{(pid=84617) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e48783-ffc3-4005-ae65-53463bb41806]: (4, None) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a5d397-e9fc-4a8f-a815-bc1024312fb8]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b59e56d-94bb-49b9-9f98-0db740a01767]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a, portal: 172.16.0.220,3260]
Aug 26 23:17:43 user nova-compute[73497]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a, portal: 172.16.0.220,3260] successful.
Aug 26 23:17:43 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fb2814e-8af9-455e-aaba-faa885d49a3a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0892c1-3bf5-49b9-9666-37beaab177e4]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] <== disconnect_volume: return (298ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:17:43 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Deleting instance files /opt/stack/data/nova/instances/62f841d2-09e7-448b-8c1c-26c824c473ba_del
Aug 26 23:17:43 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Deletion of /opt/stack/data/nova/instances/62f841d2-09e7-448b-8c1c-26c824c473ba_del complete
Aug 26 23:17:43 user nova-compute[73497]: INFO nova.compute.manager [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 26 23:17:43 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:17:43 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:17:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:45 user nova-compute[73497]: DEBUG nova.compute.manager [req-94de2592-4e16-4482-9891-153f4419d137 req-4314868d-3100-434e-b53d-149e741bac7e service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Received event network-vif-plugged-ea0c8f3c-1937-4d8c-968a-21a620ff5f7d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:17:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-94de2592-4e16-4482-9891-153f4419d137 req-4314868d-3100-434e-b53d-149e741bac7e service nova] Acquiring lock "62f841d2-09e7-448b-8c1c-26c824c473ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:17:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-94de2592-4e16-4482-9891-153f4419d137 req-4314868d-3100-434e-b53d-149e741bac7e service nova] Lock "62f841d2-09e7-448b-8c1c-26c824c473ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:17:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-94de2592-4e16-4482-9891-153f4419d137 req-4314868d-3100-434e-b53d-149e741bac7e service nova] Lock "62f841d2-09e7-448b-8c1c-26c824c473ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:17:45 user nova-compute[73497]: DEBUG nova.compute.manager [req-94de2592-4e16-4482-9891-153f4419d137 req-4314868d-3100-434e-b53d-149e741bac7e service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] No waiting events found dispatching network-vif-plugged-ea0c8f3c-1937-4d8c-968a-21a620ff5f7d {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:17:45 user nova-compute[73497]: WARNING nova.compute.manager [req-94de2592-4e16-4482-9891-153f4419d137 req-4314868d-3100-434e-b53d-149e741bac7e service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Received unexpected event network-vif-plugged-ea0c8f3c-1937-4d8c-968a-21a620ff5f7d for instance with vm_state active and task_state deleting.
Aug 26 23:17:45 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:17:45 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Took 2.00 seconds to deallocate network for instance.
Aug 26 23:17:45 user nova-compute[73497]: DEBUG nova.compute.manager [req-88ca0535-7681-4dec-a204-38bf03848cbc req-ff03701d-f93f-4424-85fd-7c774676dd5f service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Received event network-vif-deleted-ea0c8f3c-1937-4d8c-968a-21a620ff5f7d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:17:45 user nova-compute[73497]: INFO nova.compute.manager [req-88ca0535-7681-4dec-a204-38bf03848cbc req-ff03701d-f93f-4424-85fd-7c774676dd5f service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Neutron deleted interface ea0c8f3c-1937-4d8c-968a-21a620ff5f7d; detaching it from the instance and deleting it from the info cache
Aug 26 23:17:45 user nova-compute[73497]: DEBUG nova.network.neutron [req-88ca0535-7681-4dec-a204-38bf03848cbc req-ff03701d-f93f-4424-85fd-7c774676dd5f service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:17:45 user nova-compute[73497]: DEBUG nova.compute.manager [req-88ca0535-7681-4dec-a204-38bf03848cbc req-ff03701d-f93f-4424-85fd-7c774676dd5f service nova] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Detach interface failed, port_id=ea0c8f3c-1937-4d8c-968a-21a620ff5f7d, reason: Instance 62f841d2-09e7-448b-8c1c-26c824c473ba could not be found. {{(pid=73497) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 23:17:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:46 user nova-compute[73497]: INFO nova.compute.manager [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Took 0.98 seconds to detach 1 volumes for instance.
Aug 26 23:17:46 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Deleting volume: 2fb2814e-8af9-455e-aaba-faa885d49a3a {{(pid=73497) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 23:17:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:17:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:17:46 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:17:46 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:17:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:17:46 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Deleted allocations for instance 62f841d2-09e7-448b-8c1c-26c824c473ba
Aug 26 23:17:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:47 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4717164b-a3fa-4746-91bb-0af85136c50a tempest-ServerActionsV293TestJSON-1814198428 tempest-ServerActionsV293TestJSON-1814198428-project-member] Lock "62f841d2-09e7-448b-8c1c-26c824c473ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.780s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:17:48 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:48 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:17:48 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:17:48 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:17:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:17:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:17:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:17:48 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:17:48 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:48 user nova-compute[73497]: INFO nova.compute.manager [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Rescuing
Aug 26 23:17:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "refresh_cache-aebaeda6-23d1-43a1-afc8-bdc8992067e5" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:17:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquired lock "refresh_cache-aebaeda6-23d1-43a1-afc8-bdc8992067e5" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:17:48 user nova-compute[73497]: DEBUG nova.network.neutron [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:17:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:17:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:17:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:17:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:17:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:17:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:17:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:17:49 user nova-compute[73497]: DEBUG nova.network.neutron [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Updating instance_info_cache with network_info: [{"id": "2fdb126c-c800-488a-9879-08a65e646325", "address": "fa:16:3e:e0:28:c4", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fdb126c-c8", "ovs_interfaceid": "2fdb126c-c800-488a-9879-08a65e646325", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:17:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Releasing lock "refresh_cache-aebaeda6-23d1-43a1-afc8-bdc8992067e5" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:17:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:17:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:17:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:17:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:17:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:17:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:17:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:17:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:17:50 user nova-compute[73497]: DEBUG nova.compute.manager [req-d9838d00-b460-4ef2-96e5-c09203d81ccb req-7660a9e4-58d8-4c88-a510-59b210886986 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Received event network-vif-unplugged-2fdb126c-c800-488a-9879-08a65e646325 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:17:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d9838d00-b460-4ef2-96e5-c09203d81ccb req-7660a9e4-58d8-4c88-a510-59b210886986 service nova] Acquiring lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:17:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d9838d00-b460-4ef2-96e5-c09203d81ccb req-7660a9e4-58d8-4c88-a510-59b210886986 service nova] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:17:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d9838d00-b460-4ef2-96e5-c09203d81ccb req-7660a9e4-58d8-4c88-a510-59b210886986 service nova] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:17:50 user nova-compute[73497]: DEBUG nova.compute.manager [req-d9838d00-b460-4ef2-96e5-c09203d81ccb req-7660a9e4-58d8-4c88-a510-59b210886986 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] No waiting events found dispatching network-vif-unplugged-2fdb126c-c800-488a-9879-08a65e646325 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:17:50 user nova-compute[73497]: WARNING nova.compute.manager [req-d9838d00-b460-4ef2-96e5-c09203d81ccb req-7660a9e4-58d8-4c88-a510-59b210886986 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Received unexpected event network-vif-unplugged-2fdb126c-c800-488a-9879-08a65e646325 for instance with vm_state active and task_state rescuing.
Aug 26 23:17:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:17:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:17:50 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Instance destroyed successfully.
Aug 26 23:17:50 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Attempting a stable device rescue
Aug 26 23:17:50 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73497) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 23:17:50 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Instance directory exists: not creating {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 23:17:50 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Creating image(s)
Aug 26 23:17:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "/opt/stack/data/nova/instances/aebaeda6-23d1-43a1-afc8-bdc8992067e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:17:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "/opt/stack/data/nova/instances/aebaeda6-23d1-43a1-afc8-bdc8992067e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:17:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "/opt/stack/data/nova/instances/aebaeda6-23d1-43a1-afc8-bdc8992067e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:17:50 user nova-compute[73497]: DEBUG nova.objects.instance [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lazy-loading 'trusted_certs' on Instance uuid aebaeda6-23d1-43a1-afc8-bdc8992067e5 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:17:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "7318ea1cb0483324ccf7b626ca52f289b79cb0d7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:17:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "7318ea1cb0483324ccf7b626ca52f289b79cb0d7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.003s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:17:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:17:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:17:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7318ea1cb0483324ccf7b626ca52f289b79cb0d7.part --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:17:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json" returned: 0 in 1.065s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:17:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:17:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7318ea1cb0483324ccf7b626ca52f289b79cb0d7.part --force-share --output=json" returned: 0 in 0.206s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:17:51 user nova-compute[73497]: DEBUG nova.virt.images [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] 945250b1-2db5-4027-9c0d-c93d7c0ace7b was qcow2, converting to raw {{(pid=73497) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 23:17:51 user nova-compute[73497]: DEBUG nova.privsep.utils [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73497) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 23:17:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7318ea1cb0483324ccf7b626ca52f289b79cb0d7.part /opt/stack/data/nova/instances/_base/7318ea1cb0483324ccf7b626ca52f289b79cb0d7.converted {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:17:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:17:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:17:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:17:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19ccf77-8c30-44af-bd19-9b879fa60942/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:17:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7318ea1cb0483324ccf7b626ca52f289b79cb0d7.part /opt/stack/data/nova/instances/_base/7318ea1cb0483324ccf7b626ca52f289b79cb0d7.converted" returned: 0 in 0.437s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:17:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7318ea1cb0483324ccf7b626ca52f289b79cb0d7.converted --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:17:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19ccf77-8c30-44af-bd19-9b879fa60942/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:17:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19ccf77-8c30-44af-bd19-9b879fa60942/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:17:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7318ea1cb0483324ccf7b626ca52f289b79cb0d7.converted --force-share --output=json" returned: 0 in 0.193s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:17:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "7318ea1cb0483324ccf7b626ca52f289b79cb0d7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.912s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:17:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "7318ea1cb0483324ccf7b626ca52f289b79cb0d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:17:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "7318ea1cb0483324ccf7b626ca52f289b79cb0d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:17:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7318ea1cb0483324ccf7b626ca52f289b79cb0d7 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:17:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19ccf77-8c30-44af-bd19-9b879fa60942/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:17:52 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:17:52 user nova-compute[73497]: DEBUG nova.compute.manager [req-64ec5033-183d-4fb9-b38e-fe4d02204816 req-731d479d-7c3a-4cb8-a48d-d43f49850000 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Received event network-vif-plugged-2fdb126c-c800-488a-9879-08a65e646325 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:17:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-64ec5033-183d-4fb9-b38e-fe4d02204816 req-731d479d-7c3a-4cb8-a48d-d43f49850000 service nova] Acquiring lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:17:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-64ec5033-183d-4fb9-b38e-fe4d02204816 req-731d479d-7c3a-4cb8-a48d-d43f49850000 service nova] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:17:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-64ec5033-183d-4fb9-b38e-fe4d02204816 req-731d479d-7c3a-4cb8-a48d-d43f49850000 service nova] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:17:52 user nova-compute[73497]: DEBUG nova.compute.manager [req-64ec5033-183d-4fb9-b38e-fe4d02204816 req-731d479d-7c3a-4cb8-a48d-d43f49850000 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] No waiting events found dispatching network-vif-plugged-2fdb126c-c800-488a-9879-08a65e646325 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:17:52 user nova-compute[73497]: WARNING nova.compute.manager [req-64ec5033-183d-4fb9-b38e-fe4d02204816 req-731d479d-7c3a-4cb8-a48d-d43f49850000 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Received unexpected event network-vif-plugged-2fdb126c-c800-488a-9879-08a65e646325 for instance with vm_state active and task_state rescuing.
Aug 26 23:17:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7318ea1cb0483324ccf7b626ca52f289b79cb0d7 --force-share --output=json" returned: 0 in 0.637s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:17:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7318ea1cb0483324ccf7b626ca52f289b79cb0d7,backing_fmt=raw /opt/stack/data/nova/instances/aebaeda6-23d1-43a1-afc8-bdc8992067e5/disk.rescue {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:17:52 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:17:52 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:17:52 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=7816MB free_disk=25.52109146118164GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:17:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:17:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:17:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7318ea1cb0483324ccf7b626ca52f289b79cb0d7,backing_fmt=raw /opt/stack/data/nova/instances/aebaeda6-23d1-43a1-afc8-bdc8992067e5/disk.rescue" returned: 0 in 0.049s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:17:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "7318ea1cb0483324ccf7b626ca52f289b79cb0d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.690s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:17:52 user nova-compute[73497]: DEBUG nova.objects.instance [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lazy-loading 'migration_context' on Instance uuid aebaeda6-23d1-43a1-afc8-bdc8992067e5 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:17:52 user nova-compute[73497]: DEBUG nova.objects.base [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Object Instance<aebaeda6-23d1-43a1-afc8-bdc8992067e5> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:17:52 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:17:52 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Start _get_guest_xml network_info=[{"id": "2fdb126c-c800-488a-9879-08a65e646325", "address": "fa:16:3e:e0:28:c4", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "vif_mac": "fa:16:3e:e0:28:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fdb126c-c8", "ovs_interfaceid": "2fdb126c-c800-488a-9879-08a65e646325", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '945250b1-2db5-4027-9c0d-c93d7c0ace7b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '31f5b467-a336-4adb-a56d-11eb7f0055d7', 'guest_format': None, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nrOEmVhU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'aebaeda6-23d1-43a1-afc8-bdc8992067e5', 'attached_at': '', 'detached_at': '', 'volume_id': '8c797b7d-2462-4a35-9c56-b07c78e085d2', 'serial': '8c797b7d-2462-4a35-9c56-b07c78e085d2'}, 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:17:52 user nova-compute[73497]: DEBUG nova.objects.instance [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lazy-loading 'resources' on Instance uuid aebaeda6-23d1-43a1-afc8-bdc8992067e5 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:17:52 user nova-compute[73497]: DEBUG nova.objects.base [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Object Instance<aebaeda6-23d1-43a1-afc8-bdc8992067e5> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:17:52 user nova-compute[73497]: DEBUG nova.objects.instance [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lazy-loading 'numa_topology' on Instance uuid aebaeda6-23d1-43a1-afc8-bdc8992067e5 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:17:52 user nova-compute[73497]: DEBUG nova.objects.base [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Object Instance<aebaeda6-23d1-43a1-afc8-bdc8992067e5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:17:52 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:17:52 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.objects.instance [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lazy-loading 'vcpu_model' on Instance uuid aebaeda6-23d1-43a1-afc8-bdc8992067e5 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 926f8e5c-8d8a-4f07-bf08-e60700ce4698 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 994093f0-e6b2-4c96-b259-c559ef2b1fbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 171985a3-358d-4b26-a66c-372b9b99b386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 1a58c5e7-b4c7-4bd5-8dd1-a98492139240 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance aebaeda6-23d1-43a1-afc8-bdc8992067e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance ee6283d5-40de-432d-997c-0be52ff673ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance a19ccf77-8c30-44af-bd19-9b879fa60942 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance b68b6975-a24a-4861-a583-406b02446ea0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.objects.base [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Object Instance<aebaeda6-23d1-43a1-afc8-bdc8992067e5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nrOEmVhU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:17:53 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:17:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:17:53 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:17:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:17:53 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:17:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea1e966-eaec-42f9-9874-5d62fbbf15fc]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = nrOEmVhU\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 26 23:17:53 user nova-compute[73497]: node.name = iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2
Aug 26 23:17:53 user nova-compute[73497]: node.tpgt = -1
Aug 26 23:17:53 user nova-compute[73497]: node.startup = automatic
Aug 26 23:17:53 user nova-compute[73497]: node.leading_login = No
Aug 26 23:17:53 user nova-compute[73497]: iface.iscsi_ifacename = default
Aug 26 23:17:53 user nova-compute[73497]: iface.net_ifacename = <empty>
Aug 26 23:17:53 user nova-compute[73497]: iface.ipaddress = <empty>
Aug 26 23:17:53 user nova-compute[73497]: iface.prefix_len = 0
Aug 26 23:17:53 user nova-compute[73497]: iface.hwaddress = <empty>
Aug 26 23:17:53 user nova-compute[73497]: iface.transport_name = tcp
Aug 26 23:17:53 user nova-compute[73497]: iface.initiatorname = <empty>
Aug 26 23:17:53 user nova-compute[73497]: iface.state = <empty>
Aug 26 23:17:53 user nova-compute[73497]: iface.vlan_id = 0
Aug 26 23:17:53 user nova-compute[73497]: iface.vlan_priority = 0
Aug 26 23:17:53 user nova-compute[73497]: iface.vlan_state = <empty>
Aug 26 23:17:53 user nova-compute[73497]: iface.iface_num = 0
Aug 26 23:17:53 user nova-compute[73497]: iface.mtu = 0
Aug 26 23:17:53 user nova-compute[73497]: iface.port = 0
Aug 26 23:17:53 user nova-compute[73497]: iface.bootproto = <empty>
Aug 26 23:17:53 user nova-compute[73497]: iface.subnet_mask = <empty>
Aug 26 23:17:53 user nova-compute[73497]: iface.gateway = <empty>
Aug 26 23:17:53 user nova-compute[73497]: iface.dhcp_alt_client_id_state = <empty>
Aug 26 23:17:53 user nova-compute[73497]: iface.dhcp_alt_client_id = <empty>
Aug 26 23:17:53 user nova-compute[73497]: iface.dhcp_dns = <empty>
Aug 26 23:17:53 user nova-compute[73497]: iface.dhcp_learn_iqn = <empty>
Aug 26 23:17:53 user nova-compute[73497]: iface.dhcp_req_vendor_id_state = <empty>
Aug 26 23:17:53 user nova-compute[73497]: iface.dhcp_vendor_id_state = <empty>
Aug 26 23:17:53 user nova-compute[73497]: iface.dhcp_vendor_id = <empty>
Aug 26 23:17:53 user nova-compute[73497]: iface.dhcp_slp_da = <empty>
Aug 26 23:17:53 user nova-compute[73497]: iface.fragmentation = <empty>
Aug 26 23:17:53 user nova-compute[73497]: iface.gratuitous_arp = <empty>
Aug 26 23:17:53 user nova-compute[73497]: iface.incoming_forwarding = <empty>
Aug 26 23:17:53 user nova-compute[73497]: iface.tos_state = <empty>
Aug 26 23:17:53 user nova-compute[73497]: iface.tos = 0
Aug 26 23:17:53 user nova-compute[73497]: iface.ttl = 0
Aug 26 23:17:53 user nova-compute[73497]: iface.delayed_ack = <empty>
Aug 26 23:17:53 user nova-compute[73497]: iface.tcp_nagle = <empty>
Aug 26 23:17:53 user nova-compute[73497]: iface.tcp_wsf_state = <empty>
Aug 26 23:17:53 user nova-compute[73497]: iface.tcp_wsf = 0
Aug 26 23:17:53 user nova-compute[73497]: iface.tcp_timer_scale = 0
Aug 26 23:17:53 user nova-compute[73497]: iface.tcp_timestamp = <empty>
Aug 26 23:17:53 user nova-compute[73497]: iface.redirect = <empty>
Aug 26 23:17:53 user nova-compute[73497]: iface.def_task_mgmt_timeout = 0
Aug 26 23:17:53 user nova-compute[73497]: iface.header_digest = <empty>
Aug 26 23:17:53 user nova-compute[73497]: iface.data_digest = <empty>
Aug 26 23:17:53 user nova-compute[73497]: iface.immediate_data = <empty>
Aug 26 23:17:53 user nova-compute[73497]: iface.initial_r2t = <empty>
Aug 26 23:17:53 user nova-compute[73497]: iface.data_seq_inorder = <empty>
Aug 26 23:17:53 user nova-compute[73497]: iface.data_pdu_inorder = <empty>
Aug 26 23:17:53 user nova-compute[73497]: iface.erl = 0
Aug 26 23:17:53 user nova-compute[73497]: iface.max_receive_data_len = 0
Aug 26 23:17:53 user nova-compute[73497]: iface.first_burst_len = 0
Aug 26 23:17:53 user nova-compute[73497]: iface.max_outstanding_r2t = 0
Aug 26 23:17:53 user nova-compute[73497]: iface.max_burst_len = 0
Aug 26 23:17:53 user nova-compute[73497]: iface.chap_auth = <empty>
Aug 26 23:17:53 user nova-compute[73497]: iface.bidi_chap = <empty>
Aug 26 23:17:53 user nova-compute[73497]: iface.strict_login_compliance = <empty>
Aug 26 23:17:53 user nova-compute[73497]: iface.discovery_auth = <empty>
Aug 26 23:17:53 user nova-compute[73497]: iface.discovery_logout = <empty>
Aug 26 23:17:53 user nova-compute[73497]: node.discovery_address = <empty>
Aug 26 23:17:53 user nova-compute[73497]: node.discovery_port = 0
Aug 26 23:17:53 user nova-compute[73497]: node.discovery_type = static
Aug 26 23:17:53 user nova-compute[73497]: node.session.initial_cmdsn = 0
Aug 26 23:17:53 user nova-compute[73497]: node.session.initial_login_retry_max = 8
Aug 26 23:17:53 user nova-compute[73497]: node.session.xmit_thread_priority = -20
Aug 26 23:17:53 user nova-compute[73497]: node.session.cmds_max = 128
Aug 26 23:17:53 user nova-compute[73497]: node.session.queue_depth = 32
Aug 26 23:17:53 user nova-compute[73497]: node.session.nr_sessions = 1
Aug 26 23:17:53 user nova-compute[73497]: node.session.auth.authmethod = CHAP
Aug 26 23:17:53 user nova-compute[73497]: node.session.auth.username = nrOEmVhU
Aug 26 23:17:53 user nova-compute[73497]: node.session.auth.password = ***
Aug 26 23:17:53 user nova-compute[73497]: node.session.auth.username_in = <empty>
Aug 26 23:17:53 user nova-compute[73497]: node.session.auth.password_in = <empty>
Aug 26 23:17:53 user nova-compute[73497]: node.session.auth.chap_algs = MD5
Aug 26 23:17:53 user nova-compute[73497]: node.session.timeo.replacement_timeout = 120
Aug 26 23:17:53 user nova-compute[73497]: node.session.err_timeo.abort_timeout = 15
Aug 26 23:17:53 user nova-compute[73497]: node.session.err_timeo.lu_reset_timeout = 30
Aug 26 23:17:53 user nova-compute[73497]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 26 23:17:53 user nova-compute[73497]: node.session.err_timeo.host_reset_timeout = 60
Aug 26 23:17:53 user nova-compute[73497]: node.session.iscsi.FastAbort = Yes
Aug 26 23:17:53 user nova-compute[73497]: node.session.iscsi.InitialR2T = No
Aug 26 23:17:53 user nova-compute[73497]: node.session.iscsi.ImmediateData = Yes
Aug 26 23:17:53 user nova-compute[73497]: node.session.iscsi.FirstBurstLength = 262144
Aug 26 23:17:53 user nova-compute[73497]: node.session.iscsi.MaxBurstLength = 16776192
Aug 26 23:17:53 user nova-compute[73497]: node.session.iscsi.DefaultTime2Retain = 0
Aug 26 23:17:53 user nova-compute[73497]: node.session.iscsi.DefaultTime2Wait = 2
Aug 26 23:17:53 user nova-compute[73497]: node.session.iscsi.MaxConnections = 1
Aug 26 23:17:53 user nova-compute[73497]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 26 23:17:53 user nova-compute[73497]: node.session.iscsi.ERL = 0
Aug 26 23:17:53 user nova-compute[73497]: node.session.scan = manual
Aug 26 23:17:53 user nova-compute[73497]: node.session.reopen_max = 0
Aug 26 23:17:53 user nova-compute[73497]: node.conn[0].address = 172.16.0.220
Aug 26 23:17:53 user nova-compute[73497]: node.conn[0].port = 3260
Aug 26 23:17:53 user nova-compute[73497]: node.conn[0].startup = manual
Aug 26 23:17:53 user nova-compute[73497]: node.conn[0].tcp.window_size = 524288
Aug 26 23:17:53 user nova-compute[73497]: node.conn[0].tcp.type_of_service = 0
Aug 26 23:17:53 user nova-compute[73497]: node.conn[0].timeo.logout_timeout = 15
Aug 26 23:17:53 user nova-compute[73497]: node.conn[0].timeo.login_timeout = 15
Aug 26 23:17:53 user nova-compute[73497]: node.conn[0].timeo.auth_timeout = 45
Aug 26 23:17:53 user nova-compute[73497]: node.conn[0].timeo.noop_out_interval = 5
Aug 26 23:17:53 user nova-compute[73497]: node.conn[0].timeo.noop_out_timeout = 5
Aug 26 23:17:53 user nova-compute[73497]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 26 23:17:53 user nova-compute[73497]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 26 23:17:53 user nova-compute[73497]: node.conn[0].iscsi.HeaderDigest = None
Aug 26 23:17:53 user nova-compute[73497]: node.conn[0].iscsi.DataDigest = None
Aug 26 23:17:53 user nova-compute[73497]: node.conn[0].iscsi.IFMarker = No
Aug 26 23:17:53 user nova-compute[73497]: node.conn[0].iscsi.OFMarker = No
Aug 26 23:17:53 user nova-compute[73497]: # END RECORD
Aug 26 23:17:53 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[042996f1-ae6b-405d-b1bd-0efb828cfda9]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d353ce7-da6e-4583-9c58-97eba7607b94]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nrOEmVhU {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nrOEmVhU" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccf7848-2493-4fb0-849b-2460e0e4fccb]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nrOEmVhU'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[caeb6282-a18e-42c9-acbe-3b86810d582c]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67df54a-f38c-4b28-9377-e4b533907341]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:17:53 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:17:53 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.168s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] HCTL ('34', '0', '0', 0) found on session 11 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3296511a-57a2-4b24-8b7d-8ba6a2ef3e77]: (4, ('0 0 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Searching for a device in session 11 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nrOEmVhU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.197s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] <== connect_volume: return (198ms) {'type': 'block', 'scsi_wwn': '26262383063396566', 'path': '/dev/sdc'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262383063396566', 'path': '/dev/sdc'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1490878168',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1490878168',id=12,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:16:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ee8ef1c899342b38a624c1c28309d41',ramdisk_id='',reservation_id='r-92y3pmcv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1276656289',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:16:32Z,user_data=None,user_id='83005131fdc2411abe7a198157910743',uuid=aebaeda6-23d1-43a1-afc8-bdc8992067e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2fdb126c-c800-488a-9879-08a65e646325", "address": "fa:16:3e:e0:28:c4", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "vif_mac": "fa:16:3e:e0:28:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fdb126c-c8", "ovs_interfaceid": "2fdb126c-c800-488a-9879-08a65e646325", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Converting VIF {"id": "2fdb126c-c800-488a-9879-08a65e646325", "address": "fa:16:3e:e0:28:c4", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "vif_mac": "fa:16:3e:e0:28:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fdb126c-c8", "ovs_interfaceid": "2fdb126c-c800-488a-9879-08a65e646325", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:28:c4,bridge_name='br-int',has_traffic_filtering=True,id=2fdb126c-c800-488a-9879-08a65e646325,network=Network(f8ba0a6b-e4fc-4236-9df3-90ffab8824fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fdb126c-c8') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.objects.instance [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lazy-loading 'pci_devices' on Instance uuid aebaeda6-23d1-43a1-afc8-bdc8992067e5 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.objects.base [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Object Instance<aebaeda6-23d1-43a1-afc8-bdc8992067e5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:17:53 user nova-compute[73497]:   <uuid>aebaeda6-23d1-43a1-afc8-bdc8992067e5</uuid>
Aug 26 23:17:53 user nova-compute[73497]:   <name>instance-0000000c</name>
Aug 26 23:17:53 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:17:53 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:17:53 user nova-compute[73497]:   <metadata>
Aug 26 23:17:53 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:17:53 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:17:53 user nova-compute[73497]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1490878168</nova:name>
Aug 26 23:17:53 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:17:52</nova:creationTime>
Aug 26 23:17:53 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:17:53 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:17:53 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:17:53 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:17:53 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:17:53 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:17:53 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:17:53 user nova-compute[73497]:       <nova:owner>
Aug 26 23:17:53 user nova-compute[73497]:         <nova:user uuid="83005131fdc2411abe7a198157910743">tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member</nova:user>
Aug 26 23:17:53 user nova-compute[73497]:         <nova:project uuid="3ee8ef1c899342b38a624c1c28309d41">tempest-ServerBootFromVolumeStableRescueTest-1276656289</nova:project>
Aug 26 23:17:53 user nova-compute[73497]:       </nova:owner>
Aug 26 23:17:53 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:17:53 user nova-compute[73497]:       <nova:ports>
Aug 26 23:17:53 user nova-compute[73497]:         <nova:port uuid="2fdb126c-c800-488a-9879-08a65e646325">
Aug 26 23:17:53 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 23:17:53 user nova-compute[73497]:         </nova:port>
Aug 26 23:17:53 user nova-compute[73497]:       </nova:ports>
Aug 26 23:17:53 user nova-compute[73497]:     </nova:instance>
Aug 26 23:17:53 user nova-compute[73497]:   </metadata>
Aug 26 23:17:53 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:17:53 user nova-compute[73497]:     <system>
Aug 26 23:17:53 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:17:53 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:17:53 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:17:53 user nova-compute[73497]:       <entry name="serial">aebaeda6-23d1-43a1-afc8-bdc8992067e5</entry>
Aug 26 23:17:53 user nova-compute[73497]:       <entry name="uuid">aebaeda6-23d1-43a1-afc8-bdc8992067e5</entry>
Aug 26 23:17:53 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:17:53 user nova-compute[73497]:     </system>
Aug 26 23:17:53 user nova-compute[73497]:   </sysinfo>
Aug 26 23:17:53 user nova-compute[73497]:   <os>
Aug 26 23:17:53 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:17:53 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:17:53 user nova-compute[73497]:   </os>
Aug 26 23:17:53 user nova-compute[73497]:   <features>
Aug 26 23:17:53 user nova-compute[73497]:     <acpi/>
Aug 26 23:17:53 user nova-compute[73497]:     <apic/>
Aug 26 23:17:53 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:17:53 user nova-compute[73497]:   </features>
Aug 26 23:17:53 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:17:53 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:17:53 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:17:53 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:17:53 user nova-compute[73497]:   </clock>
Aug 26 23:17:53 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:17:53 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:17:53 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:17:53 user nova-compute[73497]:   </cpu>
Aug 26 23:17:53 user nova-compute[73497]:   <devices>
Aug 26 23:17:53 user nova-compute[73497]:     <disk type="block" device="disk">
Aug 26 23:17:53 user nova-compute[73497]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:17:53 user nova-compute[73497]:       <source dev="/dev/sdc"/>
Aug 26 23:17:53 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:17:53 user nova-compute[73497]:       <serial>8c797b7d-2462-4a35-9c56-b07c78e085d2</serial>
Aug 26 23:17:53 user nova-compute[73497]:     </disk>
Aug 26 23:17:53 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:17:53 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:17:53 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/aebaeda6-23d1-43a1-afc8-bdc8992067e5/disk.rescue"/>
Aug 26 23:17:53 user nova-compute[73497]:       <target dev="vdb" bus="virtio"/>
Aug 26 23:17:53 user nova-compute[73497]:       <boot order="1"/>
Aug 26 23:17:53 user nova-compute[73497]:     </disk>
Aug 26 23:17:53 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:17:53 user nova-compute[73497]:       <mac address="fa:16:3e:e0:28:c4"/>
Aug 26 23:17:53 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:17:53 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:17:53 user nova-compute[73497]:       <target dev="tap2fdb126c-c8"/>
Aug 26 23:17:53 user nova-compute[73497]:     </interface>
Aug 26 23:17:53 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:17:53 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/aebaeda6-23d1-43a1-afc8-bdc8992067e5/console.log" append="off"/>
Aug 26 23:17:53 user nova-compute[73497]:     </serial>
Aug 26 23:17:53 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:17:53 user nova-compute[73497]:     <video>
Aug 26 23:17:53 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:17:53 user nova-compute[73497]:     </video>
Aug 26 23:17:53 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:17:53 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:17:53 user nova-compute[73497]:     </rng>
Aug 26 23:17:53 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:17:53 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:17:53 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:17:53 user nova-compute[73497]:     </memballoon>
Aug 26 23:17:53 user nova-compute[73497]:   </devices>
Aug 26 23:17:53 user nova-compute[73497]: </domain>
Aug 26 23:17:53 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:17:53 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Instance destroyed successfully.
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.488s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:17:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] No VIF found with MAC fa:16:3e:e0:28:c4, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:17:54 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:17:54 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:17:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-1a58c5e7-b4c7-4bd5-8dd1-a98492139240" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:17:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-1a58c5e7-b4c7-4bd5-8dd1-a98492139240" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:17:54 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:17:54 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693091859.973641, ab745e33-a11e-4ee4-a442-1e7893448d27 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:17:54 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] VM Stopped (Lifecycle Event)
Aug 26 23:17:55 user nova-compute[73497]: DEBUG nova.compute.manager [None req-d90b91a5-a3f5-4008-aad4-a729775e41cf None None] [instance: ab745e33-a11e-4ee4-a442-1e7893448d27] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:17:55 user nova-compute[73497]: DEBUG nova.compute.manager [req-761354a9-c46d-4a26-a29e-789ea47b8dac req-8e8c0787-e9f5-42b1-97d9-c28352c075a5 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Received event network-vif-plugged-2fdb126c-c800-488a-9879-08a65e646325 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:17:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-761354a9-c46d-4a26-a29e-789ea47b8dac req-8e8c0787-e9f5-42b1-97d9-c28352c075a5 service nova] Acquiring lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:17:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-761354a9-c46d-4a26-a29e-789ea47b8dac req-8e8c0787-e9f5-42b1-97d9-c28352c075a5 service nova] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:17:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-761354a9-c46d-4a26-a29e-789ea47b8dac req-8e8c0787-e9f5-42b1-97d9-c28352c075a5 service nova] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:17:55 user nova-compute[73497]: DEBUG nova.compute.manager [req-761354a9-c46d-4a26-a29e-789ea47b8dac req-8e8c0787-e9f5-42b1-97d9-c28352c075a5 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] No waiting events found dispatching network-vif-plugged-2fdb126c-c800-488a-9879-08a65e646325 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:17:55 user nova-compute[73497]: WARNING nova.compute.manager [req-761354a9-c46d-4a26-a29e-789ea47b8dac req-8e8c0787-e9f5-42b1-97d9-c28352c075a5 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Received unexpected event network-vif-plugged-2fdb126c-c800-488a-9879-08a65e646325 for instance with vm_state active and task_state rescuing.
Aug 26 23:17:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:55 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Updating instance_info_cache with network_info: [{"id": "4ee7875d-cd17-4e1e-8b9c-962eaa271398", "address": "fa:16:3e:2b:48:b2", "network": {"id": "4eb3bf86-7f68-4a81-90f9-f34da6231d59", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-299898849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "546cdb5907fc494c94ea81cfcef71a28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee7875d-cd", "ovs_interfaceid": "4ee7875d-cd17-4e1e-8b9c-962eaa271398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:17:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-1a58c5e7-b4c7-4bd5-8dd1-a98492139240" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:17:55 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:17:55 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:17:55 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:17:55 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:17:55 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:17:55 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:17:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:56 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:17:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:57 user nova-compute[73497]: DEBUG nova.compute.manager [req-574068e2-d510-4275-a0f8-426b8dd38e98 req-a59e8a01-357b-4452-9628-189f98d281b6 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Received event network-vif-plugged-2fdb126c-c800-488a-9879-08a65e646325 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:17:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-574068e2-d510-4275-a0f8-426b8dd38e98 req-a59e8a01-357b-4452-9628-189f98d281b6 service nova] Acquiring lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:17:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-574068e2-d510-4275-a0f8-426b8dd38e98 req-a59e8a01-357b-4452-9628-189f98d281b6 service nova] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:17:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-574068e2-d510-4275-a0f8-426b8dd38e98 req-a59e8a01-357b-4452-9628-189f98d281b6 service nova] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:17:57 user nova-compute[73497]: DEBUG nova.compute.manager [req-574068e2-d510-4275-a0f8-426b8dd38e98 req-a59e8a01-357b-4452-9628-189f98d281b6 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] No waiting events found dispatching network-vif-plugged-2fdb126c-c800-488a-9879-08a65e646325 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:17:57 user nova-compute[73497]: WARNING nova.compute.manager [req-574068e2-d510-4275-a0f8-426b8dd38e98 req-a59e8a01-357b-4452-9628-189f98d281b6 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Received unexpected event network-vif-plugged-2fdb126c-c800-488a-9879-08a65e646325 for instance with vm_state active and task_state rescuing.
Aug 26 23:17:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Removed pending event for aebaeda6-23d1-43a1-afc8-bdc8992067e5 due to event {{(pid=73497) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 23:17:57 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091877.468463, aebaeda6-23d1-43a1-afc8-bdc8992067e5 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:17:57 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] VM Resumed (Lifecycle Event)
Aug 26 23:17:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-19e2bbed-9be1-4156-9386-25a0bdaec167 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:17:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:17:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:17:57 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 23:17:57 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091877.4722054, aebaeda6-23d1-43a1-afc8-bdc8992067e5 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:17:57 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] VM Started (Lifecycle Event)
Aug 26 23:17:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:17:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:17:58 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693091863.0704913, 62f841d2-09e7-448b-8c1c-26c824c473ba => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:17:58 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] VM Stopped (Lifecycle Event)
Aug 26 23:17:58 user nova-compute[73497]: DEBUG nova.compute.manager [None req-82a6a691-633b-49b1-9cfb-95154e60fa5b None None] [instance: 62f841d2-09e7-448b-8c1c-26c824c473ba] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:17:58 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:17:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:08 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:08 user nova-compute[73497]: DEBUG nova.compute.manager [req-69494cf4-42a4-4434-9b13-7478bf5d0064 req-ea9d58ca-e242-4e6e-9e76-2c3dab126160 service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Received event network-changed-61639246-9d84-4629-9666-154897feaeae {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:18:08 user nova-compute[73497]: DEBUG nova.compute.manager [req-69494cf4-42a4-4434-9b13-7478bf5d0064 req-ea9d58ca-e242-4e6e-9e76-2c3dab126160 service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Refreshing instance network info cache due to event network-changed-61639246-9d84-4629-9666-154897feaeae. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:18:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-69494cf4-42a4-4434-9b13-7478bf5d0064 req-ea9d58ca-e242-4e6e-9e76-2c3dab126160 service nova] Acquiring lock "refresh_cache-ee6283d5-40de-432d-997c-0be52ff673ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:18:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-69494cf4-42a4-4434-9b13-7478bf5d0064 req-ea9d58ca-e242-4e6e-9e76-2c3dab126160 service nova] Acquired lock "refresh_cache-ee6283d5-40de-432d-997c-0be52ff673ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:18:08 user nova-compute[73497]: DEBUG nova.network.neutron [req-69494cf4-42a4-4434-9b13-7478bf5d0064 req-ea9d58ca-e242-4e6e-9e76-2c3dab126160 service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Refreshing network info cache for port 61639246-9d84-4629-9666-154897feaeae {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:18:08 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "ff1085db-4bfc-4c77-a9e4-39f47ffb6d43" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "ff1085db-4bfc-4c77-a9e4-39f47ffb6d43" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:09 user nova-compute[73497]: DEBUG nova.compute.manager [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:18:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:09 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:18:09 user nova-compute[73497]: INFO nova.compute.claims [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Claim successful on node user
Aug 26 23:18:09 user nova-compute[73497]: DEBUG nova.network.neutron [req-69494cf4-42a4-4434-9b13-7478bf5d0064 req-ea9d58ca-e242-4e6e-9e76-2c3dab126160 service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Updated VIF entry in instance network info cache for port 61639246-9d84-4629-9666-154897feaeae. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:18:09 user nova-compute[73497]: DEBUG nova.network.neutron [req-69494cf4-42a4-4434-9b13-7478bf5d0064 req-ea9d58ca-e242-4e6e-9e76-2c3dab126160 service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Updating instance_info_cache with network_info: [{"id": "61639246-9d84-4629-9666-154897feaeae", "address": "fa:16:3e:56:41:f9", "network": {"id": "108c66fb-49a3-4c69-a3ac-93d9643a1d3e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025099504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e765258a50d46dea25bfd9c72970eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61639246-9d", "ovs_interfaceid": "61639246-9d84-4629-9666-154897feaeae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:18:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-69494cf4-42a4-4434-9b13-7478bf5d0064 req-ea9d58ca-e242-4e6e-9e76-2c3dab126160 service nova] Releasing lock "refresh_cache-ee6283d5-40de-432d-997c-0be52ff673ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:18:09 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:18:10 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:18:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:10 user nova-compute[73497]: DEBUG nova.compute.manager [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:18:10 user nova-compute[73497]: DEBUG nova.compute.manager [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:18:10 user nova-compute[73497]: DEBUG nova.network.neutron [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:18:10 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:18:10 user nova-compute[73497]: DEBUG nova.compute.manager [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:18:10 user nova-compute[73497]: DEBUG nova.policy [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e38409b92a95475db83540cbc4222466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd784b1d6c31e41d6a03fc377b0be69f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:18:10 user nova-compute[73497]: DEBUG nova.compute.manager [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:18:10 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:18:10 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Creating image(s)
Aug 26 23:18:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "/opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "/opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "/opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.194s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.220s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43/disk 1073741824" returned: 0 in 0.068s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.235s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:11 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:18:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:11 user nova-compute[73497]: DEBUG nova.network.neutron [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Successfully created port: c9d76244-be10-4ea6-84d7-86de94e58d05 {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:18:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:11 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Cannot resize image /opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:18:11 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:18:11 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Ensure instance console log exists: /opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:18:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Acquiring lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:11 user nova-compute[73497]: DEBUG nova.compute.manager [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:18:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:11 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:18:11 user nova-compute[73497]: INFO nova.compute.claims [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Claim successful on node user
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.network.neutron [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Successfully updated port: c9d76244-be10-4ea6-84d7-86de94e58d05 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "refresh_cache-ff1085db-4bfc-4c77-a9e4-39f47ffb6d43" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquired lock "refresh_cache-ff1085db-4bfc-4c77-a9e4-39f47ffb6d43" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.network.neutron [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.network.neutron [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.compute.manager [req-f64b3758-69cb-459d-8292-29e0dd496abd req-36fff65b-bc27-4503-b2e5-5ff518f41856 service nova] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Received event network-changed-c9d76244-be10-4ea6-84d7-86de94e58d05 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.compute.manager [req-f64b3758-69cb-459d-8292-29e0dd496abd req-36fff65b-bc27-4503-b2e5-5ff518f41856 service nova] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Refreshing instance network info cache due to event network-changed-c9d76244-be10-4ea6-84d7-86de94e58d05. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f64b3758-69cb-459d-8292-29e0dd496abd req-36fff65b-bc27-4503-b2e5-5ff518f41856 service nova] Acquiring lock "refresh_cache-ff1085db-4bfc-4c77-a9e4-39f47ffb6d43" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.637s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.compute.manager [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.compute.manager [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.network.neutron [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:18:12 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.compute.manager [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.network.neutron [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Updating instance_info_cache with network_info: [{"id": "c9d76244-be10-4ea6-84d7-86de94e58d05", "address": "fa:16:3e:15:e9:03", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d76244-be", "ovs_interfaceid": "c9d76244-be10-4ea6-84d7-86de94e58d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Releasing lock "refresh_cache-ff1085db-4bfc-4c77-a9e4-39f47ffb6d43" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.compute.manager [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Instance network_info: |[{"id": "c9d76244-be10-4ea6-84d7-86de94e58d05", "address": "fa:16:3e:15:e9:03", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d76244-be", "ovs_interfaceid": "c9d76244-be10-4ea6-84d7-86de94e58d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f64b3758-69cb-459d-8292-29e0dd496abd req-36fff65b-bc27-4503-b2e5-5ff518f41856 service nova] Acquired lock "refresh_cache-ff1085db-4bfc-4c77-a9e4-39f47ffb6d43" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.network.neutron [req-f64b3758-69cb-459d-8292-29e0dd496abd req-36fff65b-bc27-4503-b2e5-5ff518f41856 service nova] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Refreshing network info cache for port c9d76244-be10-4ea6-84d7-86de94e58d05 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Start _get_guest_xml network_info=[{"id": "c9d76244-be10-4ea6-84d7-86de94e58d05", "address": "fa:16:3e:15:e9:03", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d76244-be", "ovs_interfaceid": "c9d76244-be10-4ea6-84d7-86de94e58d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:18:12 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:18:12 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:18:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1564774353',display_name='tempest-AttachVolumeNegativeTest-server-1564774353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1564774353',id=16,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjq4kaAHeTyufvhSZekqtzsDAykiYvs05tP8gdlSnEvx+cyT5YaV7iz6qkFeqHygL3bm1ZgFmAKTOOU0v+dGUpYXzri5nWGUFomI2EnKgQVQpVIxTOQQkzJdNpIOf+oNQ==',key_name='tempest-keypair-1896541578',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d784b1d6c31e41d6a03fc377b0be69f5',ramdisk_id='',reservation_id='r-au4cf9sr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1095215256',owner_user_name='tempest-AttachVolumeNegativeTest-1095215256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:18:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e38409b92a95475db83540cbc4222466',uuid=ff1085db-4bfc-4c77-a9e4-39f47ffb6d43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9d76244-be10-4ea6-84d7-86de94e58d05", "address": "fa:16:3e:15:e9:03", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d76244-be", "ovs_interfaceid": "c9d76244-be10-4ea6-84d7-86de94e58d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Converting VIF {"id": "c9d76244-be10-4ea6-84d7-86de94e58d05", "address": "fa:16:3e:15:e9:03", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d76244-be", "ovs_interfaceid": "c9d76244-be10-4ea6-84d7-86de94e58d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:e9:03,bridge_name='br-int',has_traffic_filtering=True,id=c9d76244-be10-4ea6-84d7-86de94e58d05,network=Network(7bae9729-050d-4ff3-a842-91d0ec2c08d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9d76244-be') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.objects.instance [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lazy-loading 'pci_devices' on Instance uuid ff1085db-4bfc-4c77-a9e4-39f47ffb6d43 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:18:12 user nova-compute[73497]:   <uuid>ff1085db-4bfc-4c77-a9e4-39f47ffb6d43</uuid>
Aug 26 23:18:12 user nova-compute[73497]:   <name>instance-00000010</name>
Aug 26 23:18:12 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:18:12 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:18:12 user nova-compute[73497]:   <metadata>
Aug 26 23:18:12 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:18:12 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:18:12 user nova-compute[73497]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1564774353</nova:name>
Aug 26 23:18:12 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:18:12</nova:creationTime>
Aug 26 23:18:12 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:18:12 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:18:12 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:18:12 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:18:12 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:18:12 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:18:12 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:18:12 user nova-compute[73497]:       <nova:owner>
Aug 26 23:18:12 user nova-compute[73497]:         <nova:user uuid="e38409b92a95475db83540cbc4222466">tempest-AttachVolumeNegativeTest-1095215256-project-member</nova:user>
Aug 26 23:18:12 user nova-compute[73497]:         <nova:project uuid="d784b1d6c31e41d6a03fc377b0be69f5">tempest-AttachVolumeNegativeTest-1095215256</nova:project>
Aug 26 23:18:12 user nova-compute[73497]:       </nova:owner>
Aug 26 23:18:12 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:18:12 user nova-compute[73497]:       <nova:ports>
Aug 26 23:18:12 user nova-compute[73497]:         <nova:port uuid="c9d76244-be10-4ea6-84d7-86de94e58d05">
Aug 26 23:18:12 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 23:18:12 user nova-compute[73497]:         </nova:port>
Aug 26 23:18:12 user nova-compute[73497]:       </nova:ports>
Aug 26 23:18:12 user nova-compute[73497]:     </nova:instance>
Aug 26 23:18:12 user nova-compute[73497]:   </metadata>
Aug 26 23:18:12 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:18:12 user nova-compute[73497]:     <system>
Aug 26 23:18:12 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:18:12 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:18:12 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:18:12 user nova-compute[73497]:       <entry name="serial">ff1085db-4bfc-4c77-a9e4-39f47ffb6d43</entry>
Aug 26 23:18:12 user nova-compute[73497]:       <entry name="uuid">ff1085db-4bfc-4c77-a9e4-39f47ffb6d43</entry>
Aug 26 23:18:12 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:18:12 user nova-compute[73497]:     </system>
Aug 26 23:18:12 user nova-compute[73497]:   </sysinfo>
Aug 26 23:18:12 user nova-compute[73497]:   <os>
Aug 26 23:18:12 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:18:12 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:18:12 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:18:12 user nova-compute[73497]:   </os>
Aug 26 23:18:12 user nova-compute[73497]:   <features>
Aug 26 23:18:12 user nova-compute[73497]:     <acpi/>
Aug 26 23:18:12 user nova-compute[73497]:     <apic/>
Aug 26 23:18:12 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:18:12 user nova-compute[73497]:   </features>
Aug 26 23:18:12 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:18:12 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:18:12 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:18:12 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:18:12 user nova-compute[73497]:   </clock>
Aug 26 23:18:12 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:18:12 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:18:12 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:18:12 user nova-compute[73497]:   </cpu>
Aug 26 23:18:12 user nova-compute[73497]:   <devices>
Aug 26 23:18:12 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:18:12 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:18:12 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43/disk"/>
Aug 26 23:18:12 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:18:12 user nova-compute[73497]:     </disk>
Aug 26 23:18:12 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:18:12 user nova-compute[73497]:       <mac address="fa:16:3e:15:e9:03"/>
Aug 26 23:18:12 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:18:12 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:18:12 user nova-compute[73497]:       <target dev="tapc9d76244-be"/>
Aug 26 23:18:12 user nova-compute[73497]:     </interface>
Aug 26 23:18:12 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:18:12 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43/console.log" append="off"/>
Aug 26 23:18:12 user nova-compute[73497]:     </serial>
Aug 26 23:18:12 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:18:12 user nova-compute[73497]:     <video>
Aug 26 23:18:12 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:18:12 user nova-compute[73497]:     </video>
Aug 26 23:18:12 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:18:12 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:18:12 user nova-compute[73497]:     </rng>
Aug 26 23:18:12 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:18:12 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:18:12 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:18:12 user nova-compute[73497]:     </memballoon>
Aug 26 23:18:12 user nova-compute[73497]:   </devices>
Aug 26 23:18:12 user nova-compute[73497]: </domain>
Aug 26 23:18:12 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:18:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1564774353',display_name='tempest-AttachVolumeNegativeTest-server-1564774353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1564774353',id=16,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjq4kaAHeTyufvhSZekqtzsDAykiYvs05tP8gdlSnEvx+cyT5YaV7iz6qkFeqHygL3bm1ZgFmAKTOOU0v+dGUpYXzri5nWGUFomI2EnKgQVQpVIxTOQQkzJdNpIOf+oNQ==',key_name='tempest-keypair-1896541578',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d784b1d6c31e41d6a03fc377b0be69f5',ramdisk_id='',reservation_id='r-au4cf9sr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1095215256',owner_user_name='tempest-AttachVolumeNegativeTest-1095215256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:18:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e38409b92a95475db83540cbc4222466',uuid=ff1085db-4bfc-4c77-a9e4-39f47ffb6d43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9d76244-be10-4ea6-84d7-86de94e58d05", "address": "fa:16:3e:15:e9:03", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d76244-be", "ovs_interfaceid": "c9d76244-be10-4ea6-84d7-86de94e58d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Converting VIF {"id": "c9d76244-be10-4ea6-84d7-86de94e58d05", "address": "fa:16:3e:15:e9:03", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d76244-be", "ovs_interfaceid": "c9d76244-be10-4ea6-84d7-86de94e58d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:e9:03,bridge_name='br-int',has_traffic_filtering=True,id=c9d76244-be10-4ea6-84d7-86de94e58d05,network=Network(7bae9729-050d-4ff3-a842-91d0ec2c08d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9d76244-be') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG os_vif [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:e9:03,bridge_name='br-int',has_traffic_filtering=True,id=c9d76244-be10-4ea6-84d7-86de94e58d05,network=Network(7bae9729-050d-4ff3-a842-91d0ec2c08d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9d76244-be') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9d76244-be, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc9d76244-be, col_values=(('external_ids', {'iface-id': 'c9d76244-be10-4ea6-84d7-86de94e58d05', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:e9:03', 'vm-uuid': 'ff1085db-4bfc-4c77-a9e4-39f47ffb6d43'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:12 user nova-compute[73497]: INFO os_vif [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:e9:03,bridge_name='br-int',has_traffic_filtering=True,id=c9d76244-be10-4ea6-84d7-86de94e58d05,network=Network(7bae9729-050d-4ff3-a842-91d0ec2c08d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9d76244-be')
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.compute.manager [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:18:12 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Creating image(s)
Aug 26 23:18:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "/opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "/opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] No VIF found with MAC fa:16:3e:15:e9:03, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Acquiring lock "4c68f140-4235-4dcb-b99d-1347bc949d15" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "4c68f140-4235-4dcb-b99d-1347bc949d15" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.policy [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5745595130cb414283855ace84751a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19a5c1c2c4a456a86efbbadd38d94c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.203s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:13 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:18:13 user nova-compute[73497]: INFO nova.compute.claims [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Claim successful on node user
Aug 26 23:18:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.203s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:13 user nova-compute[73497]: DEBUG nova.network.neutron [req-f64b3758-69cb-459d-8292-29e0dd496abd req-36fff65b-bc27-4503-b2e5-5ff518f41856 service nova] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Updated VIF entry in instance network info cache for port c9d76244-be10-4ea6-84d7-86de94e58d05. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:18:13 user nova-compute[73497]: DEBUG nova.network.neutron [req-f64b3758-69cb-459d-8292-29e0dd496abd req-36fff65b-bc27-4503-b2e5-5ff518f41856 service nova] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Updating instance_info_cache with network_info: [{"id": "c9d76244-be10-4ea6-84d7-86de94e58d05", "address": "fa:16:3e:15:e9:03", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d76244-be", "ovs_interfaceid": "c9d76244-be10-4ea6-84d7-86de94e58d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:18:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk 1073741824" returned: 0 in 0.066s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f64b3758-69cb-459d-8292-29e0dd496abd req-36fff65b-bc27-4503-b2e5-5ff518f41856 service nova] Releasing lock "refresh_cache-ff1085db-4bfc-4c77-a9e4-39f47ffb6d43" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:18:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.200s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:13 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:18:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:13 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:18:13 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:18:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:13 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Cannot resize image /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:18:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:18:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Ensure instance console log exists: /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:18:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.620s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:13 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:18:13 user nova-compute[73497]: DEBUG nova.network.neutron [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Successfully created port: 127a3626-0dfe-4050-83d8-43658958e8df {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:18:13 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:18:13 user nova-compute[73497]: DEBUG nova.network.neutron [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:18:13 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:18:13 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:18:13 user nova-compute[73497]: DEBUG nova.policy [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e79225b05f24fb89cb3537ec6d983d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a539515b1f47d39d42e182bef80e63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:18:13 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:18:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:18:13 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Creating image(s)
Aug 26 23:18:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Acquiring lock "/opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "/opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "/opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.191s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.178s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk 1073741824" returned: 0 in 0.054s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.187s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:14 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:18:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:14 user nova-compute[73497]: DEBUG nova.network.neutron [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Successfully updated port: 127a3626-0dfe-4050-83d8-43658958e8df {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:18:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Acquiring lock "refresh_cache-7c124dd9-4dce-4c6f-925c-6eda8e187d84" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:18:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Acquired lock "refresh_cache-7c124dd9-4dce-4c6f-925c-6eda8e187d84" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:18:14 user nova-compute[73497]: DEBUG nova.network.neutron [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:18:14 user nova-compute[73497]: DEBUG nova.network.neutron [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Successfully created port: dc5326bf-72f0-4067-9fcc-420f0d1434aa {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:18:14 user nova-compute[73497]: DEBUG nova.compute.manager [req-0a67e851-7eea-49b8-8872-5d55cc8f9ebe req-7002b920-8182-4a00-a6b5-a4414b5a3c4b service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Received event network-changed-127a3626-0dfe-4050-83d8-43658958e8df {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:18:14 user nova-compute[73497]: DEBUG nova.compute.manager [req-0a67e851-7eea-49b8-8872-5d55cc8f9ebe req-7002b920-8182-4a00-a6b5-a4414b5a3c4b service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Refreshing instance network info cache due to event network-changed-127a3626-0dfe-4050-83d8-43658958e8df. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:18:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0a67e851-7eea-49b8-8872-5d55cc8f9ebe req-7002b920-8182-4a00-a6b5-a4414b5a3c4b service nova] Acquiring lock "refresh_cache-7c124dd9-4dce-4c6f-925c-6eda8e187d84" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:18:14 user nova-compute[73497]: DEBUG nova.network.neutron [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:18:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:14 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Cannot resize image /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:18:14 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:18:14 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Ensure instance console log exists: /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:18:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG nova.network.neutron [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Updating instance_info_cache with network_info: [{"id": "127a3626-0dfe-4050-83d8-43658958e8df", "address": "fa:16:3e:1c:46:66", "network": {"id": "0b5f5877-f6f2-4814-878a-25181e72db29", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-155251039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19a5c1c2c4a456a86efbbadd38d94c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127a3626-0d", "ovs_interfaceid": "127a3626-0dfe-4050-83d8-43658958e8df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Releasing lock "refresh_cache-7c124dd9-4dce-4c6f-925c-6eda8e187d84" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG nova.compute.manager [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Instance network_info: |[{"id": "127a3626-0dfe-4050-83d8-43658958e8df", "address": "fa:16:3e:1c:46:66", "network": {"id": "0b5f5877-f6f2-4814-878a-25181e72db29", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-155251039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19a5c1c2c4a456a86efbbadd38d94c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127a3626-0d", "ovs_interfaceid": "127a3626-0dfe-4050-83d8-43658958e8df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0a67e851-7eea-49b8-8872-5d55cc8f9ebe req-7002b920-8182-4a00-a6b5-a4414b5a3c4b service nova] Acquired lock "refresh_cache-7c124dd9-4dce-4c6f-925c-6eda8e187d84" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG nova.network.neutron [req-0a67e851-7eea-49b8-8872-5d55cc8f9ebe req-7002b920-8182-4a00-a6b5-a4414b5a3c4b service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Refreshing network info cache for port 127a3626-0dfe-4050-83d8-43658958e8df {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Start _get_guest_xml network_info=[{"id": "127a3626-0dfe-4050-83d8-43658958e8df", "address": "fa:16:3e:1c:46:66", "network": {"id": "0b5f5877-f6f2-4814-878a-25181e72db29", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-155251039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19a5c1c2c4a456a86efbbadd38d94c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127a3626-0d", "ovs_interfaceid": "127a3626-0dfe-4050-83d8-43658958e8df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:18:15 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:18:15 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:18:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1727169761',display_name='tempest-ServerStableDeviceRescueTest-server-1727169761',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1727169761',id=17,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0c6dCTiAMo7WCdbWslqH9tRAbJDKdO8xWor1zTiSdHMPGnIJqmEvuGj4G36lWhcWYWS/KgnWVp5bD+V07b0Shoxky7106vuRftXiegNWPYOB3XSzzs7Pa+BYY/5QFS6Q==',key_name='tempest-keypair-1129487804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d19a5c1c2c4a456a86efbbadd38d94c6',ramdisk_id='',reservation_id='r-3ltexvmi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1149676122',owner_user_name='tempest-ServerStableDeviceRescueTest-1149676122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:18:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5745595130cb414283855ace84751a92',uuid=7c124dd9-4dce-4c6f-925c-6eda8e187d84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "127a3626-0dfe-4050-83d8-43658958e8df", "address": "fa:16:3e:1c:46:66", "network": {"id": "0b5f5877-f6f2-4814-878a-25181e72db29", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-155251039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19a5c1c2c4a456a86efbbadd38d94c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127a3626-0d", "ovs_interfaceid": "127a3626-0dfe-4050-83d8-43658958e8df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Converting VIF {"id": "127a3626-0dfe-4050-83d8-43658958e8df", "address": "fa:16:3e:1c:46:66", "network": {"id": "0b5f5877-f6f2-4814-878a-25181e72db29", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-155251039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19a5c1c2c4a456a86efbbadd38d94c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127a3626-0d", "ovs_interfaceid": "127a3626-0dfe-4050-83d8-43658958e8df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:46:66,bridge_name='br-int',has_traffic_filtering=True,id=127a3626-0dfe-4050-83d8-43658958e8df,network=Network(0b5f5877-f6f2-4814-878a-25181e72db29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap127a3626-0d') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG nova.objects.instance [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c124dd9-4dce-4c6f-925c-6eda8e187d84 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:18:15 user nova-compute[73497]:   <uuid>7c124dd9-4dce-4c6f-925c-6eda8e187d84</uuid>
Aug 26 23:18:15 user nova-compute[73497]:   <name>instance-00000011</name>
Aug 26 23:18:15 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:18:15 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:18:15 user nova-compute[73497]:   <metadata>
Aug 26 23:18:15 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:18:15 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:18:15 user nova-compute[73497]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1727169761</nova:name>
Aug 26 23:18:15 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:18:15</nova:creationTime>
Aug 26 23:18:15 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:18:15 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:18:15 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:18:15 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:18:15 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:18:15 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:18:15 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:18:15 user nova-compute[73497]:       <nova:owner>
Aug 26 23:18:15 user nova-compute[73497]:         <nova:user uuid="5745595130cb414283855ace84751a92">tempest-ServerStableDeviceRescueTest-1149676122-project-member</nova:user>
Aug 26 23:18:15 user nova-compute[73497]:         <nova:project uuid="d19a5c1c2c4a456a86efbbadd38d94c6">tempest-ServerStableDeviceRescueTest-1149676122</nova:project>
Aug 26 23:18:15 user nova-compute[73497]:       </nova:owner>
Aug 26 23:18:15 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:18:15 user nova-compute[73497]:       <nova:ports>
Aug 26 23:18:15 user nova-compute[73497]:         <nova:port uuid="127a3626-0dfe-4050-83d8-43658958e8df">
Aug 26 23:18:15 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 23:18:15 user nova-compute[73497]:         </nova:port>
Aug 26 23:18:15 user nova-compute[73497]:       </nova:ports>
Aug 26 23:18:15 user nova-compute[73497]:     </nova:instance>
Aug 26 23:18:15 user nova-compute[73497]:   </metadata>
Aug 26 23:18:15 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:18:15 user nova-compute[73497]:     <system>
Aug 26 23:18:15 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:18:15 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:18:15 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:18:15 user nova-compute[73497]:       <entry name="serial">7c124dd9-4dce-4c6f-925c-6eda8e187d84</entry>
Aug 26 23:18:15 user nova-compute[73497]:       <entry name="uuid">7c124dd9-4dce-4c6f-925c-6eda8e187d84</entry>
Aug 26 23:18:15 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:18:15 user nova-compute[73497]:     </system>
Aug 26 23:18:15 user nova-compute[73497]:   </sysinfo>
Aug 26 23:18:15 user nova-compute[73497]:   <os>
Aug 26 23:18:15 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:18:15 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:18:15 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:18:15 user nova-compute[73497]:   </os>
Aug 26 23:18:15 user nova-compute[73497]:   <features>
Aug 26 23:18:15 user nova-compute[73497]:     <acpi/>
Aug 26 23:18:15 user nova-compute[73497]:     <apic/>
Aug 26 23:18:15 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:18:15 user nova-compute[73497]:   </features>
Aug 26 23:18:15 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:18:15 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:18:15 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:18:15 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:18:15 user nova-compute[73497]:   </clock>
Aug 26 23:18:15 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:18:15 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:18:15 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:18:15 user nova-compute[73497]:   </cpu>
Aug 26 23:18:15 user nova-compute[73497]:   <devices>
Aug 26 23:18:15 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:18:15 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:18:15 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk"/>
Aug 26 23:18:15 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:18:15 user nova-compute[73497]:     </disk>
Aug 26 23:18:15 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:18:15 user nova-compute[73497]:       <mac address="fa:16:3e:1c:46:66"/>
Aug 26 23:18:15 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:18:15 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:18:15 user nova-compute[73497]:       <target dev="tap127a3626-0d"/>
Aug 26 23:18:15 user nova-compute[73497]:     </interface>
Aug 26 23:18:15 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:18:15 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/console.log" append="off"/>
Aug 26 23:18:15 user nova-compute[73497]:     </serial>
Aug 26 23:18:15 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:18:15 user nova-compute[73497]:     <video>
Aug 26 23:18:15 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:18:15 user nova-compute[73497]:     </video>
Aug 26 23:18:15 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:18:15 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:18:15 user nova-compute[73497]:     </rng>
Aug 26 23:18:15 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:18:15 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:18:15 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:18:15 user nova-compute[73497]:     </memballoon>
Aug 26 23:18:15 user nova-compute[73497]:   </devices>
Aug 26 23:18:15 user nova-compute[73497]: </domain>
Aug 26 23:18:15 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1727169761',display_name='tempest-ServerStableDeviceRescueTest-server-1727169761',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1727169761',id=17,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0c6dCTiAMo7WCdbWslqH9tRAbJDKdO8xWor1zTiSdHMPGnIJqmEvuGj4G36lWhcWYWS/KgnWVp5bD+V07b0Shoxky7106vuRftXiegNWPYOB3XSzzs7Pa+BYY/5QFS6Q==',key_name='tempest-keypair-1129487804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d19a5c1c2c4a456a86efbbadd38d94c6',ramdisk_id='',reservation_id='r-3ltexvmi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1149676122',owner_user_name='tempest-ServerStableDeviceRescueTest-1149676122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:18:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5745595130cb414283855ace84751a92',uuid=7c124dd9-4dce-4c6f-925c-6eda8e187d84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "127a3626-0dfe-4050-83d8-43658958e8df", "address": "fa:16:3e:1c:46:66", "network": {"id": "0b5f5877-f6f2-4814-878a-25181e72db29", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-155251039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19a5c1c2c4a456a86efbbadd38d94c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127a3626-0d", "ovs_interfaceid": "127a3626-0dfe-4050-83d8-43658958e8df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Converting VIF {"id": "127a3626-0dfe-4050-83d8-43658958e8df", "address": "fa:16:3e:1c:46:66", "network": {"id": "0b5f5877-f6f2-4814-878a-25181e72db29", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-155251039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19a5c1c2c4a456a86efbbadd38d94c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127a3626-0d", "ovs_interfaceid": "127a3626-0dfe-4050-83d8-43658958e8df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:46:66,bridge_name='br-int',has_traffic_filtering=True,id=127a3626-0dfe-4050-83d8-43658958e8df,network=Network(0b5f5877-f6f2-4814-878a-25181e72db29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap127a3626-0d') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG os_vif [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:46:66,bridge_name='br-int',has_traffic_filtering=True,id=127a3626-0dfe-4050-83d8-43658958e8df,network=Network(0b5f5877-f6f2-4814-878a-25181e72db29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap127a3626-0d') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap127a3626-0d, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap127a3626-0d, col_values=(('external_ids', {'iface-id': '127a3626-0dfe-4050-83d8-43658958e8df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:46:66', 'vm-uuid': '7c124dd9-4dce-4c6f-925c-6eda8e187d84'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:15 user nova-compute[73497]: INFO os_vif [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:46:66,bridge_name='br-int',has_traffic_filtering=True,id=127a3626-0dfe-4050-83d8-43658958e8df,network=Network(0b5f5877-f6f2-4814-878a-25181e72db29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap127a3626-0d')
Aug 26 23:18:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] No VIF found with MAC fa:16:3e:1c:46:66, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG nova.network.neutron [req-0a67e851-7eea-49b8-8872-5d55cc8f9ebe req-7002b920-8182-4a00-a6b5-a4414b5a3c4b service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Updated VIF entry in instance network info cache for port 127a3626-0dfe-4050-83d8-43658958e8df. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG nova.network.neutron [req-0a67e851-7eea-49b8-8872-5d55cc8f9ebe req-7002b920-8182-4a00-a6b5-a4414b5a3c4b service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Updating instance_info_cache with network_info: [{"id": "127a3626-0dfe-4050-83d8-43658958e8df", "address": "fa:16:3e:1c:46:66", "network": {"id": "0b5f5877-f6f2-4814-878a-25181e72db29", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-155251039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19a5c1c2c4a456a86efbbadd38d94c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127a3626-0d", "ovs_interfaceid": "127a3626-0dfe-4050-83d8-43658958e8df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0a67e851-7eea-49b8-8872-5d55cc8f9ebe req-7002b920-8182-4a00-a6b5-a4414b5a3c4b service nova] Releasing lock "refresh_cache-7c124dd9-4dce-4c6f-925c-6eda8e187d84" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG nova.network.neutron [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Successfully updated port: dc5326bf-72f0-4067-9fcc-420f0d1434aa {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Acquiring lock "refresh_cache-4c68f140-4235-4dcb-b99d-1347bc949d15" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Acquired lock "refresh_cache-4c68f140-4235-4dcb-b99d-1347bc949d15" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG nova.network.neutron [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG nova.compute.manager [req-9a0d68f8-c76f-4168-96a6-6fd37897a768 req-5d044447-5fc4-4a85-a826-f44ced0a8d95 service nova] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Received event network-changed-dc5326bf-72f0-4067-9fcc-420f0d1434aa {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG nova.compute.manager [req-9a0d68f8-c76f-4168-96a6-6fd37897a768 req-5d044447-5fc4-4a85-a826-f44ced0a8d95 service nova] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Refreshing instance network info cache due to event network-changed-dc5326bf-72f0-4067-9fcc-420f0d1434aa. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:18:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9a0d68f8-c76f-4168-96a6-6fd37897a768 req-5d044447-5fc4-4a85-a826-f44ced0a8d95 service nova] Acquiring lock "refresh_cache-4c68f140-4235-4dcb-b99d-1347bc949d15" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.network.neutron [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.network.neutron [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Updating instance_info_cache with network_info: [{"id": "dc5326bf-72f0-4067-9fcc-420f0d1434aa", "address": "fa:16:3e:d0:86:2a", "network": {"id": "e5209dd2-0f09-4bab-b0a6-b486792104a3", "bridge": "br-int", "label": "tempest-TestStampPattern-819945601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a539515b1f47d39d42e182bef80e63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc5326bf-72", "ovs_interfaceid": "dc5326bf-72f0-4067-9fcc-420f0d1434aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Releasing lock "refresh_cache-4c68f140-4235-4dcb-b99d-1347bc949d15" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Instance network_info: |[{"id": "dc5326bf-72f0-4067-9fcc-420f0d1434aa", "address": "fa:16:3e:d0:86:2a", "network": {"id": "e5209dd2-0f09-4bab-b0a6-b486792104a3", "bridge": "br-int", "label": "tempest-TestStampPattern-819945601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a539515b1f47d39d42e182bef80e63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc5326bf-72", "ovs_interfaceid": "dc5326bf-72f0-4067-9fcc-420f0d1434aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9a0d68f8-c76f-4168-96a6-6fd37897a768 req-5d044447-5fc4-4a85-a826-f44ced0a8d95 service nova] Acquired lock "refresh_cache-4c68f140-4235-4dcb-b99d-1347bc949d15" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.network.neutron [req-9a0d68f8-c76f-4168-96a6-6fd37897a768 req-5d044447-5fc4-4a85-a826-f44ced0a8d95 service nova] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Refreshing network info cache for port dc5326bf-72f0-4067-9fcc-420f0d1434aa {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Start _get_guest_xml network_info=[{"id": "dc5326bf-72f0-4067-9fcc-420f0d1434aa", "address": "fa:16:3e:d0:86:2a", "network": {"id": "e5209dd2-0f09-4bab-b0a6-b486792104a3", "bridge": "br-int", "label": "tempest-TestStampPattern-819945601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a539515b1f47d39d42e182bef80e63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc5326bf-72", "ovs_interfaceid": "dc5326bf-72f0-4067-9fcc-420f0d1434aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:18:16 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:18:16 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:18:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1321416268',display_name='tempest-TestStampPattern-server-1321416268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1321416268',id=18,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSpNmqRMbMJd2f6kUSzLECN5mko6NqxFamfd/k4MFhK1XP2WLUCDpa9g6XZBlQKoHW+wuTTi/MsaMFncPcqVt3DKC1QEzKz7chFIzuhFpmCMAj7D379vAGPFvW3AZm1hg==',key_name='tempest-TestStampPattern-584336943',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04a539515b1f47d39d42e182bef80e63',ramdisk_id='',reservation_id='r-bizxvo00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2000771312',owner_user_name='tempest-TestStampPattern-2000771312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:18:14Z,user_data=None,user_id='0e79225b05f24fb89cb3537ec6d983d9',uuid=4c68f140-4235-4dcb-b99d-1347bc949d15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc5326bf-72f0-4067-9fcc-420f0d1434aa", "address": "fa:16:3e:d0:86:2a", "network": {"id": "e5209dd2-0f09-4bab-b0a6-b486792104a3", "bridge": "br-int", "label": "tempest-TestStampPattern-819945601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a539515b1f47d39d42e182bef80e63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc5326bf-72", "ovs_interfaceid": "dc5326bf-72f0-4067-9fcc-420f0d1434aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Converting VIF {"id": "dc5326bf-72f0-4067-9fcc-420f0d1434aa", "address": "fa:16:3e:d0:86:2a", "network": {"id": "e5209dd2-0f09-4bab-b0a6-b486792104a3", "bridge": "br-int", "label": "tempest-TestStampPattern-819945601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a539515b1f47d39d42e182bef80e63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc5326bf-72", "ovs_interfaceid": "dc5326bf-72f0-4067-9fcc-420f0d1434aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:86:2a,bridge_name='br-int',has_traffic_filtering=True,id=dc5326bf-72f0-4067-9fcc-420f0d1434aa,network=Network(e5209dd2-0f09-4bab-b0a6-b486792104a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc5326bf-72') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.objects.instance [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c68f140-4235-4dcb-b99d-1347bc949d15 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:18:16 user nova-compute[73497]:   <uuid>4c68f140-4235-4dcb-b99d-1347bc949d15</uuid>
Aug 26 23:18:16 user nova-compute[73497]:   <name>instance-00000012</name>
Aug 26 23:18:16 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:18:16 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:18:16 user nova-compute[73497]:   <metadata>
Aug 26 23:18:16 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:18:16 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:18:16 user nova-compute[73497]:       <nova:name>tempest-TestStampPattern-server-1321416268</nova:name>
Aug 26 23:18:16 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:18:16</nova:creationTime>
Aug 26 23:18:16 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:18:16 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:18:16 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:18:16 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:18:16 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:18:16 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:18:16 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:18:16 user nova-compute[73497]:       <nova:owner>
Aug 26 23:18:16 user nova-compute[73497]:         <nova:user uuid="0e79225b05f24fb89cb3537ec6d983d9">tempest-TestStampPattern-2000771312-project-member</nova:user>
Aug 26 23:18:16 user nova-compute[73497]:         <nova:project uuid="04a539515b1f47d39d42e182bef80e63">tempest-TestStampPattern-2000771312</nova:project>
Aug 26 23:18:16 user nova-compute[73497]:       </nova:owner>
Aug 26 23:18:16 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:18:16 user nova-compute[73497]:       <nova:ports>
Aug 26 23:18:16 user nova-compute[73497]:         <nova:port uuid="dc5326bf-72f0-4067-9fcc-420f0d1434aa">
Aug 26 23:18:16 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 23:18:16 user nova-compute[73497]:         </nova:port>
Aug 26 23:18:16 user nova-compute[73497]:       </nova:ports>
Aug 26 23:18:16 user nova-compute[73497]:     </nova:instance>
Aug 26 23:18:16 user nova-compute[73497]:   </metadata>
Aug 26 23:18:16 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:18:16 user nova-compute[73497]:     <system>
Aug 26 23:18:16 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:18:16 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:18:16 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:18:16 user nova-compute[73497]:       <entry name="serial">4c68f140-4235-4dcb-b99d-1347bc949d15</entry>
Aug 26 23:18:16 user nova-compute[73497]:       <entry name="uuid">4c68f140-4235-4dcb-b99d-1347bc949d15</entry>
Aug 26 23:18:16 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:18:16 user nova-compute[73497]:     </system>
Aug 26 23:18:16 user nova-compute[73497]:   </sysinfo>
Aug 26 23:18:16 user nova-compute[73497]:   <os>
Aug 26 23:18:16 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:18:16 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:18:16 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:18:16 user nova-compute[73497]:   </os>
Aug 26 23:18:16 user nova-compute[73497]:   <features>
Aug 26 23:18:16 user nova-compute[73497]:     <acpi/>
Aug 26 23:18:16 user nova-compute[73497]:     <apic/>
Aug 26 23:18:16 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:18:16 user nova-compute[73497]:   </features>
Aug 26 23:18:16 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:18:16 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:18:16 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:18:16 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:18:16 user nova-compute[73497]:   </clock>
Aug 26 23:18:16 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:18:16 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:18:16 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:18:16 user nova-compute[73497]:   </cpu>
Aug 26 23:18:16 user nova-compute[73497]:   <devices>
Aug 26 23:18:16 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:18:16 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:18:16 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk"/>
Aug 26 23:18:16 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:18:16 user nova-compute[73497]:     </disk>
Aug 26 23:18:16 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:18:16 user nova-compute[73497]:       <mac address="fa:16:3e:d0:86:2a"/>
Aug 26 23:18:16 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:18:16 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:18:16 user nova-compute[73497]:       <target dev="tapdc5326bf-72"/>
Aug 26 23:18:16 user nova-compute[73497]:     </interface>
Aug 26 23:18:16 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:18:16 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/console.log" append="off"/>
Aug 26 23:18:16 user nova-compute[73497]:     </serial>
Aug 26 23:18:16 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:18:16 user nova-compute[73497]:     <video>
Aug 26 23:18:16 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:18:16 user nova-compute[73497]:     </video>
Aug 26 23:18:16 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:18:16 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:18:16 user nova-compute[73497]:     </rng>
Aug 26 23:18:16 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:18:16 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:18:16 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:18:16 user nova-compute[73497]:     </memballoon>
Aug 26 23:18:16 user nova-compute[73497]:   </devices>
Aug 26 23:18:16 user nova-compute[73497]: </domain>
Aug 26 23:18:16 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:18:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1321416268',display_name='tempest-TestStampPattern-server-1321416268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1321416268',id=18,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSpNmqRMbMJd2f6kUSzLECN5mko6NqxFamfd/k4MFhK1XP2WLUCDpa9g6XZBlQKoHW+wuTTi/MsaMFncPcqVt3DKC1QEzKz7chFIzuhFpmCMAj7D379vAGPFvW3AZm1hg==',key_name='tempest-TestStampPattern-584336943',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04a539515b1f47d39d42e182bef80e63',ramdisk_id='',reservation_id='r-bizxvo00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2000771312',owner_user_name='tempest-TestStampPattern-2000771312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:18:14Z,user_data=None,user_id='0e79225b05f24fb89cb3537ec6d983d9',uuid=4c68f140-4235-4dcb-b99d-1347bc949d15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc5326bf-72f0-4067-9fcc-420f0d1434aa", "address": "fa:16:3e:d0:86:2a", "network": {"id": "e5209dd2-0f09-4bab-b0a6-b486792104a3", "bridge": "br-int", "label": "tempest-TestStampPattern-819945601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a539515b1f47d39d42e182bef80e63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc5326bf-72", "ovs_interfaceid": "dc5326bf-72f0-4067-9fcc-420f0d1434aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Converting VIF {"id": "dc5326bf-72f0-4067-9fcc-420f0d1434aa", "address": "fa:16:3e:d0:86:2a", "network": {"id": "e5209dd2-0f09-4bab-b0a6-b486792104a3", "bridge": "br-int", "label": "tempest-TestStampPattern-819945601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a539515b1f47d39d42e182bef80e63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc5326bf-72", "ovs_interfaceid": "dc5326bf-72f0-4067-9fcc-420f0d1434aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:86:2a,bridge_name='br-int',has_traffic_filtering=True,id=dc5326bf-72f0-4067-9fcc-420f0d1434aa,network=Network(e5209dd2-0f09-4bab-b0a6-b486792104a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc5326bf-72') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG os_vif [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:86:2a,bridge_name='br-int',has_traffic_filtering=True,id=dc5326bf-72f0-4067-9fcc-420f0d1434aa,network=Network(e5209dd2-0f09-4bab-b0a6-b486792104a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc5326bf-72') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc5326bf-72, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdc5326bf-72, col_values=(('external_ids', {'iface-id': 'dc5326bf-72f0-4067-9fcc-420f0d1434aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:86:2a', 'vm-uuid': '4c68f140-4235-4dcb-b99d-1347bc949d15'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:16 user nova-compute[73497]: INFO os_vif [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:86:2a,bridge_name='br-int',has_traffic_filtering=True,id=dc5326bf-72f0-4067-9fcc-420f0d1434aa,network=Network(e5209dd2-0f09-4bab-b0a6-b486792104a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc5326bf-72')
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] No VIF found with MAC fa:16:3e:d0:86:2a, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091896.5456448, ff1085db-4bfc-4c77-a9e4-39f47ffb6d43 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:18:16 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] VM Resumed (Lifecycle Event)
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.compute.manager [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:18:16 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Instance spawned successfully.
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:18:16 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091896.5477417, ff1085db-4bfc-4c77-a9e4-39f47ffb6d43 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:18:16 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] VM Started (Lifecycle Event)
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:18:16 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:18:16 user nova-compute[73497]: INFO nova.compute.manager [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Took 6.40 seconds to spawn the instance on the hypervisor.
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.compute.manager [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.network.neutron [req-9a0d68f8-c76f-4168-96a6-6fd37897a768 req-5d044447-5fc4-4a85-a826-f44ced0a8d95 service nova] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Updated VIF entry in instance network info cache for port dc5326bf-72f0-4067-9fcc-420f0d1434aa. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG nova.network.neutron [req-9a0d68f8-c76f-4168-96a6-6fd37897a768 req-5d044447-5fc4-4a85-a826-f44ced0a8d95 service nova] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Updating instance_info_cache with network_info: [{"id": "dc5326bf-72f0-4067-9fcc-420f0d1434aa", "address": "fa:16:3e:d0:86:2a", "network": {"id": "e5209dd2-0f09-4bab-b0a6-b486792104a3", "bridge": "br-int", "label": "tempest-TestStampPattern-819945601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a539515b1f47d39d42e182bef80e63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc5326bf-72", "ovs_interfaceid": "dc5326bf-72f0-4067-9fcc-420f0d1434aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9a0d68f8-c76f-4168-96a6-6fd37897a768 req-5d044447-5fc4-4a85-a826-f44ced0a8d95 service nova] Releasing lock "refresh_cache-4c68f140-4235-4dcb-b99d-1347bc949d15" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:16 user nova-compute[73497]: INFO nova.compute.manager [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Took 7.22 seconds to build instance.
Aug 26 23:18:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3b491d48-b7ea-4fbf-af0a-582fa5d6c38b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "ff1085db-4bfc-4c77-a9e4-39f47ffb6d43" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.333s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:17 user nova-compute[73497]: DEBUG nova.compute.manager [req-8d86f827-1a39-4865-a1da-757c7b6b84bd req-9a213c7e-3c10-485f-a0e0-c3fcc7819071 service nova] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Received event network-vif-plugged-c9d76244-be10-4ea6-84d7-86de94e58d05 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:18:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8d86f827-1a39-4865-a1da-757c7b6b84bd req-9a213c7e-3c10-485f-a0e0-c3fcc7819071 service nova] Acquiring lock "ff1085db-4bfc-4c77-a9e4-39f47ffb6d43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8d86f827-1a39-4865-a1da-757c7b6b84bd req-9a213c7e-3c10-485f-a0e0-c3fcc7819071 service nova] Lock "ff1085db-4bfc-4c77-a9e4-39f47ffb6d43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8d86f827-1a39-4865-a1da-757c7b6b84bd req-9a213c7e-3c10-485f-a0e0-c3fcc7819071 service nova] Lock "ff1085db-4bfc-4c77-a9e4-39f47ffb6d43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:17 user nova-compute[73497]: DEBUG nova.compute.manager [req-8d86f827-1a39-4865-a1da-757c7b6b84bd req-9a213c7e-3c10-485f-a0e0-c3fcc7819071 service nova] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] No waiting events found dispatching network-vif-plugged-c9d76244-be10-4ea6-84d7-86de94e58d05 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:18:17 user nova-compute[73497]: WARNING nova.compute.manager [req-8d86f827-1a39-4865-a1da-757c7b6b84bd req-9a213c7e-3c10-485f-a0e0-c3fcc7819071 service nova] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Received unexpected event network-vif-plugged-c9d76244-be10-4ea6-84d7-86de94e58d05 for instance with vm_state active and task_state None.
Aug 26 23:18:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:19 user nova-compute[73497]: DEBUG nova.compute.manager [req-f8ce50d9-c446-4a45-9370-1553ec3abca6 req-85d46432-e69c-4862-a5e7-a3350594f6a3 service nova] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Received event network-vif-plugged-c9d76244-be10-4ea6-84d7-86de94e58d05 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:18:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f8ce50d9-c446-4a45-9370-1553ec3abca6 req-85d46432-e69c-4862-a5e7-a3350594f6a3 service nova] Acquiring lock "ff1085db-4bfc-4c77-a9e4-39f47ffb6d43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f8ce50d9-c446-4a45-9370-1553ec3abca6 req-85d46432-e69c-4862-a5e7-a3350594f6a3 service nova] Lock "ff1085db-4bfc-4c77-a9e4-39f47ffb6d43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f8ce50d9-c446-4a45-9370-1553ec3abca6 req-85d46432-e69c-4862-a5e7-a3350594f6a3 service nova] Lock "ff1085db-4bfc-4c77-a9e4-39f47ffb6d43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:19 user nova-compute[73497]: DEBUG nova.compute.manager [req-f8ce50d9-c446-4a45-9370-1553ec3abca6 req-85d46432-e69c-4862-a5e7-a3350594f6a3 service nova] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] No waiting events found dispatching network-vif-plugged-c9d76244-be10-4ea6-84d7-86de94e58d05 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:18:19 user nova-compute[73497]: WARNING nova.compute.manager [req-f8ce50d9-c446-4a45-9370-1553ec3abca6 req-85d46432-e69c-4862-a5e7-a3350594f6a3 service nova] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Received unexpected event network-vif-plugged-c9d76244-be10-4ea6-84d7-86de94e58d05 for instance with vm_state active and task_state None.
Aug 26 23:18:19 user nova-compute[73497]: DEBUG nova.compute.manager [req-f8ce50d9-c446-4a45-9370-1553ec3abca6 req-85d46432-e69c-4862-a5e7-a3350594f6a3 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Received event network-vif-plugged-127a3626-0dfe-4050-83d8-43658958e8df {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:18:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f8ce50d9-c446-4a45-9370-1553ec3abca6 req-85d46432-e69c-4862-a5e7-a3350594f6a3 service nova] Acquiring lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f8ce50d9-c446-4a45-9370-1553ec3abca6 req-85d46432-e69c-4862-a5e7-a3350594f6a3 service nova] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f8ce50d9-c446-4a45-9370-1553ec3abca6 req-85d46432-e69c-4862-a5e7-a3350594f6a3 service nova] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:19 user nova-compute[73497]: DEBUG nova.compute.manager [req-f8ce50d9-c446-4a45-9370-1553ec3abca6 req-85d46432-e69c-4862-a5e7-a3350594f6a3 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] No waiting events found dispatching network-vif-plugged-127a3626-0dfe-4050-83d8-43658958e8df {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:18:19 user nova-compute[73497]: WARNING nova.compute.manager [req-f8ce50d9-c446-4a45-9370-1553ec3abca6 req-85d46432-e69c-4862-a5e7-a3350594f6a3 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Received unexpected event network-vif-plugged-127a3626-0dfe-4050-83d8-43658958e8df for instance with vm_state building and task_state spawning.
Aug 26 23:18:19 user nova-compute[73497]: DEBUG nova.compute.manager [req-f8ce50d9-c446-4a45-9370-1553ec3abca6 req-85d46432-e69c-4862-a5e7-a3350594f6a3 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Received event network-vif-plugged-127a3626-0dfe-4050-83d8-43658958e8df {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:18:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f8ce50d9-c446-4a45-9370-1553ec3abca6 req-85d46432-e69c-4862-a5e7-a3350594f6a3 service nova] Acquiring lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f8ce50d9-c446-4a45-9370-1553ec3abca6 req-85d46432-e69c-4862-a5e7-a3350594f6a3 service nova] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f8ce50d9-c446-4a45-9370-1553ec3abca6 req-85d46432-e69c-4862-a5e7-a3350594f6a3 service nova] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:19 user nova-compute[73497]: DEBUG nova.compute.manager [req-f8ce50d9-c446-4a45-9370-1553ec3abca6 req-85d46432-e69c-4862-a5e7-a3350594f6a3 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] No waiting events found dispatching network-vif-plugged-127a3626-0dfe-4050-83d8-43658958e8df {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:18:19 user nova-compute[73497]: WARNING nova.compute.manager [req-f8ce50d9-c446-4a45-9370-1553ec3abca6 req-85d46432-e69c-4862-a5e7-a3350594f6a3 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Received unexpected event network-vif-plugged-127a3626-0dfe-4050-83d8-43658958e8df for instance with vm_state building and task_state spawning.
Aug 26 23:18:19 user nova-compute[73497]: DEBUG nova.compute.manager [req-f8ce50d9-c446-4a45-9370-1553ec3abca6 req-85d46432-e69c-4862-a5e7-a3350594f6a3 service nova] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Received event network-vif-plugged-dc5326bf-72f0-4067-9fcc-420f0d1434aa {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:18:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f8ce50d9-c446-4a45-9370-1553ec3abca6 req-85d46432-e69c-4862-a5e7-a3350594f6a3 service nova] Acquiring lock "4c68f140-4235-4dcb-b99d-1347bc949d15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f8ce50d9-c446-4a45-9370-1553ec3abca6 req-85d46432-e69c-4862-a5e7-a3350594f6a3 service nova] Lock "4c68f140-4235-4dcb-b99d-1347bc949d15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f8ce50d9-c446-4a45-9370-1553ec3abca6 req-85d46432-e69c-4862-a5e7-a3350594f6a3 service nova] Lock "4c68f140-4235-4dcb-b99d-1347bc949d15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:19 user nova-compute[73497]: DEBUG nova.compute.manager [req-f8ce50d9-c446-4a45-9370-1553ec3abca6 req-85d46432-e69c-4862-a5e7-a3350594f6a3 service nova] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] No waiting events found dispatching network-vif-plugged-dc5326bf-72f0-4067-9fcc-420f0d1434aa {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:18:19 user nova-compute[73497]: WARNING nova.compute.manager [req-f8ce50d9-c446-4a45-9370-1553ec3abca6 req-85d46432-e69c-4862-a5e7-a3350594f6a3 service nova] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Received unexpected event network-vif-plugged-dc5326bf-72f0-4067-9fcc-420f0d1434aa for instance with vm_state building and task_state spawning.
Aug 26 23:18:19 user nova-compute[73497]: DEBUG nova.compute.manager [req-f8ce50d9-c446-4a45-9370-1553ec3abca6 req-85d46432-e69c-4862-a5e7-a3350594f6a3 service nova] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Received event network-vif-plugged-dc5326bf-72f0-4067-9fcc-420f0d1434aa {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:18:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f8ce50d9-c446-4a45-9370-1553ec3abca6 req-85d46432-e69c-4862-a5e7-a3350594f6a3 service nova] Acquiring lock "4c68f140-4235-4dcb-b99d-1347bc949d15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f8ce50d9-c446-4a45-9370-1553ec3abca6 req-85d46432-e69c-4862-a5e7-a3350594f6a3 service nova] Lock "4c68f140-4235-4dcb-b99d-1347bc949d15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f8ce50d9-c446-4a45-9370-1553ec3abca6 req-85d46432-e69c-4862-a5e7-a3350594f6a3 service nova] Lock "4c68f140-4235-4dcb-b99d-1347bc949d15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:19 user nova-compute[73497]: DEBUG nova.compute.manager [req-f8ce50d9-c446-4a45-9370-1553ec3abca6 req-85d46432-e69c-4862-a5e7-a3350594f6a3 service nova] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] No waiting events found dispatching network-vif-plugged-dc5326bf-72f0-4067-9fcc-420f0d1434aa {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:18:19 user nova-compute[73497]: WARNING nova.compute.manager [req-f8ce50d9-c446-4a45-9370-1553ec3abca6 req-85d46432-e69c-4862-a5e7-a3350594f6a3 service nova] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Received unexpected event network-vif-plugged-dc5326bf-72f0-4067-9fcc-420f0d1434aa for instance with vm_state building and task_state spawning.
Aug 26 23:18:20 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091900.3304253, 7c124dd9-4dce-4c6f-925c-6eda8e187d84 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:18:20 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] VM Resumed (Lifecycle Event)
Aug 26 23:18:20 user nova-compute[73497]: DEBUG nova.compute.manager [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:18:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:18:20 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Instance spawned successfully.
Aug 26 23:18:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:18:20 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:18:20 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:18:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:18:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:18:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:18:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:18:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:18:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:18:20 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:18:20 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091900.3402112, 7c124dd9-4dce-4c6f-925c-6eda8e187d84 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:18:20 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] VM Started (Lifecycle Event)
Aug 26 23:18:20 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:18:20 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:18:20 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:18:20 user nova-compute[73497]: INFO nova.compute.manager [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Took 7.72 seconds to spawn the instance on the hypervisor.
Aug 26 23:18:20 user nova-compute[73497]: DEBUG nova.compute.manager [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:18:20 user nova-compute[73497]: INFO nova.compute.manager [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Took 8.82 seconds to build instance.
Aug 26 23:18:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ff9f29d2-79ee-4cec-8ad8-b099bc475844 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.940s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:20 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091900.7899725, 4c68f140-4235-4dcb-b99d-1347bc949d15 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:18:20 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] VM Resumed (Lifecycle Event)
Aug 26 23:18:20 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:18:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:18:20 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Instance spawned successfully.
Aug 26 23:18:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:18:20 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:18:20 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:18:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:18:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:18:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:18:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:18:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:18:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:18:20 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:18:20 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091900.797603, 4c68f140-4235-4dcb-b99d-1347bc949d15 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:18:20 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] VM Started (Lifecycle Event)
Aug 26 23:18:20 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:18:20 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:18:20 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:18:20 user nova-compute[73497]: INFO nova.compute.manager [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Took 6.93 seconds to spawn the instance on the hypervisor.
Aug 26 23:18:20 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:18:21 user nova-compute[73497]: INFO nova.compute.manager [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Took 7.96 seconds to build instance.
Aug 26 23:18:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4060fce8-4c66-40bc-a6d5-6426ee9a6472 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "4c68f140-4235-4dcb-b99d-1347bc949d15" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.072s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d1b6b45c-b364-4bcd-87f2-53e27600c505 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Acquiring lock "a19ccf77-8c30-44af-bd19-9b879fa60942" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d1b6b45c-b364-4bcd-87f2-53e27600c505 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "a19ccf77-8c30-44af-bd19-9b879fa60942" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d1b6b45c-b364-4bcd-87f2-53e27600c505 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Acquiring lock "a19ccf77-8c30-44af-bd19-9b879fa60942-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d1b6b45c-b364-4bcd-87f2-53e27600c505 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "a19ccf77-8c30-44af-bd19-9b879fa60942-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d1b6b45c-b364-4bcd-87f2-53e27600c505 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "a19ccf77-8c30-44af-bd19-9b879fa60942-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:29 user nova-compute[73497]: INFO nova.compute.manager [None req-d1b6b45c-b364-4bcd-87f2-53e27600c505 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Terminating instance
Aug 26 23:18:29 user nova-compute[73497]: DEBUG nova.compute.manager [None req-d1b6b45c-b364-4bcd-87f2-53e27600c505 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:18:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:29 user nova-compute[73497]: DEBUG nova.compute.manager [req-850da5ab-9c0d-4a4f-9101-5a057e03a4d6 req-2db4809f-8961-4e6a-a707-6b20772f0d8b service nova] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Received event network-vif-unplugged-4d4d1845-f715-4bc2-a00a-9ac1fc39da48 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:18:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-850da5ab-9c0d-4a4f-9101-5a057e03a4d6 req-2db4809f-8961-4e6a-a707-6b20772f0d8b service nova] Acquiring lock "a19ccf77-8c30-44af-bd19-9b879fa60942-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-850da5ab-9c0d-4a4f-9101-5a057e03a4d6 req-2db4809f-8961-4e6a-a707-6b20772f0d8b service nova] Lock "a19ccf77-8c30-44af-bd19-9b879fa60942-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-850da5ab-9c0d-4a4f-9101-5a057e03a4d6 req-2db4809f-8961-4e6a-a707-6b20772f0d8b service nova] Lock "a19ccf77-8c30-44af-bd19-9b879fa60942-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:29 user nova-compute[73497]: DEBUG nova.compute.manager [req-850da5ab-9c0d-4a4f-9101-5a057e03a4d6 req-2db4809f-8961-4e6a-a707-6b20772f0d8b service nova] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] No waiting events found dispatching network-vif-unplugged-4d4d1845-f715-4bc2-a00a-9ac1fc39da48 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:18:29 user nova-compute[73497]: DEBUG nova.compute.manager [req-850da5ab-9c0d-4a4f-9101-5a057e03a4d6 req-2db4809f-8961-4e6a-a707-6b20772f0d8b service nova] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Received event network-vif-unplugged-4d4d1845-f715-4bc2-a00a-9ac1fc39da48 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:18:30 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Instance destroyed successfully.
Aug 26 23:18:30 user nova-compute[73497]: DEBUG nova.objects.instance [None req-d1b6b45c-b364-4bcd-87f2-53e27600c505 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lazy-loading 'resources' on Instance uuid a19ccf77-8c30-44af-bd19-9b879fa60942 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:18:30 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-d1b6b45c-b364-4bcd-87f2-53e27600c505 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1431036640',display_name='tempest-VolumesAdminNegativeTest-server-1431036640',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1431036640',id=14,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:16:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='546cdb5907fc494c94ea81cfcef71a28',ramdisk_id='',reservation_id='r-02rxs202',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1932002621',owner_user_name='tempest-VolumesAdminNegativeTest-1932002621-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:16:34Z,user_data=None,user_id='76e923deac454ba09eb85819527eb108',uuid=a19ccf77-8c30-44af-bd19-9b879fa60942,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d4d1845-f715-4bc2-a00a-9ac1fc39da48", "address": "fa:16:3e:a9:12:c2", "network": {"id": "4eb3bf86-7f68-4a81-90f9-f34da6231d59", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-299898849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "546cdb5907fc494c94ea81cfcef71a28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d4d1845-f7", "ovs_interfaceid": "4d4d1845-f715-4bc2-a00a-9ac1fc39da48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:18:30 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-d1b6b45c-b364-4bcd-87f2-53e27600c505 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Converting VIF {"id": "4d4d1845-f715-4bc2-a00a-9ac1fc39da48", "address": "fa:16:3e:a9:12:c2", "network": {"id": "4eb3bf86-7f68-4a81-90f9-f34da6231d59", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-299898849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "546cdb5907fc494c94ea81cfcef71a28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d4d1845-f7", "ovs_interfaceid": "4d4d1845-f715-4bc2-a00a-9ac1fc39da48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:18:30 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-d1b6b45c-b364-4bcd-87f2-53e27600c505 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:12:c2,bridge_name='br-int',has_traffic_filtering=True,id=4d4d1845-f715-4bc2-a00a-9ac1fc39da48,network=Network(4eb3bf86-7f68-4a81-90f9-f34da6231d59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d4d1845-f7') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:18:30 user nova-compute[73497]: DEBUG os_vif [None req-d1b6b45c-b364-4bcd-87f2-53e27600c505 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:12:c2,bridge_name='br-int',has_traffic_filtering=True,id=4d4d1845-f715-4bc2-a00a-9ac1fc39da48,network=Network(4eb3bf86-7f68-4a81-90f9-f34da6231d59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d4d1845-f7') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:18:30 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:30 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d4d1845-f7, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:18:30 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:18:30 user nova-compute[73497]: INFO os_vif [None req-d1b6b45c-b364-4bcd-87f2-53e27600c505 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:12:c2,bridge_name='br-int',has_traffic_filtering=True,id=4d4d1845-f715-4bc2-a00a-9ac1fc39da48,network=Network(4eb3bf86-7f68-4a81-90f9-f34da6231d59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d4d1845-f7')
Aug 26 23:18:30 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-d1b6b45c-b364-4bcd-87f2-53e27600c505 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Deleting instance files /opt/stack/data/nova/instances/a19ccf77-8c30-44af-bd19-9b879fa60942_del
Aug 26 23:18:30 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-d1b6b45c-b364-4bcd-87f2-53e27600c505 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Deletion of /opt/stack/data/nova/instances/a19ccf77-8c30-44af-bd19-9b879fa60942_del complete
Aug 26 23:18:30 user nova-compute[73497]: INFO nova.compute.manager [None req-d1b6b45c-b364-4bcd-87f2-53e27600c505 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 26 23:18:30 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-d1b6b45c-b364-4bcd-87f2-53e27600c505 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:18:30 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:18:30 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:18:30 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:18:31 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Took 0.70 seconds to deallocate network for instance.
Aug 26 23:18:31 user nova-compute[73497]: DEBUG nova.compute.manager [req-69753b3a-726d-4ba3-bcbb-99907f419cfe req-83e0b52d-2820-4623-8ca1-43b961228fc2 service nova] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Received event network-vif-deleted-4d4d1845-f715-4bc2-a00a-9ac1fc39da48 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:18:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d1b6b45c-b364-4bcd-87f2-53e27600c505 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d1b6b45c-b364-4bcd-87f2-53e27600c505 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:31 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-d1b6b45c-b364-4bcd-87f2-53e27600c505 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:18:31 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-d1b6b45c-b364-4bcd-87f2-53e27600c505 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:18:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d1b6b45c-b364-4bcd-87f2-53e27600c505 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.510s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:31 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-d1b6b45c-b364-4bcd-87f2-53e27600c505 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Deleted allocations for instance a19ccf77-8c30-44af-bd19-9b879fa60942
Aug 26 23:18:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d1b6b45c-b364-4bcd-87f2-53e27600c505 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "a19ccf77-8c30-44af-bd19-9b879fa60942" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.404s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:31 user nova-compute[73497]: DEBUG nova.compute.manager [req-cde3ccdd-16f5-4cab-b6f2-45324519b91d req-ecad0bbe-7285-44a2-9e8e-03e98827aa36 service nova] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Received event network-vif-plugged-4d4d1845-f715-4bc2-a00a-9ac1fc39da48 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:18:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cde3ccdd-16f5-4cab-b6f2-45324519b91d req-ecad0bbe-7285-44a2-9e8e-03e98827aa36 service nova] Acquiring lock "a19ccf77-8c30-44af-bd19-9b879fa60942-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cde3ccdd-16f5-4cab-b6f2-45324519b91d req-ecad0bbe-7285-44a2-9e8e-03e98827aa36 service nova] Lock "a19ccf77-8c30-44af-bd19-9b879fa60942-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cde3ccdd-16f5-4cab-b6f2-45324519b91d req-ecad0bbe-7285-44a2-9e8e-03e98827aa36 service nova] Lock "a19ccf77-8c30-44af-bd19-9b879fa60942-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:31 user nova-compute[73497]: DEBUG nova.compute.manager [req-cde3ccdd-16f5-4cab-b6f2-45324519b91d req-ecad0bbe-7285-44a2-9e8e-03e98827aa36 service nova] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] No waiting events found dispatching network-vif-plugged-4d4d1845-f715-4bc2-a00a-9ac1fc39da48 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:18:31 user nova-compute[73497]: WARNING nova.compute.manager [req-cde3ccdd-16f5-4cab-b6f2-45324519b91d req-ecad0bbe-7285-44a2-9e8e-03e98827aa36 service nova] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Received unexpected event network-vif-plugged-4d4d1845-f715-4bc2-a00a-9ac1fc39da48 for instance with vm_state deleted and task_state None.
Aug 26 23:18:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:40 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:41 user nova-compute[73497]: DEBUG nova.compute.manager [req-1b6ada46-2df6-423a-8be4-fc99ea2aea58 req-1b67bd0b-edff-4112-8d29-fe1535a544ee service nova] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Received event network-changed-744f8df2-5712-4df4-a4e6-d7705b4d3cc7 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:18:41 user nova-compute[73497]: DEBUG nova.compute.manager [req-1b6ada46-2df6-423a-8be4-fc99ea2aea58 req-1b67bd0b-edff-4112-8d29-fe1535a544ee service nova] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Refreshing instance network info cache due to event network-changed-744f8df2-5712-4df4-a4e6-d7705b4d3cc7. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:18:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1b6ada46-2df6-423a-8be4-fc99ea2aea58 req-1b67bd0b-edff-4112-8d29-fe1535a544ee service nova] Acquiring lock "refresh_cache-b68b6975-a24a-4861-a583-406b02446ea0" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:18:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1b6ada46-2df6-423a-8be4-fc99ea2aea58 req-1b67bd0b-edff-4112-8d29-fe1535a544ee service nova] Acquired lock "refresh_cache-b68b6975-a24a-4861-a583-406b02446ea0" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:18:41 user nova-compute[73497]: DEBUG nova.network.neutron [req-1b6ada46-2df6-423a-8be4-fc99ea2aea58 req-1b67bd0b-edff-4112-8d29-fe1535a544ee service nova] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Refreshing network info cache for port 744f8df2-5712-4df4-a4e6-d7705b4d3cc7 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:18:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "b68b6975-a24a-4861-a583-406b02446ea0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "b68b6975-a24a-4861-a583-406b02446ea0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:42 user nova-compute[73497]: DEBUG nova.objects.instance [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lazy-loading 'flavor' on Instance uuid b68b6975-a24a-4861-a583-406b02446ea0 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:18:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "b68b6975-a24a-4861-a583-406b02446ea0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "b68b6975-a24a-4861-a583-406b02446ea0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "b68b6975-a24a-4861-a583-406b02446ea0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:42 user nova-compute[73497]: INFO nova.compute.manager [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Attaching volume 366d637e-5a2e-4301-b2a1-0b5bcb485c10 to /dev/vdb
Aug 26 23:18:42 user nova-compute[73497]: DEBUG os_brick.utils [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:18:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:42 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[28899295-5b73-4cc7-8070-2caf520dafdc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:18:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:42 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86c6b50-d85f-4cca-9fb6-c944c39bc7c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:18:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:42 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[691510e0-37c7-4b24-93c9-b3d19fb683f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:18:42 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cba489-a134-4190-98f7-364c28481d27]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:18:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:18:42 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:18:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:18:42 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:18:42 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d12b621-ba97-4f28-9d01-252b8103244e]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:18:42 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:18:42 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:18:42 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:18:42 user nova-compute[73497]: DEBUG os_brick.utils [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:18:42 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Updating existing volume attachment record: 439dd1b0-1e13-4514-8dd2-b6cf07124daf {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:18:42 user nova-compute[73497]: DEBUG nova.network.neutron [req-1b6ada46-2df6-423a-8be4-fc99ea2aea58 req-1b67bd0b-edff-4112-8d29-fe1535a544ee service nova] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Updated VIF entry in instance network info cache for port 744f8df2-5712-4df4-a4e6-d7705b4d3cc7. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:18:42 user nova-compute[73497]: DEBUG nova.network.neutron [req-1b6ada46-2df6-423a-8be4-fc99ea2aea58 req-1b67bd0b-edff-4112-8d29-fe1535a544ee service nova] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Updating instance_info_cache with network_info: [{"id": "744f8df2-5712-4df4-a4e6-d7705b4d3cc7", "address": "fa:16:3e:03:fd:29", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744f8df2-57", "ovs_interfaceid": "744f8df2-5712-4df4-a4e6-d7705b4d3cc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:18:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1b6ada46-2df6-423a-8be4-fc99ea2aea58 req-1b67bd0b-edff-4112-8d29-fe1535a544ee service nova] Releasing lock "refresh_cache-b68b6975-a24a-4861-a583-406b02446ea0" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:18:43 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:18:43 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Cleaning up deleted instances {{(pid=73497) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 23:18:43 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] There are 0 instances to clean {{(pid=73497) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 23:18:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:44 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:18:44 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Cleaning up deleted instances with incomplete migration  {{(pid=73497) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 23:18:45 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693091910.1768947, a19ccf77-8c30-44af-bd19-9b879fa60942 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:18:45 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] VM Stopped (Lifecycle Event)
Aug 26 23:18:45 user nova-compute[73497]: DEBUG nova.compute.manager [None req-1e92dd2c-eae7-495f-b192-0076913dc0b6 None None] [instance: a19ccf77-8c30-44af-bd19-9b879fa60942] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:18:45 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:46 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:18:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "043294e5-0618-4a31-bb19-1227ef1f5d39" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "043294e5-0618-4a31-bb19-1227ef1f5d39" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:48 user nova-compute[73497]: DEBUG nova.compute.manager [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:18:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:48 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:18:48 user nova-compute[73497]: INFO nova.compute.claims [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Claim successful on node user
Aug 26 23:18:48 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:18:48 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:18:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.444s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:48 user nova-compute[73497]: DEBUG nova.compute.manager [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:18:48 user nova-compute[73497]: DEBUG nova.compute.manager [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:18:48 user nova-compute[73497]: DEBUG nova.network.neutron [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:18:48 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:18:48 user nova-compute[73497]: DEBUG nova.compute.manager [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:18:48 user nova-compute[73497]: DEBUG nova.policy [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'af64aa253eec41a0976c3e527fe41831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4ca787dd33440d98779668507369ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:18:49 user nova-compute[73497]: DEBUG nova.compute.manager [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:18:49 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:18:49 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Creating image(s)
Aug 26 23:18:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "/opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "/opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "/opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:49 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:18:49 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:18:49 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:18:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.208s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:49 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:18:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.192s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk 1073741824" returned: 0 in 0.061s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:49 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:18:49 user nova-compute[73497]: INFO nova.compute.claims [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Claim successful on node user
Aug 26 23:18:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.223s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:49 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Checking if we can resize image /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:18:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:49 user nova-compute[73497]: DEBUG nova.network.neutron [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Successfully created port: de273950-9851-448e-8ca2-ac699c12994e {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:18:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:49 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Cannot resize image /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:18:49 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:18:49 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Ensure instance console log exists: /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:18:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.645s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG nova.network.neutron [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:18:50 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:18:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:18:50 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Creating image(s)
Aug 26 23:18:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "/opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "/opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "/opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG nova.policy [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'af64aa253eec41a0976c3e527fe41831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4ca787dd33440d98779668507369ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.174s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG nova.network.neutron [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Successfully updated port: de273950-9851-448e-8ca2-ac699c12994e {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "refresh_cache-043294e5-0618-4a31-bb19-1227ef1f5d39" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquired lock "refresh_cache-043294e5-0618-4a31-bb19-1227ef1f5d39" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG nova.network.neutron [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.210s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG nova.compute.manager [req-9204c809-4514-45c1-adc1-c8b24908c49e req-2b7bbc11-b57e-4c98-ac7f-3b2449506519 service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Received event network-changed-de273950-9851-448e-8ca2-ac699c12994e {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG nova.compute.manager [req-9204c809-4514-45c1-adc1-c8b24908c49e req-2b7bbc11-b57e-4c98-ac7f-3b2449506519 service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Refreshing instance network info cache due to event network-changed-de273950-9851-448e-8ca2-ac699c12994e. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9204c809-4514-45c1-adc1-c8b24908c49e req-2b7bbc11-b57e-4c98-ac7f-3b2449506519 service nova] Acquiring lock "refresh_cache-043294e5-0618-4a31-bb19-1227ef1f5d39" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG nova.network.neutron [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk 1073741824" returned: 0 in 0.082s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.298s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.210s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Cannot resize image /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Ensure instance console log exists: /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG nova.network.neutron [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Updating instance_info_cache with network_info: [{"id": "de273950-9851-448e-8ca2-ac699c12994e", "address": "fa:16:3e:fe:2b:69", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde273950-98", "ovs_interfaceid": "de273950-9851-448e-8ca2-ac699c12994e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG nova.network.neutron [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Successfully created port: 3de77772-78de-4261-b064-d1c2d8e30b31 {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Releasing lock "refresh_cache-043294e5-0618-4a31-bb19-1227ef1f5d39" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG nova.compute.manager [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Instance network_info: |[{"id": "de273950-9851-448e-8ca2-ac699c12994e", "address": "fa:16:3e:fe:2b:69", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde273950-98", "ovs_interfaceid": "de273950-9851-448e-8ca2-ac699c12994e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9204c809-4514-45c1-adc1-c8b24908c49e req-2b7bbc11-b57e-4c98-ac7f-3b2449506519 service nova] Acquired lock "refresh_cache-043294e5-0618-4a31-bb19-1227ef1f5d39" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG nova.network.neutron [req-9204c809-4514-45c1-adc1-c8b24908c49e req-2b7bbc11-b57e-4c98-ac7f-3b2449506519 service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Refreshing network info cache for port de273950-9851-448e-8ca2-ac699c12994e {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Start _get_guest_xml network_info=[{"id": "de273950-9851-448e-8ca2-ac699c12994e", "address": "fa:16:3e:fe:2b:69", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde273950-98", "ovs_interfaceid": "de273950-9851-448e-8ca2-ac699c12994e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:18:51 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:18:51 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:18:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:18:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1111344785',display_name='tempest-ServerRescueNegativeTestJSON-server-1111344785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1111344785',id=19,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c4ca787dd33440d98779668507369ee',ramdisk_id='',reservation_id='r-mq6jhfdi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1946187856',owner_user_name='tempest-ServerRescueNegativeTestJSON-1946187856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:18:49Z,user_data=None,user_id='af64aa253eec41a0976c3e527fe41831',uuid=043294e5-0618-4a31-bb19-1227ef1f5d39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de273950-9851-448e-8ca2-ac699c12994e", "address": "fa:16:3e:fe:2b:69", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde273950-98", "ovs_interfaceid": "de273950-9851-448e-8ca2-ac699c12994e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Converting VIF {"id": "de273950-9851-448e-8ca2-ac699c12994e", "address": "fa:16:3e:fe:2b:69", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde273950-98", "ovs_interfaceid": "de273950-9851-448e-8ca2-ac699c12994e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:2b:69,bridge_name='br-int',has_traffic_filtering=True,id=de273950-9851-448e-8ca2-ac699c12994e,network=Network(6f13f07f-104d-4d8d-b5fa-afa402402a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde273950-98') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG nova.objects.instance [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lazy-loading 'pci_devices' on Instance uuid 043294e5-0618-4a31-bb19-1227ef1f5d39 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:18:51 user nova-compute[73497]:   <uuid>043294e5-0618-4a31-bb19-1227ef1f5d39</uuid>
Aug 26 23:18:51 user nova-compute[73497]:   <name>instance-00000013</name>
Aug 26 23:18:51 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:18:51 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:18:51 user nova-compute[73497]:   <metadata>
Aug 26 23:18:51 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:18:51 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:18:51 user nova-compute[73497]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1111344785</nova:name>
Aug 26 23:18:51 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:18:51</nova:creationTime>
Aug 26 23:18:51 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:18:51 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:18:51 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:18:51 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:18:51 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:18:51 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:18:51 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:18:51 user nova-compute[73497]:       <nova:owner>
Aug 26 23:18:51 user nova-compute[73497]:         <nova:user uuid="af64aa253eec41a0976c3e527fe41831">tempest-ServerRescueNegativeTestJSON-1946187856-project-member</nova:user>
Aug 26 23:18:51 user nova-compute[73497]:         <nova:project uuid="0c4ca787dd33440d98779668507369ee">tempest-ServerRescueNegativeTestJSON-1946187856</nova:project>
Aug 26 23:18:51 user nova-compute[73497]:       </nova:owner>
Aug 26 23:18:51 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:18:51 user nova-compute[73497]:       <nova:ports>
Aug 26 23:18:51 user nova-compute[73497]:         <nova:port uuid="de273950-9851-448e-8ca2-ac699c12994e">
Aug 26 23:18:51 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 23:18:51 user nova-compute[73497]:         </nova:port>
Aug 26 23:18:51 user nova-compute[73497]:       </nova:ports>
Aug 26 23:18:51 user nova-compute[73497]:     </nova:instance>
Aug 26 23:18:51 user nova-compute[73497]:   </metadata>
Aug 26 23:18:51 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:18:51 user nova-compute[73497]:     <system>
Aug 26 23:18:51 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:18:51 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:18:51 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:18:51 user nova-compute[73497]:       <entry name="serial">043294e5-0618-4a31-bb19-1227ef1f5d39</entry>
Aug 26 23:18:51 user nova-compute[73497]:       <entry name="uuid">043294e5-0618-4a31-bb19-1227ef1f5d39</entry>
Aug 26 23:18:51 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:18:51 user nova-compute[73497]:     </system>
Aug 26 23:18:51 user nova-compute[73497]:   </sysinfo>
Aug 26 23:18:51 user nova-compute[73497]:   <os>
Aug 26 23:18:51 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:18:51 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:18:51 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:18:51 user nova-compute[73497]:   </os>
Aug 26 23:18:51 user nova-compute[73497]:   <features>
Aug 26 23:18:51 user nova-compute[73497]:     <acpi/>
Aug 26 23:18:51 user nova-compute[73497]:     <apic/>
Aug 26 23:18:51 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:18:51 user nova-compute[73497]:   </features>
Aug 26 23:18:51 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:18:51 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:18:51 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:18:51 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:18:51 user nova-compute[73497]:   </clock>
Aug 26 23:18:51 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:18:51 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:18:51 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:18:51 user nova-compute[73497]:   </cpu>
Aug 26 23:18:51 user nova-compute[73497]:   <devices>
Aug 26 23:18:51 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:18:51 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:18:51 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk"/>
Aug 26 23:18:51 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:18:51 user nova-compute[73497]:     </disk>
Aug 26 23:18:51 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:18:51 user nova-compute[73497]:       <mac address="fa:16:3e:fe:2b:69"/>
Aug 26 23:18:51 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:18:51 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:18:51 user nova-compute[73497]:       <target dev="tapde273950-98"/>
Aug 26 23:18:51 user nova-compute[73497]:     </interface>
Aug 26 23:18:51 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:18:51 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/console.log" append="off"/>
Aug 26 23:18:51 user nova-compute[73497]:     </serial>
Aug 26 23:18:51 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:18:51 user nova-compute[73497]:     <video>
Aug 26 23:18:51 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:18:51 user nova-compute[73497]:     </video>
Aug 26 23:18:51 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:18:51 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:18:51 user nova-compute[73497]:     </rng>
Aug 26 23:18:51 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:18:51 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:18:51 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:18:51 user nova-compute[73497]:     </memballoon>
Aug 26 23:18:51 user nova-compute[73497]:   </devices>
Aug 26 23:18:51 user nova-compute[73497]: </domain>
Aug 26 23:18:51 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:18:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1111344785',display_name='tempest-ServerRescueNegativeTestJSON-server-1111344785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1111344785',id=19,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c4ca787dd33440d98779668507369ee',ramdisk_id='',reservation_id='r-mq6jhfdi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1946187856',owner_user_name='tempest-ServerRescueNegativeTestJSON-1946187856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:18:49Z,user_data=None,user_id='af64aa253eec41a0976c3e527fe41831',uuid=043294e5-0618-4a31-bb19-1227ef1f5d39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de273950-9851-448e-8ca2-ac699c12994e", "address": "fa:16:3e:fe:2b:69", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde273950-98", "ovs_interfaceid": "de273950-9851-448e-8ca2-ac699c12994e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Converting VIF {"id": "de273950-9851-448e-8ca2-ac699c12994e", "address": "fa:16:3e:fe:2b:69", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde273950-98", "ovs_interfaceid": "de273950-9851-448e-8ca2-ac699c12994e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:2b:69,bridge_name='br-int',has_traffic_filtering=True,id=de273950-9851-448e-8ca2-ac699c12994e,network=Network(6f13f07f-104d-4d8d-b5fa-afa402402a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde273950-98') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG os_vif [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:2b:69,bridge_name='br-int',has_traffic_filtering=True,id=de273950-9851-448e-8ca2-ac699c12994e,network=Network(6f13f07f-104d-4d8d-b5fa-afa402402a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde273950-98') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde273950-98, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapde273950-98, col_values=(('external_ids', {'iface-id': 'de273950-9851-448e-8ca2-ac699c12994e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:2b:69', 'vm-uuid': '043294e5-0618-4a31-bb19-1227ef1f5d39'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:51 user nova-compute[73497]: INFO os_vif [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:2b:69,bridge_name='br-int',has_traffic_filtering=True,id=de273950-9851-448e-8ca2-ac699c12994e,network=Network(6f13f07f-104d-4d8d-b5fa-afa402402a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde273950-98')
Aug 26 23:18:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] No VIF found with MAC fa:16:3e:fe:2b:69, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:52 user nova-compute[73497]: DEBUG nova.network.neutron [req-9204c809-4514-45c1-adc1-c8b24908c49e req-2b7bbc11-b57e-4c98-ac7f-3b2449506519 service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Updated VIF entry in instance network info cache for port de273950-9851-448e-8ca2-ac699c12994e. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:18:52 user nova-compute[73497]: DEBUG nova.network.neutron [req-9204c809-4514-45c1-adc1-c8b24908c49e req-2b7bbc11-b57e-4c98-ac7f-3b2449506519 service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Updating instance_info_cache with network_info: [{"id": "de273950-9851-448e-8ca2-ac699c12994e", "address": "fa:16:3e:fe:2b:69", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde273950-98", "ovs_interfaceid": "de273950-9851-448e-8ca2-ac699c12994e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:18:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9204c809-4514-45c1-adc1-c8b24908c49e req-2b7bbc11-b57e-4c98-ac7f-3b2449506519 service nova] Releasing lock "refresh_cache-043294e5-0618-4a31-bb19-1227ef1f5d39" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:18:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:52 user nova-compute[73497]: DEBUG nova.network.neutron [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Successfully updated port: 3de77772-78de-4261-b064-d1c2d8e30b31 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:18:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "refresh_cache-e9e5c83f-0678-48d4-a81f-1a3f959aabcf" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:18:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquired lock "refresh_cache-e9e5c83f-0678-48d4-a81f-1a3f959aabcf" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:18:52 user nova-compute[73497]: DEBUG nova.network.neutron [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:18:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:52 user nova-compute[73497]: DEBUG nova.compute.manager [req-7d4f081e-d38d-4bd6-a228-1ec91af91b13 req-43fafc5e-d321-4806-8491-35305c37a17e service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Received event network-changed-3de77772-78de-4261-b064-d1c2d8e30b31 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:18:52 user nova-compute[73497]: DEBUG nova.compute.manager [req-7d4f081e-d38d-4bd6-a228-1ec91af91b13 req-43fafc5e-d321-4806-8491-35305c37a17e service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Refreshing instance network info cache due to event network-changed-3de77772-78de-4261-b064-d1c2d8e30b31. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:18:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7d4f081e-d38d-4bd6-a228-1ec91af91b13 req-43fafc5e-d321-4806-8491-35305c37a17e service nova] Acquiring lock "refresh_cache-e9e5c83f-0678-48d4-a81f-1a3f959aabcf" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:18:52 user nova-compute[73497]: DEBUG nova.network.neutron [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:18:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:52 user nova-compute[73497]: DEBUG nova.network.neutron [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Updating instance_info_cache with network_info: [{"id": "3de77772-78de-4261-b064-d1c2d8e30b31", "address": "fa:16:3e:d7:8d:5d", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de77772-78", "ovs_interfaceid": "3de77772-78de-4261-b064-d1c2d8e30b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Releasing lock "refresh_cache-e9e5c83f-0678-48d4-a81f-1a3f959aabcf" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Instance network_info: |[{"id": "3de77772-78de-4261-b064-d1c2d8e30b31", "address": "fa:16:3e:d7:8d:5d", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de77772-78", "ovs_interfaceid": "3de77772-78de-4261-b064-d1c2d8e30b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7d4f081e-d38d-4bd6-a228-1ec91af91b13 req-43fafc5e-d321-4806-8491-35305c37a17e service nova] Acquired lock "refresh_cache-e9e5c83f-0678-48d4-a81f-1a3f959aabcf" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG nova.network.neutron [req-7d4f081e-d38d-4bd6-a228-1ec91af91b13 req-43fafc5e-d321-4806-8491-35305c37a17e service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Refreshing network info cache for port 3de77772-78de-4261-b064-d1c2d8e30b31 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Start _get_guest_xml network_info=[{"id": "3de77772-78de-4261-b064-d1c2d8e30b31", "address": "fa:16:3e:d7:8d:5d", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de77772-78", "ovs_interfaceid": "3de77772-78de-4261-b064-d1c2d8e30b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:18:53 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:18:53 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:18:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:18:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-10306177',display_name='tempest-ServerRescueNegativeTestJSON-server-10306177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-10306177',id=20,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c4ca787dd33440d98779668507369ee',ramdisk_id='',reservation_id='r-x1p8i7zq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1946187856',owner_user_name='tempest-ServerRescueNegativeTestJSON-1946187856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:18:50Z,user_data=None,user_id='af64aa253eec41a0976c3e527fe41831',uuid=e9e5c83f-0678-48d4-a81f-1a3f959aabcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3de77772-78de-4261-b064-d1c2d8e30b31", "address": "fa:16:3e:d7:8d:5d", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de77772-78", "ovs_interfaceid": "3de77772-78de-4261-b064-d1c2d8e30b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Converting VIF {"id": "3de77772-78de-4261-b064-d1c2d8e30b31", "address": "fa:16:3e:d7:8d:5d", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de77772-78", "ovs_interfaceid": "3de77772-78de-4261-b064-d1c2d8e30b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:8d:5d,bridge_name='br-int',has_traffic_filtering=True,id=3de77772-78de-4261-b064-d1c2d8e30b31,network=Network(6f13f07f-104d-4d8d-b5fa-afa402402a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de77772-78') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG nova.objects.instance [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lazy-loading 'pci_devices' on Instance uuid e9e5c83f-0678-48d4-a81f-1a3f959aabcf {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:18:53 user nova-compute[73497]:   <uuid>e9e5c83f-0678-48d4-a81f-1a3f959aabcf</uuid>
Aug 26 23:18:53 user nova-compute[73497]:   <name>instance-00000014</name>
Aug 26 23:18:53 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:18:53 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:18:53 user nova-compute[73497]:   <metadata>
Aug 26 23:18:53 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:18:53 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:18:53 user nova-compute[73497]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-10306177</nova:name>
Aug 26 23:18:53 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:18:53</nova:creationTime>
Aug 26 23:18:53 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:18:53 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:18:53 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:18:53 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:18:53 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:18:53 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:18:53 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:18:53 user nova-compute[73497]:       <nova:owner>
Aug 26 23:18:53 user nova-compute[73497]:         <nova:user uuid="af64aa253eec41a0976c3e527fe41831">tempest-ServerRescueNegativeTestJSON-1946187856-project-member</nova:user>
Aug 26 23:18:53 user nova-compute[73497]:         <nova:project uuid="0c4ca787dd33440d98779668507369ee">tempest-ServerRescueNegativeTestJSON-1946187856</nova:project>
Aug 26 23:18:53 user nova-compute[73497]:       </nova:owner>
Aug 26 23:18:53 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:18:53 user nova-compute[73497]:       <nova:ports>
Aug 26 23:18:53 user nova-compute[73497]:         <nova:port uuid="3de77772-78de-4261-b064-d1c2d8e30b31">
Aug 26 23:18:53 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 23:18:53 user nova-compute[73497]:         </nova:port>
Aug 26 23:18:53 user nova-compute[73497]:       </nova:ports>
Aug 26 23:18:53 user nova-compute[73497]:     </nova:instance>
Aug 26 23:18:53 user nova-compute[73497]:   </metadata>
Aug 26 23:18:53 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:18:53 user nova-compute[73497]:     <system>
Aug 26 23:18:53 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:18:53 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:18:53 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:18:53 user nova-compute[73497]:       <entry name="serial">e9e5c83f-0678-48d4-a81f-1a3f959aabcf</entry>
Aug 26 23:18:53 user nova-compute[73497]:       <entry name="uuid">e9e5c83f-0678-48d4-a81f-1a3f959aabcf</entry>
Aug 26 23:18:53 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:18:53 user nova-compute[73497]:     </system>
Aug 26 23:18:53 user nova-compute[73497]:   </sysinfo>
Aug 26 23:18:53 user nova-compute[73497]:   <os>
Aug 26 23:18:53 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:18:53 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:18:53 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:18:53 user nova-compute[73497]:   </os>
Aug 26 23:18:53 user nova-compute[73497]:   <features>
Aug 26 23:18:53 user nova-compute[73497]:     <acpi/>
Aug 26 23:18:53 user nova-compute[73497]:     <apic/>
Aug 26 23:18:53 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:18:53 user nova-compute[73497]:   </features>
Aug 26 23:18:53 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:18:53 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:18:53 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:18:53 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:18:53 user nova-compute[73497]:   </clock>
Aug 26 23:18:53 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:18:53 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:18:53 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:18:53 user nova-compute[73497]:   </cpu>
Aug 26 23:18:53 user nova-compute[73497]:   <devices>
Aug 26 23:18:53 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:18:53 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:18:53 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk"/>
Aug 26 23:18:53 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:18:53 user nova-compute[73497]:     </disk>
Aug 26 23:18:53 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:18:53 user nova-compute[73497]:       <mac address="fa:16:3e:d7:8d:5d"/>
Aug 26 23:18:53 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:18:53 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:18:53 user nova-compute[73497]:       <target dev="tap3de77772-78"/>
Aug 26 23:18:53 user nova-compute[73497]:     </interface>
Aug 26 23:18:53 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:18:53 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/console.log" append="off"/>
Aug 26 23:18:53 user nova-compute[73497]:     </serial>
Aug 26 23:18:53 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:18:53 user nova-compute[73497]:     <video>
Aug 26 23:18:53 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:18:53 user nova-compute[73497]:     </video>
Aug 26 23:18:53 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:18:53 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:18:53 user nova-compute[73497]:     </rng>
Aug 26 23:18:53 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:18:53 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:18:53 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:18:53 user nova-compute[73497]:     </memballoon>
Aug 26 23:18:53 user nova-compute[73497]:   </devices>
Aug 26 23:18:53 user nova-compute[73497]: </domain>
Aug 26 23:18:53 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:18:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-10306177',display_name='tempest-ServerRescueNegativeTestJSON-server-10306177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-10306177',id=20,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c4ca787dd33440d98779668507369ee',ramdisk_id='',reservation_id='r-x1p8i7zq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1946187856',owner_user_name='tempest-ServerRescueNegativeTestJSON-1946187856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:18:50Z,user_data=None,user_id='af64aa253eec41a0976c3e527fe41831',uuid=e9e5c83f-0678-48d4-a81f-1a3f959aabcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3de77772-78de-4261-b064-d1c2d8e30b31", "address": "fa:16:3e:d7:8d:5d", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de77772-78", "ovs_interfaceid": "3de77772-78de-4261-b064-d1c2d8e30b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Converting VIF {"id": "3de77772-78de-4261-b064-d1c2d8e30b31", "address": "fa:16:3e:d7:8d:5d", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de77772-78", "ovs_interfaceid": "3de77772-78de-4261-b064-d1c2d8e30b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:8d:5d,bridge_name='br-int',has_traffic_filtering=True,id=3de77772-78de-4261-b064-d1c2d8e30b31,network=Network(6f13f07f-104d-4d8d-b5fa-afa402402a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de77772-78') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG os_vif [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:8d:5d,bridge_name='br-int',has_traffic_filtering=True,id=3de77772-78de-4261-b064-d1c2d8e30b31,network=Network(6f13f07f-104d-4d8d-b5fa-afa402402a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de77772-78') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3de77772-78, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3de77772-78, col_values=(('external_ids', {'iface-id': '3de77772-78de-4261-b064-d1c2d8e30b31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:8d:5d', 'vm-uuid': 'e9e5c83f-0678-48d4-a81f-1a3f959aabcf'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:53 user nova-compute[73497]: INFO os_vif [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:8d:5d,bridge_name='br-int',has_traffic_filtering=True,id=3de77772-78de-4261-b064-d1c2d8e30b31,network=Network(6f13f07f-104d-4d8d-b5fa-afa402402a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de77772-78')
Aug 26 23:18:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] No VIF found with MAC fa:16:3e:d7:8d:5d, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG nova.network.neutron [req-7d4f081e-d38d-4bd6-a228-1ec91af91b13 req-43fafc5e-d321-4806-8491-35305c37a17e service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Updated VIF entry in instance network info cache for port 3de77772-78de-4261-b064-d1c2d8e30b31. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG nova.network.neutron [req-7d4f081e-d38d-4bd6-a228-1ec91af91b13 req-43fafc5e-d321-4806-8491-35305c37a17e service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Updating instance_info_cache with network_info: [{"id": "3de77772-78de-4261-b064-d1c2d8e30b31", "address": "fa:16:3e:d7:8d:5d", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de77772-78", "ovs_interfaceid": "3de77772-78de-4261-b064-d1c2d8e30b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7d4f081e-d38d-4bd6-a228-1ec91af91b13 req-43fafc5e-d321-4806-8491-35305c37a17e service nova] Releasing lock "refresh_cache-e9e5c83f-0678-48d4-a81f-1a3f959aabcf" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG nova.compute.manager [req-7eb9049e-8a9e-492f-8907-ee4c0a4fae85 req-d63e4018-9009-470b-b368-54e83fb186f9 service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Received event network-vif-plugged-de273950-9851-448e-8ca2-ac699c12994e {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7eb9049e-8a9e-492f-8907-ee4c0a4fae85 req-d63e4018-9009-470b-b368-54e83fb186f9 service nova] Acquiring lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7eb9049e-8a9e-492f-8907-ee4c0a4fae85 req-d63e4018-9009-470b-b368-54e83fb186f9 service nova] Lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7eb9049e-8a9e-492f-8907-ee4c0a4fae85 req-d63e4018-9009-470b-b368-54e83fb186f9 service nova] Lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG nova.compute.manager [req-7eb9049e-8a9e-492f-8907-ee4c0a4fae85 req-d63e4018-9009-470b-b368-54e83fb186f9 service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] No waiting events found dispatching network-vif-plugged-de273950-9851-448e-8ca2-ac699c12994e {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:18:53 user nova-compute[73497]: WARNING nova.compute.manager [req-7eb9049e-8a9e-492f-8907-ee4c0a4fae85 req-d63e4018-9009-470b-b368-54e83fb186f9 service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Received unexpected event network-vif-plugged-de273950-9851-448e-8ca2-ac699c12994e for instance with vm_state building and task_state spawning.
Aug 26 23:18:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:18:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aebaeda6-23d1-43a1-afc8-bdc8992067e5/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aebaeda6-23d1-43a1-afc8-bdc8992067e5/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aebaeda6-23d1-43a1-afc8-bdc8992067e5/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aebaeda6-23d1-43a1-afc8-bdc8992067e5/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091936.7688107, 043294e5-0618-4a31-bb19-1227ef1f5d39 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:18:57 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] VM Resumed (Lifecycle Event)
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.compute.manager [req-cbe161cd-36dc-4cbb-96ac-3936911b83b3 req-1252fc8a-a012-47bf-8e2f-2c3ad61356b5 service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Received event network-vif-plugged-3de77772-78de-4261-b064-d1c2d8e30b31 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cbe161cd-36dc-4cbb-96ac-3936911b83b3 req-1252fc8a-a012-47bf-8e2f-2c3ad61356b5 service nova] Acquiring lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cbe161cd-36dc-4cbb-96ac-3936911b83b3 req-1252fc8a-a012-47bf-8e2f-2c3ad61356b5 service nova] Lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cbe161cd-36dc-4cbb-96ac-3936911b83b3 req-1252fc8a-a012-47bf-8e2f-2c3ad61356b5 service nova] Lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.compute.manager [req-cbe161cd-36dc-4cbb-96ac-3936911b83b3 req-1252fc8a-a012-47bf-8e2f-2c3ad61356b5 service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] No waiting events found dispatching network-vif-plugged-3de77772-78de-4261-b064-d1c2d8e30b31 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:18:57 user nova-compute[73497]: WARNING nova.compute.manager [req-cbe161cd-36dc-4cbb-96ac-3936911b83b3 req-1252fc8a-a012-47bf-8e2f-2c3ad61356b5 service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Received unexpected event network-vif-plugged-3de77772-78de-4261-b064-d1c2d8e30b31 for instance with vm_state building and task_state spawning.
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.compute.manager [req-a27f45ff-4183-443a-99cf-9a353ca77c9b req-39e062c9-c009-493a-a7a6-b358678d7909 service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Received event network-vif-plugged-de273950-9851-448e-8ca2-ac699c12994e {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a27f45ff-4183-443a-99cf-9a353ca77c9b req-39e062c9-c009-493a-a7a6-b358678d7909 service nova] Acquiring lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a27f45ff-4183-443a-99cf-9a353ca77c9b req-39e062c9-c009-493a-a7a6-b358678d7909 service nova] Lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a27f45ff-4183-443a-99cf-9a353ca77c9b req-39e062c9-c009-493a-a7a6-b358678d7909 service nova] Lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.compute.manager [req-a27f45ff-4183-443a-99cf-9a353ca77c9b req-39e062c9-c009-493a-a7a6-b358678d7909 service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] No waiting events found dispatching network-vif-plugged-de273950-9851-448e-8ca2-ac699c12994e {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:18:57 user nova-compute[73497]: WARNING nova.compute.manager [req-a27f45ff-4183-443a-99cf-9a353ca77c9b req-39e062c9-c009-493a-a7a6-b358678d7909 service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Received unexpected event network-vif-plugged-de273950-9851-448e-8ca2-ac699c12994e for instance with vm_state building and task_state spawning.
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'svqUICKd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:18:57 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:18:57 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:18:57 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:18:57 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:18:57 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:57 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Instance spawned successfully.
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:18:57 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:18:57 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=7297MB free_disk=25.352497100830078GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff44a96-87ee-4aea-a4aa-3a7ceb0476e2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:18:57 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:57 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091936.7698846, 043294e5-0618-4a31-bb19-1227ef1f5d39 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:18:57 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] VM Started (Lifecycle Event)
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb3a405-5843-443e-923d-46d05aa3c98f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10] added
Aug 26 23:18:57 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.compute.manager [req-0bfaeecc-bbe0-4a0a-8324-b7b9458ec1f5 req-ff217526-2baa-41a5-8828-4e12e89272ad service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Received event network-vif-plugged-3de77772-78de-4261-b064-d1c2d8e30b31 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0bfaeecc-bbe0-4a0a-8324-b7b9458ec1f5 req-ff217526-2baa-41a5-8828-4e12e89272ad service nova] Acquiring lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0bfaeecc-bbe0-4a0a-8324-b7b9458ec1f5 req-ff217526-2baa-41a5-8828-4e12e89272ad service nova] Lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0bfaeecc-bbe0-4a0a-8324-b7b9458ec1f5 req-ff217526-2baa-41a5-8828-4e12e89272ad service nova] Lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.compute.manager [req-0bfaeecc-bbe0-4a0a-8324-b7b9458ec1f5 req-ff217526-2baa-41a5-8828-4e12e89272ad service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] No waiting events found dispatching network-vif-plugged-3de77772-78de-4261-b064-d1c2d8e30b31 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:18:57 user nova-compute[73497]: WARNING nova.compute.manager [req-0bfaeecc-bbe0-4a0a-8324-b7b9458ec1f5 req-ff217526-2baa-41a5-8828-4e12e89272ad service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Received unexpected event network-vif-plugged-3de77772-78de-4261-b064-d1c2d8e30b31 for instance with vm_state building and task_state spawning.
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a28dec-5f08-4160-a1ce-c2004fe133ff]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abe60a5-7556-4630-89b2-ce0e37f9ad4c]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v svqUICKd {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:57 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v svqUICKd" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7966e709-7453-4bc9-a233-63e0d750e83f]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'svqUICKd'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adb64a6-6284-4729-9240-e11f4f01011b]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091937.3242064, e9e5c83f-0678-48d4-a81f-1a3f959aabcf => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:18:57 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] VM Resumed (Lifecycle Event)
Aug 26 23:18:57 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:18:57 user nova-compute[73497]: INFO nova.compute.manager [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Took 8.32 seconds to spawn the instance on the hypervisor.
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:57 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Instance spawned successfully.
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17203ef-f39e-471b-947d-e7715c3e6132]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:18:57 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:18:57 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 926f8e5c-8d8a-4f07-bf08-e60700ce4698 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 994093f0-e6b2-4c96-b259-c559ef2b1fbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 171985a3-358d-4b26-a66c-372b9b99b386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 1a58c5e7-b4c7-4bd5-8dd1-a98492139240 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance aebaeda6-23d1-43a1-afc8-bdc8992067e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance ee6283d5-40de-432d-997c-0be52ff673ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance b68b6975-a24a-4861-a583-406b02446ea0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance ff1085db-4bfc-4c77-a9e4-39f47ffb6d43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 7c124dd9-4dce-4c6f-925c-6eda8e187d84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 4c68f140-4235-4dcb-b99d-1347bc949d15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 043294e5-0618-4a31-bb19-1227ef1f5d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance e9e5c83f-0678-48d4-a81f-1a3f959aabcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:18:57 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091937.3247004, e9e5c83f-0678-48d4-a81f-1a3f959aabcf => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:18:57 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] VM Started (Lifecycle Event)
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[47887d20-4e8f-41d7-ad8e-151c1e0c6d70]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10, portal: 172.16.0.220,3260]
Aug 26 23:18:57 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10, portal: 172.16.0.220,3260] successful.
Aug 26 23:18:57 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e89ce0-a9f7-4664-b6b0-f38b2b8dd2e3]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:18:57 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:18:57 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4701f2cf-8313-4e23-a96a-cd2221b6ab89]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:18:57 user nova-compute[73497]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:18:57 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:18:57 user nova-compute[73497]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:18:57 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:18:57 user nova-compute[73497]: INFO nova.compute.manager [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Took 9.27 seconds to build instance.
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f02d79-896f-4600-b4ea-233f6b165752]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'svqUICKd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-eb657bbd-28d2-4d24-8532-237341759421 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "043294e5-0618-4a31-bb19-1227ef1f5d39" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.431s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:57 user nova-compute[73497]: INFO nova.compute.manager [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Took 7.22 seconds to spawn the instance on the hypervisor.
Aug 26 23:18:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:18:57 user nova-compute[73497]: INFO nova.compute.manager [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Took 8.29 seconds to build instance.
Aug 26 23:18:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9b9fbbc0-402a-460e-ba39-c55a766b5172 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.405s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:58 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:18:58 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:18:58 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:18:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.896s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:18:58 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:18:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:18:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23364373239353238', 'path': '/dev/sdb'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:18:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364373239353238', 'path': '/dev/sdb'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:18:58 user nova-compute[73497]: DEBUG nova.objects.instance [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lazy-loading 'flavor' on Instance uuid b68b6975-a24a-4861-a583-406b02446ea0 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:18:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 23:18:58 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:18:58 user nova-compute[73497]:   <source dev="/dev/sdb"/>
Aug 26 23:18:58 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:18:58 user nova-compute[73497]:   <serial>366d637e-5a2e-4301-b2a1-0b5bcb485c10</serial>
Aug 26 23:18:58 user nova-compute[73497]: </disk>
Aug 26 23:18:58 user nova-compute[73497]:  {{(pid=73497) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 23:18:59 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:18:59 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:18:59 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] No VIF found with MAC fa:16:3e:03:fd:29, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:18:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c40692e3-fe6d-4390-afb7-e0d09a442c60 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "b68b6975-a24a-4861-a583-406b02446ea0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.903s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:19:00 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:19:00 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:19:00 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:19:00 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:19:00 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Didn't find any instances for network info cache update. {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 23:19:00 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:19:00 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:19:00 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:19:00 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:19:00 user nova-compute[73497]: INFO nova.compute.manager [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Rebuilding instance
Aug 26 23:19:00 user nova-compute[73497]: DEBUG nova.compute.manager [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:19:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:00 user nova-compute[73497]: DEBUG nova.compute.manager [req-42e508da-1c62-42d2-839e-8cd0d95df6ea req-f8f1d29f-adc2-4e1a-9c94-cda7460ff87c service nova] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Received event network-vif-unplugged-744f8df2-5712-4df4-a4e6-d7705b4d3cc7 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:19:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-42e508da-1c62-42d2-839e-8cd0d95df6ea req-f8f1d29f-adc2-4e1a-9c94-cda7460ff87c service nova] Acquiring lock "b68b6975-a24a-4861-a583-406b02446ea0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:19:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-42e508da-1c62-42d2-839e-8cd0d95df6ea req-f8f1d29f-adc2-4e1a-9c94-cda7460ff87c service nova] Lock "b68b6975-a24a-4861-a583-406b02446ea0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:19:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-42e508da-1c62-42d2-839e-8cd0d95df6ea req-f8f1d29f-adc2-4e1a-9c94-cda7460ff87c service nova] Lock "b68b6975-a24a-4861-a583-406b02446ea0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:19:00 user nova-compute[73497]: DEBUG nova.compute.manager [req-42e508da-1c62-42d2-839e-8cd0d95df6ea req-f8f1d29f-adc2-4e1a-9c94-cda7460ff87c service nova] [instance: b68b6975-a24a-4861-a583-406b02446ea0] No waiting events found dispatching network-vif-unplugged-744f8df2-5712-4df4-a4e6-d7705b4d3cc7 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:19:00 user nova-compute[73497]: WARNING nova.compute.manager [req-42e508da-1c62-42d2-839e-8cd0d95df6ea req-f8f1d29f-adc2-4e1a-9c94-cda7460ff87c service nova] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Received unexpected event network-vif-unplugged-744f8df2-5712-4df4-a4e6-d7705b4d3cc7 for instance with vm_state active and task_state rebuilding.
Aug 26 23:19:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:01 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Instance destroyed successfully.
Aug 26 23:19:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:01 user nova-compute[73497]: INFO nova.compute.manager [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Detaching volume 366d637e-5a2e-4301-b2a1-0b5bcb485c10
Aug 26 23:19:01 user nova-compute[73497]: INFO nova.virt.block_device [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Attempting to driver detach volume 366d637e-5a2e-4301-b2a1-0b5bcb485c10 from mountpoint /dev/vdb
Aug 26 23:19:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Attempting to detach device vdb from instance b68b6975-a24a-4861-a583-406b02446ea0 from the persistent domain config. {{(pid=73497) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:19:01 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:19:01 user nova-compute[73497]:   <source dev="/dev/sdb"/>
Aug 26 23:19:01 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:19:01 user nova-compute[73497]:   <serial>366d637e-5a2e-4301-b2a1-0b5bcb485c10</serial>
Aug 26 23:19:01 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:19:01 user nova-compute[73497]: </disk>
Aug 26 23:19:01 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:19:01 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Successfully detached device vdb from instance b68b6975-a24a-4861-a583-406b02446ea0 from the persistent domain config.
Aug 26 23:19:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'svqUICKd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:19:01 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 23:19:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c4973d-f1c3-49a2-ac90-c34c231232fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[47579baa-1591-4c77-b013-0ba0080da48d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:19:01 user nova-compute[73497]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:19:01 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:19:01 user nova-compute[73497]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:19:01 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281c41f9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10'): ({'sdb'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Removing single pathed devices sdb {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a25810d-18e4-49fa-b5dd-53bedbb065bc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[47beb741-4a11-4b77-b592-720f0084e34a]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Flushing IO for device /dev/sdb {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[651bc368-f78f-4fac-82d2-ba8a3701f9a2]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd453f0-fb13-4dc1-b8de-a1633bd2d34d]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[21930917-9073-407f-a2ae-7dbaf9b51479]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7995104d-07c2-4b7d-80e8-d16ef814b2e8]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10, portal: 172.16.0.220,3260]
Aug 26 23:19:01 user nova-compute[73497]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10, portal: 172.16.0.220,3260] successful.
Aug 26 23:19:01 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c6f4cb-73a8-4a14-9742-e0821fbb2e4b]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] <== disconnect_volume: return (331ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:19:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:19:02 user nova-compute[73497]: DEBUG nova.compute.manager [req-cad7c48c-c3f9-4daf-84d3-b071e9952ca7 req-3f81b71b-0a64-4b7e-bb35-fb883c99808b service nova] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Received event network-vif-plugged-744f8df2-5712-4df4-a4e6-d7705b4d3cc7 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:19:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cad7c48c-c3f9-4daf-84d3-b071e9952ca7 req-3f81b71b-0a64-4b7e-bb35-fb883c99808b service nova] Acquiring lock "b68b6975-a24a-4861-a583-406b02446ea0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:19:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cad7c48c-c3f9-4daf-84d3-b071e9952ca7 req-3f81b71b-0a64-4b7e-bb35-fb883c99808b service nova] Lock "b68b6975-a24a-4861-a583-406b02446ea0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:19:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cad7c48c-c3f9-4daf-84d3-b071e9952ca7 req-3f81b71b-0a64-4b7e-bb35-fb883c99808b service nova] Lock "b68b6975-a24a-4861-a583-406b02446ea0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:19:02 user nova-compute[73497]: DEBUG nova.compute.manager [req-cad7c48c-c3f9-4daf-84d3-b071e9952ca7 req-3f81b71b-0a64-4b7e-bb35-fb883c99808b service nova] [instance: b68b6975-a24a-4861-a583-406b02446ea0] No waiting events found dispatching network-vif-plugged-744f8df2-5712-4df4-a4e6-d7705b4d3cc7 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:19:02 user nova-compute[73497]: WARNING nova.compute.manager [req-cad7c48c-c3f9-4daf-84d3-b071e9952ca7 req-3f81b71b-0a64-4b7e-bb35-fb883c99808b service nova] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Received unexpected event network-vif-plugged-744f8df2-5712-4df4-a4e6-d7705b4d3cc7 for instance with vm_state active and task_state rebuilding.
Aug 26 23:19:03 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Instance destroyed successfully.
Aug 26 23:19:03 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:16:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-625758251',display_name='tempest-ServerActionsTestOtherA-server-1293034491',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-625758251',id=15,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmg/g6/JqH0YLHZCpkD8rdnvMd23HQeTLvjge/Sh0DkE/Wj5zHdvAQ5fV67GK4vLmc3pz0PLw+2ofNRJAaMibeeNwiocztzy0e4AyExGxeymNeWH40DsExDFkx2358gAQ==',key_name='tempest-keypair-2050586917',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:16:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='80c212cbb083450ea15ec54a96f12510',ramdisk_id='',reservation_id='r-3tzokivj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-81910947',owner_user_name='tempest-ServerActionsTestOtherA-81910947-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:19:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='935b8635557949cfba9b6528b97da95f',uuid=b68b6975-a24a-4861-a583-406b02446ea0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "744f8df2-5712-4df4-a4e6-d7705b4d3cc7", "address": "fa:16:3e:03:fd:29", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744f8df2-57", "ovs_interfaceid": "744f8df2-5712-4df4-a4e6-d7705b4d3cc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Converting VIF {"id": "744f8df2-5712-4df4-a4e6-d7705b4d3cc7", "address": "fa:16:3e:03:fd:29", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744f8df2-57", "ovs_interfaceid": "744f8df2-5712-4df4-a4e6-d7705b4d3cc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:fd:29,bridge_name='br-int',has_traffic_filtering=True,id=744f8df2-5712-4df4-a4e6-d7705b4d3cc7,network=Network(bf99a38a-faaf-4f1e-a161-736ce9089919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744f8df2-57') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG os_vif [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:fd:29,bridge_name='br-int',has_traffic_filtering=True,id=744f8df2-5712-4df4-a4e6-d7705b4d3cc7,network=Network(bf99a38a-faaf-4f1e-a161-736ce9089919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744f8df2-57') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap744f8df2-57, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:19:03 user nova-compute[73497]: INFO os_vif [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:fd:29,bridge_name='br-int',has_traffic_filtering=True,id=744f8df2-5712-4df4-a4e6-d7705b4d3cc7,network=Network(bf99a38a-faaf-4f1e-a161-736ce9089919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744f8df2-57')
Aug 26 23:19:03 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'svqUICKd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:19:03 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 23:19:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1f5273-a6be-4bad-a259-bef39b5a3c47]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c437e72-3241-4595-a703-8b5d60be1779]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:19:03 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:19:03 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281c5783a0>, {}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Disconnecting from: [] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.053s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] <== disconnect_volume: return (54ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:19:03 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Deleting instance files /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0_del
Aug 26 23:19:03 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Deletion of /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0_del complete
Aug 26 23:19:03 user nova-compute[73497]: INFO nova.virt.block_device [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Booting with volume 366d637e-5a2e-4301-b2a1-0b5bcb485c10 at /dev/vdb
Aug 26 23:19:03 user nova-compute[73497]: DEBUG os_brick.utils [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc4e3e0-4973-4f2b-a4cb-7077899ae36f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d855bec7-70ed-4348-a719-389a635f8579]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f20cc89-c96a-4bf8-a699-14c7cf50a6e7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[634dc1d0-d68b-47de-b452-54e9d13fe851]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:19:03 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:19:03 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[46120c30-1cc3-47d2-b3b9-e8fb493adc4e]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG os_brick.utils [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:19:03 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Updating existing volume attachment record: 7d3886af-3c29-4dc1-bf34-d72fb5e3ae20 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:19:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:08 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:08 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:10 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:19:15 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Creating image(s)
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "/opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "/opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "/opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.180s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_power_states {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.183s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:15 user nova-compute[73497]: WARNING nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] While synchronizing instance power states, found 12 instances in the database and 11 instances on the hypervisor.
Aug 26 23:19:15 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Triggering sync for uuid 926f8e5c-8d8a-4f07-bf08-e60700ce4698 {{(pid=73497) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Triggering sync for uuid 994093f0-e6b2-4c96-b259-c559ef2b1fbc {{(pid=73497) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Triggering sync for uuid 171985a3-358d-4b26-a66c-372b9b99b386 {{(pid=73497) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Triggering sync for uuid 1a58c5e7-b4c7-4bd5-8dd1-a98492139240 {{(pid=73497) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Triggering sync for uuid aebaeda6-23d1-43a1-afc8-bdc8992067e5 {{(pid=73497) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Triggering sync for uuid ee6283d5-40de-432d-997c-0be52ff673ca {{(pid=73497) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Triggering sync for uuid b68b6975-a24a-4861-a583-406b02446ea0 {{(pid=73497) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Triggering sync for uuid ff1085db-4bfc-4c77-a9e4-39f47ffb6d43 {{(pid=73497) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Triggering sync for uuid 7c124dd9-4dce-4c6f-925c-6eda8e187d84 {{(pid=73497) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Triggering sync for uuid 4c68f140-4235-4dcb-b99d-1347bc949d15 {{(pid=73497) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Triggering sync for uuid 043294e5-0618-4a31-bb19-1227ef1f5d39 {{(pid=73497) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Triggering sync for uuid e9e5c83f-0678-48d4-a81f-1a3f959aabcf {{(pid=73497) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk 1073741824" returned: 0 in 0.055s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "926f8e5c-8d8a-4f07-bf08-e60700ce4698" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "926f8e5c-8d8a-4f07-bf08-e60700ce4698" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "994093f0-e6b2-4c96-b259-c559ef2b1fbc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "994093f0-e6b2-4c96-b259-c559ef2b1fbc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "171985a3-358d-4b26-a66c-372b9b99b386" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "171985a3-358d-4b26-a66c-372b9b99b386" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "1a58c5e7-b4c7-4bd5-8dd1-a98492139240" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "1a58c5e7-b4c7-4bd5-8dd1-a98492139240" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "ee6283d5-40de-432d-997c-0be52ff673ca" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "ee6283d5-40de-432d-997c-0be52ff673ca" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "b68b6975-a24a-4861-a583-406b02446ea0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "b68b6975-a24a-4861-a583-406b02446ea0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:19:15 user nova-compute[73497]: INFO nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: b68b6975-a24a-4861-a583-406b02446ea0] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "b68b6975-a24a-4861-a583-406b02446ea0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "ff1085db-4bfc-4c77-a9e4-39f47ffb6d43" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "ff1085db-4bfc-4c77-a9e4-39f47ffb6d43" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "4c68f140-4235-4dcb-b99d-1347bc949d15" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "4c68f140-4235-4dcb-b99d-1347bc949d15" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "043294e5-0618-4a31-bb19-1227ef1f5d39" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "043294e5-0618-4a31-bb19-1227ef1f5d39" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:15 user nova-compute[73497]: WARNING oslo_messaging._drivers.amqpdriver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "171985a3-358d-4b26-a66c-372b9b99b386" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.143s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "926f8e5c-8d8a-4f07-bf08-e60700ce4698" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.148s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "1a58c5e7-b4c7-4bd5-8dd1-a98492139240" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.150s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "994093f0-e6b2-4c96-b259-c559ef2b1fbc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.159s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "4c68f140-4235-4dcb-b99d-1347bc949d15" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.149s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "ee6283d5-40de-432d-997c-0be52ff673ca" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.157s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "043294e5-0618-4a31-bb19-1227ef1f5d39" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.158s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "ff1085db-4bfc-4c77-a9e4-39f47ffb6d43" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.164s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.169s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.177s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.185s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.198s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Cannot resize image /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Ensure instance console log exists: /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Start _get_guest_xml network_info=[{"id": "744f8df2-5712-4df4-a4e6-d7705b4d3cc7", "address": "fa:16:3e:03:fd:29", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744f8df2-57", "ovs_interfaceid": "744f8df2-5712-4df4-a4e6-d7705b4d3cc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '7d3886af-3c29-4dc1-bf34-d72fb5e3ae20', 'guest_format': None, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'svqUICKd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b68b6975-a24a-4861-a583-406b02446ea0', 'attached_at': '', 'detached_at': '', 'volume_id': '366d637e-5a2e-4301-b2a1-0b5bcb485c10', 'serial': '366d637e-5a2e-4301-b2a1-0b5bcb485c10'}, 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:19:15 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 23:19:15 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 23:19:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG nova.objects.instance [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lazy-loading 'vcpu_model' on Instance uuid b68b6975-a24a-4861-a583-406b02446ea0 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'svqUICKd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:19:15 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 23:19:15 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:19:15 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 23:19:15 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:19:15 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:19:15 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:19:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f9c473-e97b-4e53-92da-7f9a4d5df743]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:19:16 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fffede0-fbcb-457d-a650-c0ec2515f461]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10] added
Aug 26 23:19:16 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50f3cec-c5a8-4c20-88a1-add965d3236f]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[774d442b-653f-4f53-8110-d4f090be0636]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v svqUICKd {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v svqUICKd" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cff634a-6477-4238-ac0d-56d822781eda]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'svqUICKd'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[091840fb-05c3-4cdb-86e2-ba2569043d33]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a902493-4004-48a7-b8b2-0bc666947b2a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:19:16 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:19:16 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[43dcd1c3-fda6-4f68-b05f-370c874333a4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10, portal: 172.16.0.220,3260]
Aug 26 23:19:16 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10, portal: 172.16.0.220,3260] successful.
Aug 26 23:19:16 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da118a8-285f-41c5-b0c9-54fb0d9b53e6]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec5d422-1034-4348-93c3-d8a2e8453aab]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:19:16 user nova-compute[73497]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:19:16 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:19:16 user nova-compute[73497]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:19:16 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b947994-9235-4765-9185-9b783018402d]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'svqUICKd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693091941.396142, b68b6975-a24a-4861-a583-406b02446ea0 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:19:16 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: b68b6975-a24a-4861-a583-406b02446ea0] VM Stopped (Lifecycle Event)
Aug 26 23:19:16 user nova-compute[73497]: DEBUG nova.compute.manager [None req-d6a5d417-e173-407e-89fa-cb100ea991fa None None] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:19:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:17 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:19:17 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23364373239353238', 'path': '/dev/sdb'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:19:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364373239353238', 'path': '/dev/sdb'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:19:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T23:16:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-625758251',display_name='tempest-ServerActionsTestOtherA-server-1293034491',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-625758251',id=15,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmg/g6/JqH0YLHZCpkD8rdnvMd23HQeTLvjge/Sh0DkE/Wj5zHdvAQ5fV67GK4vLmc3pz0PLw+2ofNRJAaMibeeNwiocztzy0e4AyExGxeymNeWH40DsExDFkx2358gAQ==',key_name='tempest-keypair-2050586917',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:16:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='80c212cbb083450ea15ec54a96f12510',ramdisk_id='',reservation_id='r-3tzokivj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-81910947',owner_user_name='tempest-ServerActionsTestOtherA-81910947-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:19:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='935b8635557949cfba9b6528b97da95f',uuid=b68b6975-a24a-4861-a583-406b02446ea0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "744f8df2-5712-4df4-a4e6-d7705b4d3cc7", "address": "fa:16:3e:03:fd:29", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744f8df2-57", "ovs_interfaceid": "744f8df2-5712-4df4-a4e6-d7705b4d3cc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:19:17 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Converting VIF {"id": "744f8df2-5712-4df4-a4e6-d7705b4d3cc7", "address": "fa:16:3e:03:fd:29", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744f8df2-57", "ovs_interfaceid": "744f8df2-5712-4df4-a4e6-d7705b4d3cc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:19:17 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:fd:29,bridge_name='br-int',has_traffic_filtering=True,id=744f8df2-5712-4df4-a4e6-d7705b4d3cc7,network=Network(bf99a38a-faaf-4f1e-a161-736ce9089919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744f8df2-57') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:19:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:19:17 user nova-compute[73497]:   <uuid>b68b6975-a24a-4861-a583-406b02446ea0</uuid>
Aug 26 23:19:17 user nova-compute[73497]:   <name>instance-0000000f</name>
Aug 26 23:19:17 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:19:17 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:19:17 user nova-compute[73497]:   <metadata>
Aug 26 23:19:17 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:19:17 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:19:17 user nova-compute[73497]:       <nova:name>tempest-ServerActionsTestOtherA-server-1293034491</nova:name>
Aug 26 23:19:17 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:19:15</nova:creationTime>
Aug 26 23:19:17 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:19:17 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:19:17 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:19:17 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:19:17 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:19:17 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:19:17 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:19:17 user nova-compute[73497]:       <nova:owner>
Aug 26 23:19:17 user nova-compute[73497]:         <nova:user uuid="935b8635557949cfba9b6528b97da95f">tempest-ServerActionsTestOtherA-81910947-project-member</nova:user>
Aug 26 23:19:17 user nova-compute[73497]:         <nova:project uuid="80c212cbb083450ea15ec54a96f12510">tempest-ServerActionsTestOtherA-81910947</nova:project>
Aug 26 23:19:17 user nova-compute[73497]:       </nova:owner>
Aug 26 23:19:17 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:19:17 user nova-compute[73497]:       <nova:ports>
Aug 26 23:19:17 user nova-compute[73497]:         <nova:port uuid="744f8df2-5712-4df4-a4e6-d7705b4d3cc7">
Aug 26 23:19:17 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 23:19:17 user nova-compute[73497]:         </nova:port>
Aug 26 23:19:17 user nova-compute[73497]:       </nova:ports>
Aug 26 23:19:17 user nova-compute[73497]:     </nova:instance>
Aug 26 23:19:17 user nova-compute[73497]:   </metadata>
Aug 26 23:19:17 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:19:17 user nova-compute[73497]:     <system>
Aug 26 23:19:17 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:19:17 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:19:17 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:19:17 user nova-compute[73497]:       <entry name="serial">b68b6975-a24a-4861-a583-406b02446ea0</entry>
Aug 26 23:19:17 user nova-compute[73497]:       <entry name="uuid">b68b6975-a24a-4861-a583-406b02446ea0</entry>
Aug 26 23:19:17 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:19:17 user nova-compute[73497]:     </system>
Aug 26 23:19:17 user nova-compute[73497]:   </sysinfo>
Aug 26 23:19:17 user nova-compute[73497]:   <os>
Aug 26 23:19:17 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:19:17 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:19:17 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:19:17 user nova-compute[73497]:   </os>
Aug 26 23:19:17 user nova-compute[73497]:   <features>
Aug 26 23:19:17 user nova-compute[73497]:     <acpi/>
Aug 26 23:19:17 user nova-compute[73497]:     <apic/>
Aug 26 23:19:17 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:19:17 user nova-compute[73497]:   </features>
Aug 26 23:19:17 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:19:17 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:19:17 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:19:17 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:19:17 user nova-compute[73497]:   </clock>
Aug 26 23:19:17 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:19:17 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:19:17 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:19:17 user nova-compute[73497]:   </cpu>
Aug 26 23:19:17 user nova-compute[73497]:   <devices>
Aug 26 23:19:17 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:19:17 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:19:17 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk"/>
Aug 26 23:19:17 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:19:17 user nova-compute[73497]:     </disk>
Aug 26 23:19:17 user nova-compute[73497]:     <disk type="block" device="disk">
Aug 26 23:19:17 user nova-compute[73497]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:19:17 user nova-compute[73497]:       <source dev="/dev/sdb"/>
Aug 26 23:19:17 user nova-compute[73497]:       <target dev="vdb" bus="virtio"/>
Aug 26 23:19:17 user nova-compute[73497]:       <serial>366d637e-5a2e-4301-b2a1-0b5bcb485c10</serial>
Aug 26 23:19:17 user nova-compute[73497]:     </disk>
Aug 26 23:19:17 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:19:17 user nova-compute[73497]:       <mac address="fa:16:3e:03:fd:29"/>
Aug 26 23:19:17 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:19:17 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:19:17 user nova-compute[73497]:       <target dev="tap744f8df2-57"/>
Aug 26 23:19:17 user nova-compute[73497]:     </interface>
Aug 26 23:19:17 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:19:17 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/console.log" append="off"/>
Aug 26 23:19:17 user nova-compute[73497]:     </serial>
Aug 26 23:19:17 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:19:17 user nova-compute[73497]:     <video>
Aug 26 23:19:17 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:19:17 user nova-compute[73497]:     </video>
Aug 26 23:19:17 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:19:17 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:19:17 user nova-compute[73497]:     </rng>
Aug 26 23:19:17 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:19:17 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:19:17 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:19:17 user nova-compute[73497]:     </memballoon>
Aug 26 23:19:17 user nova-compute[73497]:   </devices>
Aug 26 23:19:17 user nova-compute[73497]: </domain>
Aug 26 23:19:17 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:19:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T23:16:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-625758251',display_name='tempest-ServerActionsTestOtherA-server-1293034491',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-625758251',id=15,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmg/g6/JqH0YLHZCpkD8rdnvMd23HQeTLvjge/Sh0DkE/Wj5zHdvAQ5fV67GK4vLmc3pz0PLw+2ofNRJAaMibeeNwiocztzy0e4AyExGxeymNeWH40DsExDFkx2358gAQ==',key_name='tempest-keypair-2050586917',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:16:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='80c212cbb083450ea15ec54a96f12510',ramdisk_id='',reservation_id='r-3tzokivj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-81910947',owner_user_name='tempest-ServerActionsTestOtherA-81910947-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:19:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='935b8635557949cfba9b6528b97da95f',uuid=b68b6975-a24a-4861-a583-406b02446ea0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "744f8df2-5712-4df4-a4e6-d7705b4d3cc7", "address": "fa:16:3e:03:fd:29", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744f8df2-57", "ovs_interfaceid": "744f8df2-5712-4df4-a4e6-d7705b4d3cc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:19:17 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Converting VIF {"id": "744f8df2-5712-4df4-a4e6-d7705b4d3cc7", "address": "fa:16:3e:03:fd:29", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744f8df2-57", "ovs_interfaceid": "744f8df2-5712-4df4-a4e6-d7705b4d3cc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:19:17 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:fd:29,bridge_name='br-int',has_traffic_filtering=True,id=744f8df2-5712-4df4-a4e6-d7705b4d3cc7,network=Network(bf99a38a-faaf-4f1e-a161-736ce9089919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744f8df2-57') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:19:17 user nova-compute[73497]: DEBUG os_vif [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:fd:29,bridge_name='br-int',has_traffic_filtering=True,id=744f8df2-5712-4df4-a4e6-d7705b4d3cc7,network=Network(bf99a38a-faaf-4f1e-a161-736ce9089919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744f8df2-57') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:19:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:19:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:19:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap744f8df2-57, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:19:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap744f8df2-57, col_values=(('external_ids', {'iface-id': '744f8df2-5712-4df4-a4e6-d7705b4d3cc7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:fd:29', 'vm-uuid': 'b68b6975-a24a-4861-a583-406b02446ea0'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:19:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:19:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:17 user nova-compute[73497]: INFO os_vif [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:fd:29,bridge_name='br-int',has_traffic_filtering=True,id=744f8df2-5712-4df4-a4e6-d7705b4d3cc7,network=Network(bf99a38a-faaf-4f1e-a161-736ce9089919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744f8df2-57')
Aug 26 23:19:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:19:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:19:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] No VIF found with MAC fa:16:3e:03:fd:29, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:19:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:18 user nova-compute[73497]: DEBUG nova.compute.manager [req-626f5177-8afa-4f04-b136-c1f274bdff52 req-3272c834-f463-4190-836e-d12dd04b32a0 service nova] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Received event network-vif-plugged-744f8df2-5712-4df4-a4e6-d7705b4d3cc7 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:19:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-626f5177-8afa-4f04-b136-c1f274bdff52 req-3272c834-f463-4190-836e-d12dd04b32a0 service nova] Acquiring lock "b68b6975-a24a-4861-a583-406b02446ea0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:19:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-626f5177-8afa-4f04-b136-c1f274bdff52 req-3272c834-f463-4190-836e-d12dd04b32a0 service nova] Lock "b68b6975-a24a-4861-a583-406b02446ea0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:19:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-626f5177-8afa-4f04-b136-c1f274bdff52 req-3272c834-f463-4190-836e-d12dd04b32a0 service nova] Lock "b68b6975-a24a-4861-a583-406b02446ea0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:19:18 user nova-compute[73497]: DEBUG nova.compute.manager [req-626f5177-8afa-4f04-b136-c1f274bdff52 req-3272c834-f463-4190-836e-d12dd04b32a0 service nova] [instance: b68b6975-a24a-4861-a583-406b02446ea0] No waiting events found dispatching network-vif-plugged-744f8df2-5712-4df4-a4e6-d7705b4d3cc7 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:19:18 user nova-compute[73497]: WARNING nova.compute.manager [req-626f5177-8afa-4f04-b136-c1f274bdff52 req-3272c834-f463-4190-836e-d12dd04b32a0 service nova] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Received unexpected event network-vif-plugged-744f8df2-5712-4df4-a4e6-d7705b4d3cc7 for instance with vm_state active and task_state rebuild_spawning.
Aug 26 23:19:20 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091960.9193249, b68b6975-a24a-4861-a583-406b02446ea0 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:19:20 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b68b6975-a24a-4861-a583-406b02446ea0] VM Resumed (Lifecycle Event)
Aug 26 23:19:20 user nova-compute[73497]: DEBUG nova.compute.manager [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:19:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:19:20 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Instance spawned successfully.
Aug 26 23:19:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:19:20 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:19:20 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:19:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:19:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:19:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:19:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:19:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:19:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:19:20 user nova-compute[73497]: DEBUG nova.compute.manager [req-a0094179-3458-4d2f-b369-3529edeef5ad req-e7fac607-1368-44fa-93f1-3468dfbcfd17 service nova] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Received event network-vif-plugged-744f8df2-5712-4df4-a4e6-d7705b4d3cc7 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:19:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a0094179-3458-4d2f-b369-3529edeef5ad req-e7fac607-1368-44fa-93f1-3468dfbcfd17 service nova] Acquiring lock "b68b6975-a24a-4861-a583-406b02446ea0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:19:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a0094179-3458-4d2f-b369-3529edeef5ad req-e7fac607-1368-44fa-93f1-3468dfbcfd17 service nova] Lock "b68b6975-a24a-4861-a583-406b02446ea0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:19:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a0094179-3458-4d2f-b369-3529edeef5ad req-e7fac607-1368-44fa-93f1-3468dfbcfd17 service nova] Lock "b68b6975-a24a-4861-a583-406b02446ea0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:19:20 user nova-compute[73497]: DEBUG nova.compute.manager [req-a0094179-3458-4d2f-b369-3529edeef5ad req-e7fac607-1368-44fa-93f1-3468dfbcfd17 service nova] [instance: b68b6975-a24a-4861-a583-406b02446ea0] No waiting events found dispatching network-vif-plugged-744f8df2-5712-4df4-a4e6-d7705b4d3cc7 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:19:20 user nova-compute[73497]: WARNING nova.compute.manager [req-a0094179-3458-4d2f-b369-3529edeef5ad req-e7fac607-1368-44fa-93f1-3468dfbcfd17 service nova] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Received unexpected event network-vif-plugged-744f8df2-5712-4df4-a4e6-d7705b4d3cc7 for instance with vm_state active and task_state rebuild_spawning.
Aug 26 23:19:20 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b68b6975-a24a-4861-a583-406b02446ea0] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 23:19:20 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091960.9216592, b68b6975-a24a-4861-a583-406b02446ea0 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:19:20 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b68b6975-a24a-4861-a583-406b02446ea0] VM Started (Lifecycle Event)
Aug 26 23:19:21 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:19:21 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:19:21 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b68b6975-a24a-4861-a583-406b02446ea0] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 23:19:21 user nova-compute[73497]: DEBUG nova.compute.manager [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:19:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:19:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:19:21 user nova-compute[73497]: DEBUG nova.objects.instance [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73497) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Aug 26 23:19:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b3d2c298-687e-4e05-817a-a4c8b2177658 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.069s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:19:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0994949d-97cd-411a-922c-1d16752dff17 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Acquiring lock "1a58c5e7-b4c7-4bd5-8dd1-a98492139240" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:19:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0994949d-97cd-411a-922c-1d16752dff17 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "1a58c5e7-b4c7-4bd5-8dd1-a98492139240" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:19:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0994949d-97cd-411a-922c-1d16752dff17 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Acquiring lock "1a58c5e7-b4c7-4bd5-8dd1-a98492139240-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:19:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0994949d-97cd-411a-922c-1d16752dff17 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "1a58c5e7-b4c7-4bd5-8dd1-a98492139240-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:19:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0994949d-97cd-411a-922c-1d16752dff17 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "1a58c5e7-b4c7-4bd5-8dd1-a98492139240-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:19:27 user nova-compute[73497]: INFO nova.compute.manager [None req-0994949d-97cd-411a-922c-1d16752dff17 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Terminating instance
Aug 26 23:19:27 user nova-compute[73497]: DEBUG nova.compute.manager [None req-0994949d-97cd-411a-922c-1d16752dff17 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:19:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:27 user nova-compute[73497]: DEBUG nova.compute.manager [req-11f3e686-2ff1-4dff-915b-4caa12af7010 req-1dca60ba-08b8-4376-b957-65515e6daa15 service nova] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Received event network-vif-unplugged-4ee7875d-cd17-4e1e-8b9c-962eaa271398 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:19:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-11f3e686-2ff1-4dff-915b-4caa12af7010 req-1dca60ba-08b8-4376-b957-65515e6daa15 service nova] Acquiring lock "1a58c5e7-b4c7-4bd5-8dd1-a98492139240-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:19:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-11f3e686-2ff1-4dff-915b-4caa12af7010 req-1dca60ba-08b8-4376-b957-65515e6daa15 service nova] Lock "1a58c5e7-b4c7-4bd5-8dd1-a98492139240-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:19:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-11f3e686-2ff1-4dff-915b-4caa12af7010 req-1dca60ba-08b8-4376-b957-65515e6daa15 service nova] Lock "1a58c5e7-b4c7-4bd5-8dd1-a98492139240-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:19:27 user nova-compute[73497]: DEBUG nova.compute.manager [req-11f3e686-2ff1-4dff-915b-4caa12af7010 req-1dca60ba-08b8-4376-b957-65515e6daa15 service nova] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] No waiting events found dispatching network-vif-unplugged-4ee7875d-cd17-4e1e-8b9c-962eaa271398 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:19:27 user nova-compute[73497]: DEBUG nova.compute.manager [req-11f3e686-2ff1-4dff-915b-4caa12af7010 req-1dca60ba-08b8-4376-b957-65515e6daa15 service nova] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Received event network-vif-unplugged-4ee7875d-cd17-4e1e-8b9c-962eaa271398 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:19:28 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Instance destroyed successfully.
Aug 26 23:19:28 user nova-compute[73497]: DEBUG nova.objects.instance [None req-0994949d-97cd-411a-922c-1d16752dff17 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lazy-loading 'resources' on Instance uuid 1a58c5e7-b4c7-4bd5-8dd1-a98492139240 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:19:28 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-0994949d-97cd-411a-922c-1d16752dff17 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:13:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-146515420',display_name='tempest-VolumesAdminNegativeTest-server-146515420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-146515420',id=5,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFRVtCyeTuZ42hCRxF84QXtEtiMeOlumYosXqhUJtvmGfdYXRrOu0s7FCD6IJO5hhz41rgr2MILXHa7Oz+H2gfJQIDzivNQLznkghAqgbrDXDT0coaoJ5+THVgug5iWzQ==',key_name='tempest-keypair-1911481869',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:13:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='546cdb5907fc494c94ea81cfcef71a28',ramdisk_id='',reservation_id='r-o8012xqd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1932002621',owner_user_name='tempest-VolumesAdminNegativeTest-1932002621-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:13:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76e923deac454ba09eb85819527eb108',uuid=1a58c5e7-b4c7-4bd5-8dd1-a98492139240,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ee7875d-cd17-4e1e-8b9c-962eaa271398", "address": "fa:16:3e:2b:48:b2", "network": {"id": "4eb3bf86-7f68-4a81-90f9-f34da6231d59", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-299898849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "546cdb5907fc494c94ea81cfcef71a28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee7875d-cd", "ovs_interfaceid": "4ee7875d-cd17-4e1e-8b9c-962eaa271398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:19:28 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-0994949d-97cd-411a-922c-1d16752dff17 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Converting VIF {"id": "4ee7875d-cd17-4e1e-8b9c-962eaa271398", "address": "fa:16:3e:2b:48:b2", "network": {"id": "4eb3bf86-7f68-4a81-90f9-f34da6231d59", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-299898849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "546cdb5907fc494c94ea81cfcef71a28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee7875d-cd", "ovs_interfaceid": "4ee7875d-cd17-4e1e-8b9c-962eaa271398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:19:28 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-0994949d-97cd-411a-922c-1d16752dff17 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:48:b2,bridge_name='br-int',has_traffic_filtering=True,id=4ee7875d-cd17-4e1e-8b9c-962eaa271398,network=Network(4eb3bf86-7f68-4a81-90f9-f34da6231d59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee7875d-cd') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:19:28 user nova-compute[73497]: DEBUG os_vif [None req-0994949d-97cd-411a-922c-1d16752dff17 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:48:b2,bridge_name='br-int',has_traffic_filtering=True,id=4ee7875d-cd17-4e1e-8b9c-962eaa271398,network=Network(4eb3bf86-7f68-4a81-90f9-f34da6231d59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee7875d-cd') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:19:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ee7875d-cd, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:19:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:19:28 user nova-compute[73497]: INFO os_vif [None req-0994949d-97cd-411a-922c-1d16752dff17 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:48:b2,bridge_name='br-int',has_traffic_filtering=True,id=4ee7875d-cd17-4e1e-8b9c-962eaa271398,network=Network(4eb3bf86-7f68-4a81-90f9-f34da6231d59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee7875d-cd')
Aug 26 23:19:28 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-0994949d-97cd-411a-922c-1d16752dff17 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Deleting instance files /opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240_del
Aug 26 23:19:28 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-0994949d-97cd-411a-922c-1d16752dff17 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Deletion of /opt/stack/data/nova/instances/1a58c5e7-b4c7-4bd5-8dd1-a98492139240_del complete
Aug 26 23:19:28 user nova-compute[73497]: INFO nova.compute.manager [None req-0994949d-97cd-411a-922c-1d16752dff17 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 26 23:19:28 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-0994949d-97cd-411a-922c-1d16752dff17 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:19:28 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:19:28 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:19:29 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:19:29 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Took 0.96 seconds to deallocate network for instance.
Aug 26 23:19:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0994949d-97cd-411a-922c-1d16752dff17 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:19:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0994949d-97cd-411a-922c-1d16752dff17 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:19:29 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-0994949d-97cd-411a-922c-1d16752dff17 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Refreshing inventories for resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 23:19:29 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-0994949d-97cd-411a-922c-1d16752dff17 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Updating ProviderTree inventory for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 23:19:29 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-0994949d-97cd-411a-922c-1d16752dff17 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Updating inventory in ProviderTree for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 23:19:29 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-0994949d-97cd-411a-922c-1d16752dff17 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Refreshing aggregate associations for resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1, aggregates: None {{(pid=73497) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 23:19:29 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-0994949d-97cd-411a-922c-1d16752dff17 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Refreshing trait associations for resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING {{(pid=73497) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 23:19:29 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-0994949d-97cd-411a-922c-1d16752dff17 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:19:29 user nova-compute[73497]: DEBUG nova.compute.manager [req-b168b76d-74de-4fda-baaa-5815ddc8761d req-6fad4816-d51e-4866-a30d-7ab8e90ad644 service nova] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Received event network-vif-plugged-4ee7875d-cd17-4e1e-8b9c-962eaa271398 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:19:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b168b76d-74de-4fda-baaa-5815ddc8761d req-6fad4816-d51e-4866-a30d-7ab8e90ad644 service nova] Acquiring lock "1a58c5e7-b4c7-4bd5-8dd1-a98492139240-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:19:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b168b76d-74de-4fda-baaa-5815ddc8761d req-6fad4816-d51e-4866-a30d-7ab8e90ad644 service nova] Lock "1a58c5e7-b4c7-4bd5-8dd1-a98492139240-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:19:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b168b76d-74de-4fda-baaa-5815ddc8761d req-6fad4816-d51e-4866-a30d-7ab8e90ad644 service nova] Lock "1a58c5e7-b4c7-4bd5-8dd1-a98492139240-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:19:29 user nova-compute[73497]: DEBUG nova.compute.manager [req-b168b76d-74de-4fda-baaa-5815ddc8761d req-6fad4816-d51e-4866-a30d-7ab8e90ad644 service nova] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] No waiting events found dispatching network-vif-plugged-4ee7875d-cd17-4e1e-8b9c-962eaa271398 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:19:29 user nova-compute[73497]: WARNING nova.compute.manager [req-b168b76d-74de-4fda-baaa-5815ddc8761d req-6fad4816-d51e-4866-a30d-7ab8e90ad644 service nova] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Received unexpected event network-vif-plugged-4ee7875d-cd17-4e1e-8b9c-962eaa271398 for instance with vm_state deleted and task_state None.
Aug 26 23:19:29 user nova-compute[73497]: DEBUG nova.compute.manager [req-b168b76d-74de-4fda-baaa-5815ddc8761d req-6fad4816-d51e-4866-a30d-7ab8e90ad644 service nova] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Received event network-vif-deleted-4ee7875d-cd17-4e1e-8b9c-962eaa271398 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:19:29 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-0994949d-97cd-411a-922c-1d16752dff17 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:19:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0994949d-97cd-411a-922c-1d16752dff17 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.538s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:19:30 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-0994949d-97cd-411a-922c-1d16752dff17 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Deleted allocations for instance 1a58c5e7-b4c7-4bd5-8dd1-a98492139240
Aug 26 23:19:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0994949d-97cd-411a-922c-1d16752dff17 tempest-VolumesAdminNegativeTest-1932002621 tempest-VolumesAdminNegativeTest-1932002621-project-member] Lock "1a58c5e7-b4c7-4bd5-8dd1-a98492139240" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.618s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:19:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:39 user nova-compute[73497]: INFO nova.compute.manager [None req-794c8b44-aa03-4ca0-a8d7-2cf8b1ea892c tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Unrescuing
Aug 26 23:19:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-794c8b44-aa03-4ca0-a8d7-2cf8b1ea892c tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "refresh_cache-aebaeda6-23d1-43a1-afc8-bdc8992067e5" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:19:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-794c8b44-aa03-4ca0-a8d7-2cf8b1ea892c tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquired lock "refresh_cache-aebaeda6-23d1-43a1-afc8-bdc8992067e5" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:19:39 user nova-compute[73497]: DEBUG nova.network.neutron [None req-794c8b44-aa03-4ca0-a8d7-2cf8b1ea892c tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:19:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Acquiring lock "2f46a6a8-a043-455a-98f8-dae359594f56" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:19:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Lock "2f46a6a8-a043-455a-98f8-dae359594f56" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:19:39 user nova-compute[73497]: DEBUG nova.compute.manager [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:19:40 user nova-compute[73497]: INFO nova.compute.claims [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Claim successful on node user
Aug 26 23:19:40 user nova-compute[73497]: DEBUG nova.network.neutron [None req-794c8b44-aa03-4ca0-a8d7-2cf8b1ea892c tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Updating instance_info_cache with network_info: [{"id": "2fdb126c-c800-488a-9879-08a65e646325", "address": "fa:16:3e:e0:28:c4", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fdb126c-c8", "ovs_interfaceid": "2fdb126c-c800-488a-9879-08a65e646325", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-794c8b44-aa03-4ca0-a8d7-2cf8b1ea892c tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Releasing lock "refresh_cache-aebaeda6-23d1-43a1-afc8-bdc8992067e5" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG nova.objects.instance [None req-794c8b44-aa03-4ca0-a8d7-2cf8b1ea892c tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lazy-loading 'flavor' on Instance uuid aebaeda6-23d1-43a1-afc8-bdc8992067e5 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.449s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG nova.compute.manager [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG nova.compute.manager [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG nova.network.neutron [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:19:40 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:19:40 user nova-compute[73497]: DEBUG nova.compute.manager [req-79e24a55-bbf2-423c-b59c-3eaa82bbd0b2 req-ac0094dc-4d8d-4244-9aec-be398fba34f1 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Received event network-vif-unplugged-2fdb126c-c800-488a-9879-08a65e646325 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-79e24a55-bbf2-423c-b59c-3eaa82bbd0b2 req-ac0094dc-4d8d-4244-9aec-be398fba34f1 service nova] Acquiring lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-79e24a55-bbf2-423c-b59c-3eaa82bbd0b2 req-ac0094dc-4d8d-4244-9aec-be398fba34f1 service nova] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-79e24a55-bbf2-423c-b59c-3eaa82bbd0b2 req-ac0094dc-4d8d-4244-9aec-be398fba34f1 service nova] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG nova.compute.manager [req-79e24a55-bbf2-423c-b59c-3eaa82bbd0b2 req-ac0094dc-4d8d-4244-9aec-be398fba34f1 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] No waiting events found dispatching network-vif-unplugged-2fdb126c-c800-488a-9879-08a65e646325 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:19:40 user nova-compute[73497]: WARNING nova.compute.manager [req-79e24a55-bbf2-423c-b59c-3eaa82bbd0b2 req-ac0094dc-4d8d-4244-9aec-be398fba34f1 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Received unexpected event network-vif-unplugged-2fdb126c-c800-488a-9879-08a65e646325 for instance with vm_state rescued and task_state unrescuing.
Aug 26 23:19:40 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG nova.compute.manager [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:19:40 user nova-compute[73497]: INFO nova.virt.block_device [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Booting with volume 4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f at /dev/vda
Aug 26 23:19:40 user nova-compute[73497]: DEBUG os_brick.utils [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a8826e-e333-487e-839c-4bb104511eee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abd5c76-d60d-4dd5-ac29-158d3187d69f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11823d9-6f77-4573-bd80-bf91ddd4e93e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9040d91e-8d02-401f-b4c8-5b7bb5bd8b9c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG nova.policy [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'db2fc512067944a7aa32ec31c9db0252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d34ef8af644207b59d77a2d42c5f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:19:40 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:19:40 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c461c5-d510-4dfe-b9a7-99a011b435cb]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG os_brick.utils [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:19:40 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Updating existing volume attachment record: 2c6e9e2c-3c0e-412c-a3c9-62dad7999376 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:19:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:41 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Instance destroyed successfully.
Aug 26 23:19:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:41 user nova-compute[73497]: DEBUG nova.network.neutron [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Successfully created port: dbc2a5c3-3411-4be9-aa3b-a902180c81c2 {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:19:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:42 user nova-compute[73497]: DEBUG nova.compute.manager [req-024550a7-23d5-481e-8116-0ddbe342347c req-137d9bd8-0b3d-4d2b-a777-5d1d8b93edc2 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Received event network-vif-plugged-2fdb126c-c800-488a-9879-08a65e646325 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:19:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-024550a7-23d5-481e-8116-0ddbe342347c req-137d9bd8-0b3d-4d2b-a777-5d1d8b93edc2 service nova] Acquiring lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:19:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-024550a7-23d5-481e-8116-0ddbe342347c req-137d9bd8-0b3d-4d2b-a777-5d1d8b93edc2 service nova] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:19:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-024550a7-23d5-481e-8116-0ddbe342347c req-137d9bd8-0b3d-4d2b-a777-5d1d8b93edc2 service nova] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:19:42 user nova-compute[73497]: DEBUG nova.compute.manager [req-024550a7-23d5-481e-8116-0ddbe342347c req-137d9bd8-0b3d-4d2b-a777-5d1d8b93edc2 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] No waiting events found dispatching network-vif-plugged-2fdb126c-c800-488a-9879-08a65e646325 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:19:42 user nova-compute[73497]: WARNING nova.compute.manager [req-024550a7-23d5-481e-8116-0ddbe342347c req-137d9bd8-0b3d-4d2b-a777-5d1d8b93edc2 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Received unexpected event network-vif-plugged-2fdb126c-c800-488a-9879-08a65e646325 for instance with vm_state rescued and task_state unrescuing.
Aug 26 23:19:42 user nova-compute[73497]: DEBUG nova.compute.manager [req-024550a7-23d5-481e-8116-0ddbe342347c req-137d9bd8-0b3d-4d2b-a777-5d1d8b93edc2 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Received event network-vif-plugged-2fdb126c-c800-488a-9879-08a65e646325 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:19:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-024550a7-23d5-481e-8116-0ddbe342347c req-137d9bd8-0b3d-4d2b-a777-5d1d8b93edc2 service nova] Acquiring lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:19:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-024550a7-23d5-481e-8116-0ddbe342347c req-137d9bd8-0b3d-4d2b-a777-5d1d8b93edc2 service nova] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:19:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-024550a7-23d5-481e-8116-0ddbe342347c req-137d9bd8-0b3d-4d2b-a777-5d1d8b93edc2 service nova] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:19:42 user nova-compute[73497]: DEBUG nova.compute.manager [req-024550a7-23d5-481e-8116-0ddbe342347c req-137d9bd8-0b3d-4d2b-a777-5d1d8b93edc2 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] No waiting events found dispatching network-vif-plugged-2fdb126c-c800-488a-9879-08a65e646325 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:19:42 user nova-compute[73497]: WARNING nova.compute.manager [req-024550a7-23d5-481e-8116-0ddbe342347c req-137d9bd8-0b3d-4d2b-a777-5d1d8b93edc2 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Received unexpected event network-vif-plugged-2fdb126c-c800-488a-9879-08a65e646325 for instance with vm_state rescued and task_state unrescuing.
Aug 26 23:19:42 user nova-compute[73497]: DEBUG nova.compute.manager [req-024550a7-23d5-481e-8116-0ddbe342347c req-137d9bd8-0b3d-4d2b-a777-5d1d8b93edc2 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Received event network-vif-plugged-2fdb126c-c800-488a-9879-08a65e646325 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:19:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-024550a7-23d5-481e-8116-0ddbe342347c req-137d9bd8-0b3d-4d2b-a777-5d1d8b93edc2 service nova] Acquiring lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:19:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-024550a7-23d5-481e-8116-0ddbe342347c req-137d9bd8-0b3d-4d2b-a777-5d1d8b93edc2 service nova] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:19:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-024550a7-23d5-481e-8116-0ddbe342347c req-137d9bd8-0b3d-4d2b-a777-5d1d8b93edc2 service nova] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:19:42 user nova-compute[73497]: DEBUG nova.compute.manager [req-024550a7-23d5-481e-8116-0ddbe342347c req-137d9bd8-0b3d-4d2b-a777-5d1d8b93edc2 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] No waiting events found dispatching network-vif-plugged-2fdb126c-c800-488a-9879-08a65e646325 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:19:42 user nova-compute[73497]: WARNING nova.compute.manager [req-024550a7-23d5-481e-8116-0ddbe342347c req-137d9bd8-0b3d-4d2b-a777-5d1d8b93edc2 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Received unexpected event network-vif-plugged-2fdb126c-c800-488a-9879-08a65e646325 for instance with vm_state rescued and task_state unrescuing.
Aug 26 23:19:43 user nova-compute[73497]: DEBUG nova.network.neutron [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Successfully created port: 0e19373c-aa09-49fa-a349-1a7caafa8b61 {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:19:43 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693091968.2922735, 1a58c5e7-b4c7-4bd5-8dd1-a98492139240 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:19:43 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] VM Stopped (Lifecycle Event)
Aug 26 23:19:43 user nova-compute[73497]: DEBUG nova.compute.manager [None req-928a6124-2139-49c9-93f9-e0ee6e1d3556 None None] [instance: 1a58c5e7-b4c7-4bd5-8dd1-a98492139240] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:19:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:44 user nova-compute[73497]: DEBUG nova.network.neutron [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Successfully created port: fb8cf209-6174-4bcd-9beb-d2f21ef40e5e {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:19:44 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Removed pending event for aebaeda6-23d1-43a1-afc8-bdc8992067e5 due to event {{(pid=73497) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 23:19:44 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091984.5592256, aebaeda6-23d1-43a1-afc8-bdc8992067e5 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:19:44 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] VM Resumed (Lifecycle Event)
Aug 26 23:19:44 user nova-compute[73497]: DEBUG nova.compute.manager [None req-794c8b44-aa03-4ca0-a8d7-2cf8b1ea892c tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:19:44 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:19:44 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:19:44 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 23:19:44 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693091984.5607905, aebaeda6-23d1-43a1-afc8-bdc8992067e5 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:19:44 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] VM Started (Lifecycle Event)
Aug 26 23:19:44 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:19:44 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:19:44 user nova-compute[73497]: DEBUG nova.network.neutron [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Successfully created port: b2bc5017-c7ab-43ff-b092-f49336426174 {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:19:44 user nova-compute[73497]: DEBUG nova.compute.manager [req-4a6bfef1-5a9b-4ed7-8890-d5b7a7f524be req-25859940-3767-4c63-997d-80809ac0e1a6 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Received event network-vif-unplugged-2fdb126c-c800-488a-9879-08a65e646325 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:19:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4a6bfef1-5a9b-4ed7-8890-d5b7a7f524be req-25859940-3767-4c63-997d-80809ac0e1a6 service nova] Acquiring lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:19:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4a6bfef1-5a9b-4ed7-8890-d5b7a7f524be req-25859940-3767-4c63-997d-80809ac0e1a6 service nova] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:19:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4a6bfef1-5a9b-4ed7-8890-d5b7a7f524be req-25859940-3767-4c63-997d-80809ac0e1a6 service nova] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:19:44 user nova-compute[73497]: DEBUG nova.compute.manager [req-4a6bfef1-5a9b-4ed7-8890-d5b7a7f524be req-25859940-3767-4c63-997d-80809ac0e1a6 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] No waiting events found dispatching network-vif-unplugged-2fdb126c-c800-488a-9879-08a65e646325 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:19:44 user nova-compute[73497]: WARNING nova.compute.manager [req-4a6bfef1-5a9b-4ed7-8890-d5b7a7f524be req-25859940-3767-4c63-997d-80809ac0e1a6 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Received unexpected event network-vif-unplugged-2fdb126c-c800-488a-9879-08a65e646325 for instance with vm_state active and task_state None.
Aug 26 23:19:44 user nova-compute[73497]: DEBUG nova.compute.manager [req-4a6bfef1-5a9b-4ed7-8890-d5b7a7f524be req-25859940-3767-4c63-997d-80809ac0e1a6 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Received event network-vif-plugged-2fdb126c-c800-488a-9879-08a65e646325 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:19:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4a6bfef1-5a9b-4ed7-8890-d5b7a7f524be req-25859940-3767-4c63-997d-80809ac0e1a6 service nova] Acquiring lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:19:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4a6bfef1-5a9b-4ed7-8890-d5b7a7f524be req-25859940-3767-4c63-997d-80809ac0e1a6 service nova] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:19:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4a6bfef1-5a9b-4ed7-8890-d5b7a7f524be req-25859940-3767-4c63-997d-80809ac0e1a6 service nova] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:19:44 user nova-compute[73497]: DEBUG nova.compute.manager [req-4a6bfef1-5a9b-4ed7-8890-d5b7a7f524be req-25859940-3767-4c63-997d-80809ac0e1a6 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] No waiting events found dispatching network-vif-plugged-2fdb126c-c800-488a-9879-08a65e646325 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:19:44 user nova-compute[73497]: WARNING nova.compute.manager [req-4a6bfef1-5a9b-4ed7-8890-d5b7a7f524be req-25859940-3767-4c63-997d-80809ac0e1a6 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Received unexpected event network-vif-plugged-2fdb126c-c800-488a-9879-08a65e646325 for instance with vm_state active and task_state None.
Aug 26 23:19:44 user nova-compute[73497]: DEBUG nova.compute.manager [req-4a6bfef1-5a9b-4ed7-8890-d5b7a7f524be req-25859940-3767-4c63-997d-80809ac0e1a6 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Received event network-vif-plugged-2fdb126c-c800-488a-9879-08a65e646325 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:19:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4a6bfef1-5a9b-4ed7-8890-d5b7a7f524be req-25859940-3767-4c63-997d-80809ac0e1a6 service nova] Acquiring lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:19:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4a6bfef1-5a9b-4ed7-8890-d5b7a7f524be req-25859940-3767-4c63-997d-80809ac0e1a6 service nova] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:19:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4a6bfef1-5a9b-4ed7-8890-d5b7a7f524be req-25859940-3767-4c63-997d-80809ac0e1a6 service nova] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:19:44 user nova-compute[73497]: DEBUG nova.compute.manager [req-4a6bfef1-5a9b-4ed7-8890-d5b7a7f524be req-25859940-3767-4c63-997d-80809ac0e1a6 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] No waiting events found dispatching network-vif-plugged-2fdb126c-c800-488a-9879-08a65e646325 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:19:44 user nova-compute[73497]: WARNING nova.compute.manager [req-4a6bfef1-5a9b-4ed7-8890-d5b7a7f524be req-25859940-3767-4c63-997d-80809ac0e1a6 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Received unexpected event network-vif-plugged-2fdb126c-c800-488a-9879-08a65e646325 for instance with vm_state active and task_state None.
Aug 26 23:19:44 user nova-compute[73497]: DEBUG nova.compute.manager [req-4a6bfef1-5a9b-4ed7-8890-d5b7a7f524be req-25859940-3767-4c63-997d-80809ac0e1a6 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Received event network-vif-plugged-2fdb126c-c800-488a-9879-08a65e646325 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:19:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4a6bfef1-5a9b-4ed7-8890-d5b7a7f524be req-25859940-3767-4c63-997d-80809ac0e1a6 service nova] Acquiring lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:19:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4a6bfef1-5a9b-4ed7-8890-d5b7a7f524be req-25859940-3767-4c63-997d-80809ac0e1a6 service nova] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:19:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4a6bfef1-5a9b-4ed7-8890-d5b7a7f524be req-25859940-3767-4c63-997d-80809ac0e1a6 service nova] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:19:44 user nova-compute[73497]: DEBUG nova.compute.manager [req-4a6bfef1-5a9b-4ed7-8890-d5b7a7f524be req-25859940-3767-4c63-997d-80809ac0e1a6 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] No waiting events found dispatching network-vif-plugged-2fdb126c-c800-488a-9879-08a65e646325 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:19:44 user nova-compute[73497]: WARNING nova.compute.manager [req-4a6bfef1-5a9b-4ed7-8890-d5b7a7f524be req-25859940-3767-4c63-997d-80809ac0e1a6 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Received unexpected event network-vif-plugged-2fdb126c-c800-488a-9879-08a65e646325 for instance with vm_state active and task_state None.
Aug 26 23:19:45 user nova-compute[73497]: DEBUG nova.network.neutron [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Successfully created port: a9571bef-59d5-4a2d-9803-69bf1e5335d1 {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:19:46 user nova-compute[73497]: DEBUG nova.network.neutron [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Successfully updated port: dbc2a5c3-3411-4be9-aa3b-a902180c81c2 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:19:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:46 user nova-compute[73497]: DEBUG nova.compute.manager [req-85b11670-5027-4bd9-ae2f-68ff4b765118 req-fad38643-9f56-4d99-aee6-6d80325ce602 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-changed-dbc2a5c3-3411-4be9-aa3b-a902180c81c2 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:19:46 user nova-compute[73497]: DEBUG nova.compute.manager [req-85b11670-5027-4bd9-ae2f-68ff4b765118 req-fad38643-9f56-4d99-aee6-6d80325ce602 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Refreshing instance network info cache due to event network-changed-dbc2a5c3-3411-4be9-aa3b-a902180c81c2. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:19:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-85b11670-5027-4bd9-ae2f-68ff4b765118 req-fad38643-9f56-4d99-aee6-6d80325ce602 service nova] Acquiring lock "refresh_cache-2f46a6a8-a043-455a-98f8-dae359594f56" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:19:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-85b11670-5027-4bd9-ae2f-68ff4b765118 req-fad38643-9f56-4d99-aee6-6d80325ce602 service nova] Acquired lock "refresh_cache-2f46a6a8-a043-455a-98f8-dae359594f56" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:19:46 user nova-compute[73497]: DEBUG nova.network.neutron [req-85b11670-5027-4bd9-ae2f-68ff4b765118 req-fad38643-9f56-4d99-aee6-6d80325ce602 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Refreshing network info cache for port dbc2a5c3-3411-4be9-aa3b-a902180c81c2 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:19:46 user nova-compute[73497]: DEBUG nova.network.neutron [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Successfully updated port: 5dbd55d2-5e99-474c-a1f5-8c87c783aa07 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:19:46 user nova-compute[73497]: DEBUG nova.network.neutron [req-85b11670-5027-4bd9-ae2f-68ff4b765118 req-fad38643-9f56-4d99-aee6-6d80325ce602 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:19:47 user nova-compute[73497]: DEBUG nova.network.neutron [req-85b11670-5027-4bd9-ae2f-68ff4b765118 req-fad38643-9f56-4d99-aee6-6d80325ce602 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:19:47 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-85b11670-5027-4bd9-ae2f-68ff4b765118 req-fad38643-9f56-4d99-aee6-6d80325ce602 service nova] Releasing lock "refresh_cache-2f46a6a8-a043-455a-98f8-dae359594f56" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:19:47 user nova-compute[73497]: DEBUG nova.network.neutron [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Successfully updated port: 66a415ff-2dea-4458-bdba-35ac845cd7d6 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:19:48 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:48 user nova-compute[73497]: DEBUG nova.network.neutron [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Successfully updated port: 0e19373c-aa09-49fa-a349-1a7caafa8b61 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:19:48 user nova-compute[73497]: DEBUG nova.compute.manager [req-50a2e07c-64dc-4ba7-873a-78c7d011d832 req-61a00270-4b62-4b86-912e-ce0eee9a2188 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-changed-5dbd55d2-5e99-474c-a1f5-8c87c783aa07 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:19:48 user nova-compute[73497]: DEBUG nova.compute.manager [req-50a2e07c-64dc-4ba7-873a-78c7d011d832 req-61a00270-4b62-4b86-912e-ce0eee9a2188 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Refreshing instance network info cache due to event network-changed-5dbd55d2-5e99-474c-a1f5-8c87c783aa07. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:19:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-50a2e07c-64dc-4ba7-873a-78c7d011d832 req-61a00270-4b62-4b86-912e-ce0eee9a2188 service nova] Acquiring lock "refresh_cache-2f46a6a8-a043-455a-98f8-dae359594f56" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:19:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-50a2e07c-64dc-4ba7-873a-78c7d011d832 req-61a00270-4b62-4b86-912e-ce0eee9a2188 service nova] Acquired lock "refresh_cache-2f46a6a8-a043-455a-98f8-dae359594f56" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:19:48 user nova-compute[73497]: DEBUG nova.network.neutron [req-50a2e07c-64dc-4ba7-873a-78c7d011d832 req-61a00270-4b62-4b86-912e-ce0eee9a2188 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Refreshing network info cache for port 5dbd55d2-5e99-474c-a1f5-8c87c783aa07 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:19:49 user nova-compute[73497]: DEBUG nova.network.neutron [req-50a2e07c-64dc-4ba7-873a-78c7d011d832 req-61a00270-4b62-4b86-912e-ce0eee9a2188 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:19:49 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:19:49 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:19:49 user nova-compute[73497]: DEBUG nova.network.neutron [req-50a2e07c-64dc-4ba7-873a-78c7d011d832 req-61a00270-4b62-4b86-912e-ce0eee9a2188 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:19:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-50a2e07c-64dc-4ba7-873a-78c7d011d832 req-61a00270-4b62-4b86-912e-ce0eee9a2188 service nova] Releasing lock "refresh_cache-2f46a6a8-a043-455a-98f8-dae359594f56" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:19:49 user nova-compute[73497]: DEBUG nova.compute.manager [req-50a2e07c-64dc-4ba7-873a-78c7d011d832 req-61a00270-4b62-4b86-912e-ce0eee9a2188 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-changed-66a415ff-2dea-4458-bdba-35ac845cd7d6 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:19:49 user nova-compute[73497]: DEBUG nova.compute.manager [req-50a2e07c-64dc-4ba7-873a-78c7d011d832 req-61a00270-4b62-4b86-912e-ce0eee9a2188 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Refreshing instance network info cache due to event network-changed-66a415ff-2dea-4458-bdba-35ac845cd7d6. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:19:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-50a2e07c-64dc-4ba7-873a-78c7d011d832 req-61a00270-4b62-4b86-912e-ce0eee9a2188 service nova] Acquiring lock "refresh_cache-2f46a6a8-a043-455a-98f8-dae359594f56" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:19:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-50a2e07c-64dc-4ba7-873a-78c7d011d832 req-61a00270-4b62-4b86-912e-ce0eee9a2188 service nova] Acquired lock "refresh_cache-2f46a6a8-a043-455a-98f8-dae359594f56" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:19:49 user nova-compute[73497]: DEBUG nova.network.neutron [req-50a2e07c-64dc-4ba7-873a-78c7d011d832 req-61a00270-4b62-4b86-912e-ce0eee9a2188 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Refreshing network info cache for port 66a415ff-2dea-4458-bdba-35ac845cd7d6 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:19:49 user nova-compute[73497]: DEBUG nova.network.neutron [req-50a2e07c-64dc-4ba7-873a-78c7d011d832 req-61a00270-4b62-4b86-912e-ce0eee9a2188 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:19:49 user nova-compute[73497]: DEBUG nova.network.neutron [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Successfully updated port: fb8cf209-6174-4bcd-9beb-d2f21ef40e5e {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:19:49 user nova-compute[73497]: DEBUG nova.network.neutron [req-50a2e07c-64dc-4ba7-873a-78c7d011d832 req-61a00270-4b62-4b86-912e-ce0eee9a2188 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:19:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-50a2e07c-64dc-4ba7-873a-78c7d011d832 req-61a00270-4b62-4b86-912e-ce0eee9a2188 service nova] Releasing lock "refresh_cache-2f46a6a8-a043-455a-98f8-dae359594f56" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:19:49 user nova-compute[73497]: DEBUG nova.compute.manager [req-50a2e07c-64dc-4ba7-873a-78c7d011d832 req-61a00270-4b62-4b86-912e-ce0eee9a2188 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-changed-0e19373c-aa09-49fa-a349-1a7caafa8b61 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:19:49 user nova-compute[73497]: DEBUG nova.compute.manager [req-50a2e07c-64dc-4ba7-873a-78c7d011d832 req-61a00270-4b62-4b86-912e-ce0eee9a2188 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Refreshing instance network info cache due to event network-changed-0e19373c-aa09-49fa-a349-1a7caafa8b61. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:19:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-50a2e07c-64dc-4ba7-873a-78c7d011d832 req-61a00270-4b62-4b86-912e-ce0eee9a2188 service nova] Acquiring lock "refresh_cache-2f46a6a8-a043-455a-98f8-dae359594f56" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:19:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-50a2e07c-64dc-4ba7-873a-78c7d011d832 req-61a00270-4b62-4b86-912e-ce0eee9a2188 service nova] Acquired lock "refresh_cache-2f46a6a8-a043-455a-98f8-dae359594f56" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:19:49 user nova-compute[73497]: DEBUG nova.network.neutron [req-50a2e07c-64dc-4ba7-873a-78c7d011d832 req-61a00270-4b62-4b86-912e-ce0eee9a2188 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Refreshing network info cache for port 0e19373c-aa09-49fa-a349-1a7caafa8b61 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:19:49 user nova-compute[73497]: DEBUG nova.network.neutron [req-50a2e07c-64dc-4ba7-873a-78c7d011d832 req-61a00270-4b62-4b86-912e-ce0eee9a2188 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:19:49 user nova-compute[73497]: DEBUG nova.network.neutron [req-50a2e07c-64dc-4ba7-873a-78c7d011d832 req-61a00270-4b62-4b86-912e-ce0eee9a2188 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:19:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-50a2e07c-64dc-4ba7-873a-78c7d011d832 req-61a00270-4b62-4b86-912e-ce0eee9a2188 service nova] Releasing lock "refresh_cache-2f46a6a8-a043-455a-98f8-dae359594f56" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:19:50 user nova-compute[73497]: DEBUG nova.network.neutron [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Successfully updated port: b2bc5017-c7ab-43ff-b092-f49336426174 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:19:50 user nova-compute[73497]: DEBUG nova.network.neutron [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Successfully updated port: a9571bef-59d5-4a2d-9803-69bf1e5335d1 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:19:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Acquiring lock "refresh_cache-2f46a6a8-a043-455a-98f8-dae359594f56" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:19:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Acquired lock "refresh_cache-2f46a6a8-a043-455a-98f8-dae359594f56" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:19:50 user nova-compute[73497]: DEBUG nova.network.neutron [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:19:50 user nova-compute[73497]: DEBUG nova.network.neutron [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:19:51 user nova-compute[73497]: DEBUG nova.compute.manager [req-f59dfba1-9e13-40ef-b011-09fddc5b0259 req-27974d03-b0eb-4da1-83f8-33bace348c68 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-changed-fb8cf209-6174-4bcd-9beb-d2f21ef40e5e {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:19:51 user nova-compute[73497]: DEBUG nova.compute.manager [req-f59dfba1-9e13-40ef-b011-09fddc5b0259 req-27974d03-b0eb-4da1-83f8-33bace348c68 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Refreshing instance network info cache due to event network-changed-fb8cf209-6174-4bcd-9beb-d2f21ef40e5e. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:19:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f59dfba1-9e13-40ef-b011-09fddc5b0259 req-27974d03-b0eb-4da1-83f8-33bace348c68 service nova] Acquiring lock "refresh_cache-2f46a6a8-a043-455a-98f8-dae359594f56" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:19:51 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:19:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:52 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:19:52 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:19:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:19:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:19:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:19:52 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:19:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:52 user nova-compute[73497]: INFO nova.virt.block_device [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Booting with volume fae83862-cb43-4437-9680-f544f97fe6ee at /dev/vdb
Aug 26 23:19:52 user nova-compute[73497]: DEBUG os_brick.utils [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:19:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:52 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb1e74c-a660-4be8-a0a8-f4c932fb2bdb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:19:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:52 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbed9e34-f456-4984-af19-9360cf446200]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:19:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:52 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[87dd3769-4522-4c65-89da-5d82889c5a6b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:19:52 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f7b6c4-5699-45d4-966b-9c08cc2e40f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:19:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:19:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:19:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:19:52 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:19:52 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd81bbd-ae34-40dd-9199-239e00f3a51f]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:19:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:19:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:19:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:19:52 user nova-compute[73497]: DEBUG os_brick.utils [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:19:52 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Updating existing volume attachment record: 33424836-4f78-4198-8f5d-eb4cc4e951f0 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:19:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:52 user nova-compute[73497]: DEBUG nova.network.neutron [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Updating instance_info_cache with network_info: [{"id": "dbc2a5c3-3411-4be9-aa3b-a902180c81c2", "address": "fa:16:3e:7e:8e:8a", "network": {"id": "43d07640-08ec-4f81-9b86-a9b192b9aaf3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-376476172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbc2a5c3-34", "ovs_interfaceid": "dbc2a5c3-3411-4be9-aa3b-a902180c81c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5dbd55d2-5e99-474c-a1f5-8c87c783aa07", "address": "fa:16:3e:07:92:18", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbd55d2-5e", "ovs_interfaceid": "5dbd55d2-5e99-474c-a1f5-8c87c783aa07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "66a415ff-2dea-4458-bdba-35ac845cd7d6", "address": "fa:16:3e:7c:f6:90", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a415ff-2d", "ovs_interfaceid": "66a415ff-2dea-4458-bdba-35ac845cd7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0e19373c-aa09-49fa-a349-1a7caafa8b61", "address": "fa:16:3e:46:67:4c", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e19373c-aa", "ovs_interfaceid": "0e19373c-aa09-49fa-a349-1a7caafa8b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fb8cf209-6174-4bcd-9beb-d2f21ef40e5e", "address": "fa:16:3e:86:4c:dd", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8cf209-61", "ovs_interfaceid": "fb8cf209-6174-4bcd-9beb-d2f21ef40e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b2bc5017-c7ab-43ff-b092-f49336426174", "address": "fa:16:3e:15:05:18", "network": {"id": "061595cf-a510-4019-9445-60a0fa5b2338", "bridge": "br-int", "label": "tempest-device-tagging-net2-827609296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bc5017-c7", "ovs_interfaceid": "b2bc5017-c7ab-43ff-b092-f49336426174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a9571bef-59d5-4a2d-9803-69bf1e5335d1", "address": "fa:16:3e:75:bf:5d", "network": {"id": "061595cf-a510-4019-9445-60a0fa5b2338", "bridge": "br-int", "label": "tempest-device-tagging-net2-827609296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9571bef-59", "ovs_interfaceid": "a9571bef-59d5-4a2d-9803-69bf1e5335d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:19:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Releasing lock "refresh_cache-2f46a6a8-a043-455a-98f8-dae359594f56" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:19:53 user nova-compute[73497]: DEBUG nova.compute.manager [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Instance network_info: |[{"id": "dbc2a5c3-3411-4be9-aa3b-a902180c81c2", "address": "fa:16:3e:7e:8e:8a", "network": {"id": "43d07640-08ec-4f81-9b86-a9b192b9aaf3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-376476172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbc2a5c3-34", "ovs_interfaceid": "dbc2a5c3-3411-4be9-aa3b-a902180c81c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5dbd55d2-5e99-474c-a1f5-8c87c783aa07", "address": "fa:16:3e:07:92:18", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbd55d2-5e", "ovs_interfaceid": "5dbd55d2-5e99-474c-a1f5-8c87c783aa07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "66a415ff-2dea-4458-bdba-35ac845cd7d6", "address": "fa:16:3e:7c:f6:90", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a415ff-2d", "ovs_interfaceid": "66a415ff-2dea-4458-bdba-35ac845cd7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0e19373c-aa09-49fa-a349-1a7caafa8b61", "address": "fa:16:3e:46:67:4c", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e19373c-aa", "ovs_interfaceid": "0e19373c-aa09-49fa-a349-1a7caafa8b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fb8cf209-6174-4bcd-9beb-d2f21ef40e5e", "address": "fa:16:3e:86:4c:dd", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8cf209-61", "ovs_interfaceid": "fb8cf209-6174-4bcd-9beb-d2f21ef40e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b2bc5017-c7ab-43ff-b092-f49336426174", "address": "fa:16:3e:15:05:18", "network": {"id": "061595cf-a510-4019-9445-60a0fa5b2338", "bridge": "br-int", "label": "tempest-device-tagging-net2-827609296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bc5017-c7", "ovs_interfaceid": "b2bc5017-c7ab-43ff-b092-f49336426174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a9571bef-59d5-4a2d-9803-69bf1e5335d1", "address": "fa:16:3e:75:bf:5d", "network": {"id": "061595cf-a510-4019-9445-60a0fa5b2338", "bridge": "br-int", "label": "tempest-device-tagging-net2-827609296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9571bef-59", "ovs_interfaceid": "a9571bef-59d5-4a2d-9803-69bf1e5335d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:19:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f59dfba1-9e13-40ef-b011-09fddc5b0259 req-27974d03-b0eb-4da1-83f8-33bace348c68 service nova] Acquired lock "refresh_cache-2f46a6a8-a043-455a-98f8-dae359594f56" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:19:53 user nova-compute[73497]: DEBUG nova.network.neutron [req-f59dfba1-9e13-40ef-b011-09fddc5b0259 req-27974d03-b0eb-4da1-83f8-33bace348c68 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Refreshing network info cache for port fb8cf209-6174-4bcd-9beb-d2f21ef40e5e {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:19:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:19:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:53 user nova-compute[73497]: DEBUG nova.network.neutron [req-f59dfba1-9e13-40ef-b011-09fddc5b0259 req-27974d03-b0eb-4da1-83f8-33bace348c68 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Updated VIF entry in instance network info cache for port fb8cf209-6174-4bcd-9beb-d2f21ef40e5e. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:19:53 user nova-compute[73497]: DEBUG nova.network.neutron [req-f59dfba1-9e13-40ef-b011-09fddc5b0259 req-27974d03-b0eb-4da1-83f8-33bace348c68 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Updating instance_info_cache with network_info: [{"id": "dbc2a5c3-3411-4be9-aa3b-a902180c81c2", "address": "fa:16:3e:7e:8e:8a", "network": {"id": "43d07640-08ec-4f81-9b86-a9b192b9aaf3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-376476172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbc2a5c3-34", "ovs_interfaceid": "dbc2a5c3-3411-4be9-aa3b-a902180c81c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5dbd55d2-5e99-474c-a1f5-8c87c783aa07", "address": "fa:16:3e:07:92:18", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbd55d2-5e", "ovs_interfaceid": "5dbd55d2-5e99-474c-a1f5-8c87c783aa07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "66a415ff-2dea-4458-bdba-35ac845cd7d6", "address": "fa:16:3e:7c:f6:90", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a415ff-2d", "ovs_interfaceid": "66a415ff-2dea-4458-bdba-35ac845cd7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0e19373c-aa09-49fa-a349-1a7caafa8b61", "address": "fa:16:3e:46:67:4c", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e19373c-aa", "ovs_interfaceid": "0e19373c-aa09-49fa-a349-1a7caafa8b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fb8cf209-6174-4bcd-9beb-d2f21ef40e5e", "address": "fa:16:3e:86:4c:dd", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8cf209-61", "ovs_interfaceid": "fb8cf209-6174-4bcd-9beb-d2f21ef40e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b2bc5017-c7ab-43ff-b092-f49336426174", "address": "fa:16:3e:15:05:18", "network": {"id": "061595cf-a510-4019-9445-60a0fa5b2338", "bridge": "br-int", "label": "tempest-device-tagging-net2-827609296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bc5017-c7", "ovs_interfaceid": "b2bc5017-c7ab-43ff-b092-f49336426174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a9571bef-59d5-4a2d-9803-69bf1e5335d1", "address": "fa:16:3e:75:bf:5d", "network": {"id": "061595cf-a510-4019-9445-60a0fa5b2338", "bridge": "br-int", "label": "tempest-device-tagging-net2-827609296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9571bef-59", "ovs_interfaceid": "a9571bef-59d5-4a2d-9803-69bf1e5335d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:19:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f59dfba1-9e13-40ef-b011-09fddc5b0259 req-27974d03-b0eb-4da1-83f8-33bace348c68 service nova] Releasing lock "refresh_cache-2f46a6a8-a043-455a-98f8-dae359594f56" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:19:53 user nova-compute[73497]: DEBUG nova.compute.manager [req-f59dfba1-9e13-40ef-b011-09fddc5b0259 req-27974d03-b0eb-4da1-83f8-33bace348c68 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-changed-b2bc5017-c7ab-43ff-b092-f49336426174 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:19:53 user nova-compute[73497]: DEBUG nova.compute.manager [req-f59dfba1-9e13-40ef-b011-09fddc5b0259 req-27974d03-b0eb-4da1-83f8-33bace348c68 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Refreshing instance network info cache due to event network-changed-b2bc5017-c7ab-43ff-b092-f49336426174. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:19:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f59dfba1-9e13-40ef-b011-09fddc5b0259 req-27974d03-b0eb-4da1-83f8-33bace348c68 service nova] Acquiring lock "refresh_cache-2f46a6a8-a043-455a-98f8-dae359594f56" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:19:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f59dfba1-9e13-40ef-b011-09fddc5b0259 req-27974d03-b0eb-4da1-83f8-33bace348c68 service nova] Acquired lock "refresh_cache-2f46a6a8-a043-455a-98f8-dae359594f56" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:19:53 user nova-compute[73497]: DEBUG nova.network.neutron [req-f59dfba1-9e13-40ef-b011-09fddc5b0259 req-27974d03-b0eb-4da1-83f8-33bace348c68 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Refreshing network info cache for port b2bc5017-c7ab-43ff-b092-f49336426174 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:19:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:19:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:54 user nova-compute[73497]: DEBUG nova.network.neutron [req-f59dfba1-9e13-40ef-b011-09fddc5b0259 req-27974d03-b0eb-4da1-83f8-33bace348c68 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Updated VIF entry in instance network info cache for port b2bc5017-c7ab-43ff-b092-f49336426174. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:19:54 user nova-compute[73497]: DEBUG nova.network.neutron [req-f59dfba1-9e13-40ef-b011-09fddc5b0259 req-27974d03-b0eb-4da1-83f8-33bace348c68 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Updating instance_info_cache with network_info: [{"id": "dbc2a5c3-3411-4be9-aa3b-a902180c81c2", "address": "fa:16:3e:7e:8e:8a", "network": {"id": "43d07640-08ec-4f81-9b86-a9b192b9aaf3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-376476172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbc2a5c3-34", "ovs_interfaceid": "dbc2a5c3-3411-4be9-aa3b-a902180c81c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5dbd55d2-5e99-474c-a1f5-8c87c783aa07", "address": "fa:16:3e:07:92:18", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbd55d2-5e", "ovs_interfaceid": "5dbd55d2-5e99-474c-a1f5-8c87c783aa07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "66a415ff-2dea-4458-bdba-35ac845cd7d6", "address": "fa:16:3e:7c:f6:90", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a415ff-2d", "ovs_interfaceid": "66a415ff-2dea-4458-bdba-35ac845cd7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0e19373c-aa09-49fa-a349-1a7caafa8b61", "address": "fa:16:3e:46:67:4c", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e19373c-aa", "ovs_interfaceid": "0e19373c-aa09-49fa-a349-1a7caafa8b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fb8cf209-6174-4bcd-9beb-d2f21ef40e5e", "address": "fa:16:3e:86:4c:dd", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8cf209-61", "ovs_interfaceid": "fb8cf209-6174-4bcd-9beb-d2f21ef40e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b2bc5017-c7ab-43ff-b092-f49336426174", "address": "fa:16:3e:15:05:18", "network": {"id": "061595cf-a510-4019-9445-60a0fa5b2338", "bridge": "br-int", "label": "tempest-device-tagging-net2-827609296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bc5017-c7", "ovs_interfaceid": "b2bc5017-c7ab-43ff-b092-f49336426174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a9571bef-59d5-4a2d-9803-69bf1e5335d1", "address": "fa:16:3e:75:bf:5d", "network": {"id": "061595cf-a510-4019-9445-60a0fa5b2338", "bridge": "br-int", "label": "tempest-device-tagging-net2-827609296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9571bef-59", "ovs_interfaceid": "a9571bef-59d5-4a2d-9803-69bf1e5335d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:19:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f59dfba1-9e13-40ef-b011-09fddc5b0259 req-27974d03-b0eb-4da1-83f8-33bace348c68 service nova] Releasing lock "refresh_cache-2f46a6a8-a043-455a-98f8-dae359594f56" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:19:54 user nova-compute[73497]: DEBUG nova.compute.manager [req-f59dfba1-9e13-40ef-b011-09fddc5b0259 req-27974d03-b0eb-4da1-83f8-33bace348c68 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-changed-a9571bef-59d5-4a2d-9803-69bf1e5335d1 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:19:54 user nova-compute[73497]: DEBUG nova.compute.manager [req-f59dfba1-9e13-40ef-b011-09fddc5b0259 req-27974d03-b0eb-4da1-83f8-33bace348c68 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Refreshing instance network info cache due to event network-changed-a9571bef-59d5-4a2d-9803-69bf1e5335d1. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:19:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f59dfba1-9e13-40ef-b011-09fddc5b0259 req-27974d03-b0eb-4da1-83f8-33bace348c68 service nova] Acquiring lock "refresh_cache-2f46a6a8-a043-455a-98f8-dae359594f56" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:19:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f59dfba1-9e13-40ef-b011-09fddc5b0259 req-27974d03-b0eb-4da1-83f8-33bace348c68 service nova] Acquired lock "refresh_cache-2f46a6a8-a043-455a-98f8-dae359594f56" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:19:54 user nova-compute[73497]: DEBUG nova.network.neutron [req-f59dfba1-9e13-40ef-b011-09fddc5b0259 req-27974d03-b0eb-4da1-83f8-33bace348c68 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Refreshing network info cache for port a9571bef-59d5-4a2d-9803-69bf1e5335d1 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:19:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:54 user nova-compute[73497]: DEBUG nova.network.neutron [req-f59dfba1-9e13-40ef-b011-09fddc5b0259 req-27974d03-b0eb-4da1-83f8-33bace348c68 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Updated VIF entry in instance network info cache for port a9571bef-59d5-4a2d-9803-69bf1e5335d1. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:19:54 user nova-compute[73497]: DEBUG nova.network.neutron [req-f59dfba1-9e13-40ef-b011-09fddc5b0259 req-27974d03-b0eb-4da1-83f8-33bace348c68 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Updating instance_info_cache with network_info: [{"id": "dbc2a5c3-3411-4be9-aa3b-a902180c81c2", "address": "fa:16:3e:7e:8e:8a", "network": {"id": "43d07640-08ec-4f81-9b86-a9b192b9aaf3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-376476172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbc2a5c3-34", "ovs_interfaceid": "dbc2a5c3-3411-4be9-aa3b-a902180c81c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5dbd55d2-5e99-474c-a1f5-8c87c783aa07", "address": "fa:16:3e:07:92:18", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbd55d2-5e", "ovs_interfaceid": "5dbd55d2-5e99-474c-a1f5-8c87c783aa07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "66a415ff-2dea-4458-bdba-35ac845cd7d6", "address": "fa:16:3e:7c:f6:90", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a415ff-2d", "ovs_interfaceid": "66a415ff-2dea-4458-bdba-35ac845cd7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0e19373c-aa09-49fa-a349-1a7caafa8b61", "address": "fa:16:3e:46:67:4c", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e19373c-aa", "ovs_interfaceid": "0e19373c-aa09-49fa-a349-1a7caafa8b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fb8cf209-6174-4bcd-9beb-d2f21ef40e5e", "address": "fa:16:3e:86:4c:dd", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8cf209-61", "ovs_interfaceid": "fb8cf209-6174-4bcd-9beb-d2f21ef40e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b2bc5017-c7ab-43ff-b092-f49336426174", "address": "fa:16:3e:15:05:18", "network": {"id": "061595cf-a510-4019-9445-60a0fa5b2338", "bridge": "br-int", "label": "tempest-device-tagging-net2-827609296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bc5017-c7", "ovs_interfaceid": "b2bc5017-c7ab-43ff-b092-f49336426174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a9571bef-59d5-4a2d-9803-69bf1e5335d1", "address": "fa:16:3e:75:bf:5d", "network": {"id": "061595cf-a510-4019-9445-60a0fa5b2338", "bridge": "br-int", "label": "tempest-device-tagging-net2-827609296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9571bef-59", "ovs_interfaceid": "a9571bef-59d5-4a2d-9803-69bf1e5335d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:19:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f59dfba1-9e13-40ef-b011-09fddc5b0259 req-27974d03-b0eb-4da1-83f8-33bace348c68 service nova] Releasing lock "refresh_cache-2f46a6a8-a043-455a-98f8-dae359594f56" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:19:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:19:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:19:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:19:56 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:19:56 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:19:56 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=7224MB free_disk=25.31100845336914GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:19:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:19:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:19:56 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 926f8e5c-8d8a-4f07-bf08-e60700ce4698 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:19:56 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 994093f0-e6b2-4c96-b259-c559ef2b1fbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:19:56 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 171985a3-358d-4b26-a66c-372b9b99b386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:19:56 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance aebaeda6-23d1-43a1-afc8-bdc8992067e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:19:56 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance ee6283d5-40de-432d-997c-0be52ff673ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:19:56 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance b68b6975-a24a-4861-a583-406b02446ea0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:19:56 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance ff1085db-4bfc-4c77-a9e4-39f47ffb6d43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:19:56 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 7c124dd9-4dce-4c6f-925c-6eda8e187d84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:19:56 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 4c68f140-4235-4dcb-b99d-1347bc949d15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:19:56 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 043294e5-0618-4a31-bb19-1227ef1f5d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:19:56 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance e9e5c83f-0678-48d4-a81f-1a3f959aabcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:19:56 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 2f46a6a8-a043-455a-98f8-dae359594f56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:19:56 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:19:56 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:19:57 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:19:57 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:19:57 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:19:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.519s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:19:58 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:19:59 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:19:59 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:19:59 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:19:59 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Rebuilding the list of instances to heal {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 23:19:59 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Skipping network cache update for instance because it is Building. {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 26 23:19:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-926f8e5c-8d8a-4f07-bf08-e60700ce4698" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:19:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-926f8e5c-8d8a-4f07-bf08-e60700ce4698" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:19:59 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:19:59 user nova-compute[73497]: DEBUG nova.objects.instance [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lazy-loading 'info_cache' on Instance uuid 926f8e5c-8d8a-4f07-bf08-e60700ce4698 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:19:59 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Updating instance_info_cache with network_info: [{"id": "400e10af-326e-4457-bf67-f7e350fd821e", "address": "fa:16:3e:25:9f:76", "network": {"id": "823997b4-f108-4e9f-807b-2aa2c95f2b09", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-593185584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7402b17f71d6489c9a419ac0d73abefb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400e10af-32", "ovs_interfaceid": "400e10af-326e-4457-bf67-f7e350fd821e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:19:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-926f8e5c-8d8a-4f07-bf08-e60700ce4698" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:19:59 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:19:59 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:19:59 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:19:59 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:20:00 user nova-compute[73497]: DEBUG nova.compute.manager [req-0831781c-ea2b-4f48-8be0-75d0fe6eaf8f req-faba3790-5463-4d7f-898a-1377c4e26fae service nova] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Received event network-changed-c9d76244-be10-4ea6-84d7-86de94e58d05 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:20:00 user nova-compute[73497]: DEBUG nova.compute.manager [req-0831781c-ea2b-4f48-8be0-75d0fe6eaf8f req-faba3790-5463-4d7f-898a-1377c4e26fae service nova] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Refreshing instance network info cache due to event network-changed-c9d76244-be10-4ea6-84d7-86de94e58d05. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:20:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0831781c-ea2b-4f48-8be0-75d0fe6eaf8f req-faba3790-5463-4d7f-898a-1377c4e26fae service nova] Acquiring lock "refresh_cache-ff1085db-4bfc-4c77-a9e4-39f47ffb6d43" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:20:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0831781c-ea2b-4f48-8be0-75d0fe6eaf8f req-faba3790-5463-4d7f-898a-1377c4e26fae service nova] Acquired lock "refresh_cache-ff1085db-4bfc-4c77-a9e4-39f47ffb6d43" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:20:00 user nova-compute[73497]: DEBUG nova.network.neutron [req-0831781c-ea2b-4f48-8be0-75d0fe6eaf8f req-faba3790-5463-4d7f-898a-1377c4e26fae service nova] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Refreshing network info cache for port c9d76244-be10-4ea6-84d7-86de94e58d05 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:20:00 user nova-compute[73497]: DEBUG nova.network.neutron [req-0831781c-ea2b-4f48-8be0-75d0fe6eaf8f req-faba3790-5463-4d7f-898a-1377c4e26fae service nova] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Updated VIF entry in instance network info cache for port c9d76244-be10-4ea6-84d7-86de94e58d05. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:20:00 user nova-compute[73497]: DEBUG nova.network.neutron [req-0831781c-ea2b-4f48-8be0-75d0fe6eaf8f req-faba3790-5463-4d7f-898a-1377c4e26fae service nova] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Updating instance_info_cache with network_info: [{"id": "c9d76244-be10-4ea6-84d7-86de94e58d05", "address": "fa:16:3e:15:e9:03", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d76244-be", "ovs_interfaceid": "c9d76244-be10-4ea6-84d7-86de94e58d05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:20:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0831781c-ea2b-4f48-8be0-75d0fe6eaf8f req-faba3790-5463-4d7f-898a-1377c4e26fae service nova] Releasing lock "refresh_cache-ff1085db-4bfc-4c77-a9e4-39f47ffb6d43" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:20:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-d1d1d1e9-cce3-42c7-9ae3-1dae5b80df84 req-dccf8a80-bf21-4614-9fa0-3de5e377366b service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Received event network-changed-127a3626-0dfe-4050-83d8-43658958e8df {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:20:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-d1d1d1e9-cce3-42c7-9ae3-1dae5b80df84 req-dccf8a80-bf21-4614-9fa0-3de5e377366b service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Refreshing instance network info cache due to event network-changed-127a3626-0dfe-4050-83d8-43658958e8df. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:20:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d1d1d1e9-cce3-42c7-9ae3-1dae5b80df84 req-dccf8a80-bf21-4614-9fa0-3de5e377366b service nova] Acquiring lock "refresh_cache-7c124dd9-4dce-4c6f-925c-6eda8e187d84" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:20:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d1d1d1e9-cce3-42c7-9ae3-1dae5b80df84 req-dccf8a80-bf21-4614-9fa0-3de5e377366b service nova] Acquired lock "refresh_cache-7c124dd9-4dce-4c6f-925c-6eda8e187d84" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:20:03 user nova-compute[73497]: DEBUG nova.network.neutron [req-d1d1d1e9-cce3-42c7-9ae3-1dae5b80df84 req-dccf8a80-bf21-4614-9fa0-3de5e377366b service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Refreshing network info cache for port 127a3626-0dfe-4050-83d8-43658958e8df {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:20:04 user nova-compute[73497]: INFO nova.virt.block_device [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Booting with volume 16a71fdf-6491-4e87-ac8f-81fff9209a5a at /dev/vdc
Aug 26 23:20:04 user nova-compute[73497]: DEBUG os_brick.utils [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:20:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:04 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9675134b-2144-4407-b50a-a422303eb926]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:04 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efa7b58-5296-49e9-bac7-0a9393dfeaf1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:04 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e9b463-1ac2-4008-b623-3923d3abb652]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:04 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e8f5e0-3c48-48ab-babd-807b4e620609]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:20:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:20:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:20:04 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:20:04 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[038f6fb5-8b83-4cf7-a75d-d13810aa2bd9]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:20:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:20:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:20:04 user nova-compute[73497]: DEBUG os_brick.utils [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:20:04 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Updating existing volume attachment record: d8889633-40c1-416b-8745-534fe5d3ca56 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:20:04 user nova-compute[73497]: DEBUG nova.network.neutron [req-d1d1d1e9-cce3-42c7-9ae3-1dae5b80df84 req-dccf8a80-bf21-4614-9fa0-3de5e377366b service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Updated VIF entry in instance network info cache for port 127a3626-0dfe-4050-83d8-43658958e8df. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:20:04 user nova-compute[73497]: DEBUG nova.network.neutron [req-d1d1d1e9-cce3-42c7-9ae3-1dae5b80df84 req-dccf8a80-bf21-4614-9fa0-3de5e377366b service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Updating instance_info_cache with network_info: [{"id": "127a3626-0dfe-4050-83d8-43658958e8df", "address": "fa:16:3e:1c:46:66", "network": {"id": "0b5f5877-f6f2-4814-878a-25181e72db29", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-155251039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19a5c1c2c4a456a86efbbadd38d94c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127a3626-0d", "ovs_interfaceid": "127a3626-0dfe-4050-83d8-43658958e8df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:20:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d1d1d1e9-cce3-42c7-9ae3-1dae5b80df84 req-dccf8a80-bf21-4614-9fa0-3de5e377366b service nova] Releasing lock "refresh_cache-7c124dd9-4dce-4c6f-925c-6eda8e187d84" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:20:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Acquiring lock "ee6283d5-40de-432d-997c-0be52ff673ca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "ee6283d5-40de-432d-997c-0be52ff673ca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:05 user nova-compute[73497]: DEBUG nova.objects.instance [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lazy-loading 'flavor' on Instance uuid ee6283d5-40de-432d-997c-0be52ff673ca {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:20:05 user nova-compute[73497]: DEBUG nova.compute.manager [None req-068c7a2d-e028-4627-83ba-a214cb2b25b8 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:20:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "ee6283d5-40de-432d-997c-0be52ff673ca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:05 user nova-compute[73497]: INFO nova.compute.manager [None req-068c7a2d-e028-4627-83ba-a214cb2b25b8 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] instance snapshotting
Aug 26 23:20:05 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-068c7a2d-e028-4627-83ba-a214cb2b25b8 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Beginning live snapshot process
Aug 26 23:20:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Acquiring lock "ee6283d5-40de-432d-997c-0be52ff673ca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "ee6283d5-40de-432d-997c-0be52ff673ca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:05 user nova-compute[73497]: INFO nova.compute.manager [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Attaching volume a1647697-14cc-47fd-a9c1-003e0115159c to /dev/vdb
Aug 26 23:20:05 user nova-compute[73497]: DEBUG os_brick.utils [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:20:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:05 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a29106-cff0-4c17-86fd-0d87d79fbd78]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:05 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6deb19f8-8210-4cfc-8114-cfbc58f5246b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:05 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da79d85-dbb3-4a82-aefa-9b6d8d7883d6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:05 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff02a9c-f995-4321-a75b-1215d8a5ca50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:20:05 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:20:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-068c7a2d-e028-4627-83ba-a214cb2b25b8 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk --force-share --output=json -f qcow2 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:20:05 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:20:05 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3099cdd-c4c8-4a7f-a940-8e2ca1c00787]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:05 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:20:05 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:20:05 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:20:05 user nova-compute[73497]: DEBUG os_brick.utils [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:20:05 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Updating existing volume attachment record: baf5b91f-74eb-4396-bc66-3fba7f4d2a83 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:20:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-068c7a2d-e028-4627-83ba-a214cb2b25b8 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk --force-share --output=json -f qcow2" returned: 0 in 0.172s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-068c7a2d-e028-4627-83ba-a214cb2b25b8 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk --force-share --output=json -f qcow2 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG nova.compute.manager [req-49d8e89c-3d6a-497b-bee1-b90dbe439567 req-7e947730-d54c-4d0a-95a8-ef84edd02550 service nova] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Received event network-changed-dc5326bf-72f0-4067-9fcc-420f0d1434aa {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG nova.compute.manager [req-49d8e89c-3d6a-497b-bee1-b90dbe439567 req-7e947730-d54c-4d0a-95a8-ef84edd02550 service nova] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Refreshing instance network info cache due to event network-changed-dc5326bf-72f0-4067-9fcc-420f0d1434aa. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-49d8e89c-3d6a-497b-bee1-b90dbe439567 req-7e947730-d54c-4d0a-95a8-ef84edd02550 service nova] Acquiring lock "refresh_cache-4c68f140-4235-4dcb-b99d-1347bc949d15" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-49d8e89c-3d6a-497b-bee1-b90dbe439567 req-7e947730-d54c-4d0a-95a8-ef84edd02550 service nova] Acquired lock "refresh_cache-4c68f140-4235-4dcb-b99d-1347bc949d15" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG nova.network.neutron [req-49d8e89c-3d6a-497b-bee1-b90dbe439567 req-7e947730-d54c-4d0a-95a8-ef84edd02550 service nova] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Refreshing network info cache for port dc5326bf-72f0-4067-9fcc-420f0d1434aa {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Acquiring lock "4c68f140-4235-4dcb-b99d-1347bc949d15" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "4c68f140-4235-4dcb-b99d-1347bc949d15" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG nova.objects.instance [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lazy-loading 'flavor' on Instance uuid 4c68f140-4235-4dcb-b99d-1347bc949d15 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-068c7a2d-e028-4627-83ba-a214cb2b25b8 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk --force-share --output=json -f qcow2" returned: 0 in 0.216s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-068c7a2d-e028-4627-83ba-a214cb2b25b8 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "4c68f140-4235-4dcb-b99d-1347bc949d15" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.133s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Acquiring lock "4c68f140-4235-4dcb-b99d-1347bc949d15" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "4c68f140-4235-4dcb-b99d-1347bc949d15" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:06 user nova-compute[73497]: INFO nova.compute.manager [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Attaching volume 4e31d512-8b34-4754-ae73-aba20997de45 to /dev/vdb
Aug 26 23:20:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-068c7a2d-e028-4627-83ba-a214cb2b25b8 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.210s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-068c7a2d-e028-4627-83ba-a214cb2b25b8 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1mqiz5_1/33624890415747ea82cb300465963657.delta 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-068c7a2d-e028-4627-83ba-a214cb2b25b8 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1mqiz5_1/33624890415747ea82cb300465963657.delta 1073741824" returned: 0 in 0.073s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:06 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-068c7a2d-e028-4627-83ba-a214cb2b25b8 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 23:20:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG os_brick.utils [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[771bfc7d-787f-40b7-9c2b-e7c874614cd7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09c3b33-1ee4-4cf5-932a-14283210c0be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a8689a-462d-4572-abe5-a63621a7793d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2c5e47-d877-464e-baab-33ff5a333ef4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:20:06 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:20:06 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[35127eb1-3fea-4863-b0d3-9d5534b9a0a3]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG os_brick.utils [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Updating existing volume attachment record: c061db19-6617-47d3-8054-5168cf6827a7 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG nova.network.neutron [req-49d8e89c-3d6a-497b-bee1-b90dbe439567 req-7e947730-d54c-4d0a-95a8-ef84edd02550 service nova] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Updated VIF entry in instance network info cache for port dc5326bf-72f0-4067-9fcc-420f0d1434aa. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG nova.network.neutron [req-49d8e89c-3d6a-497b-bee1-b90dbe439567 req-7e947730-d54c-4d0a-95a8-ef84edd02550 service nova] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Updating instance_info_cache with network_info: [{"id": "dc5326bf-72f0-4067-9fcc-420f0d1434aa", "address": "fa:16:3e:d0:86:2a", "network": {"id": "e5209dd2-0f09-4bab-b0a6-b486792104a3", "bridge": "br-int", "label": "tempest-TestStampPattern-819945601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a539515b1f47d39d42e182bef80e63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc5326bf-72", "ovs_interfaceid": "dc5326bf-72f0-4067-9fcc-420f0d1434aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:20:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-49d8e89c-3d6a-497b-bee1-b90dbe439567 req-7e947730-d54c-4d0a-95a8-ef84edd02550 service nova] Releasing lock "refresh_cache-4c68f140-4235-4dcb-b99d-1347bc949d15" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:20:07 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-068c7a2d-e028-4627-83ba-a214cb2b25b8 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73497) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 23:20:07 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-068c7a2d-e028-4627-83ba-a214cb2b25b8 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73497) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 23:20:07 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-068c7a2d-e028-4627-83ba-a214cb2b25b8 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 23:20:07 user nova-compute[73497]: DEBUG nova.privsep.utils [None req-068c7a2d-e028-4627-83ba-a214cb2b25b8 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73497) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 23:20:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-068c7a2d-e028-4627-83ba-a214cb2b25b8 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1mqiz5_1/33624890415747ea82cb300465963657.delta /opt/stack/data/nova/instances/snapshots/tmp1mqiz5_1/33624890415747ea82cb300465963657 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:08 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-068c7a2d-e028-4627-83ba-a214cb2b25b8 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1mqiz5_1/33624890415747ea82cb300465963657.delta /opt/stack/data/nova/instances/snapshots/tmp1mqiz5_1/33624890415747ea82cb300465963657" returned: 0 in 0.301s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:08 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-068c7a2d-e028-4627-83ba-a214cb2b25b8 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Snapshot extracted, beginning image upload
Aug 26 23:20:08 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:10 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-068c7a2d-e028-4627-83ba-a214cb2b25b8 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Snapshot image upload complete
Aug 26 23:20:10 user nova-compute[73497]: INFO nova.compute.manager [None req-068c7a2d-e028-4627-83ba-a214cb2b25b8 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Took 5.17 seconds to snapshot the instance on the hypervisor.
Aug 26 23:20:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "ff1085db-4bfc-4c77-a9e4-39f47ffb6d43" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "ff1085db-4bfc-4c77-a9e4-39f47ffb6d43" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG nova.objects.instance [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lazy-loading 'flavor' on Instance uuid ff1085db-4bfc-4c77-a9e4-39f47ffb6d43 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG nova.compute.manager [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:20:17 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Creating image(s)
Aug 26 23:20:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Did not create local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Ensure instance console log exists: /opt/stack/data/nova/instances/2f46a6a8-a043-455a-98f8-dae359594f56/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Start _get_guest_xml network_info=[{"id": "dbc2a5c3-3411-4be9-aa3b-a902180c81c2", "address": "fa:16:3e:7e:8e:8a", "network": {"id": "43d07640-08ec-4f81-9b86-a9b192b9aaf3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-376476172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbc2a5c3-34", "ovs_interfaceid": "dbc2a5c3-3411-4be9-aa3b-a902180c81c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5dbd55d2-5e99-474c-a1f5-8c87c783aa07", "address": "fa:16:3e:07:92:18", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbd55d2-5e", "ovs_interfaceid": "5dbd55d2-5e99-474c-a1f5-8c87c783aa07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "66a415ff-2dea-4458-bdba-35ac845cd7d6", "address": "fa:16:3e:7c:f6:90", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a415ff-2d", "ovs_interfaceid": "66a415ff-2dea-4458-bdba-35ac845cd7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0e19373c-aa09-49fa-a349-1a7caafa8b61", "address": "fa:16:3e:46:67:4c", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e19373c-aa", "ovs_interfaceid": "0e19373c-aa09-49fa-a349-1a7caafa8b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fb8cf209-6174-4bcd-9beb-d2f21ef40e5e", "address": "fa:16:3e:86:4c:dd", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8cf209-61", "ovs_interfaceid": "fb8cf209-6174-4bcd-9beb-d2f21ef40e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b2bc5017-c7ab-43ff-b092-f49336426174", "address": "fa:16:3e:15:05:18", "network": {"id": "061595cf-a510-4019-9445-60a0fa5b2338", "bridge": "br-int", "label": "tempest-device-tagging-net2-827609296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bc5017-c7", "ovs_interfaceid": "b2bc5017-c7ab-43ff-b092-f49336426174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a9571bef-59d5-4a2d-9803-69bf1e5335d1", "address": "fa:16:3e:75:bf:5d", "network": {"id": "061595cf-a510-4019-9445-60a0fa5b2338", "bridge": "br-int", "label": "tempest-device-tagging-net2-827609296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9571bef-59", "ovs_interfaceid": "a9571bef-59d5-4a2d-9803-69bf1e5335d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2c6e9e2c-3c0e-412c-a3c9-62dad7999376', 'guest_format': None, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUlHYgXE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2f46a6a8-a043-455a-98f8-dae359594f56', 'attached_at': '', 'detached_at': '', 'volume_id': '4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f', 'serial': '4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f'}, 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}, {'attachment_id': '33424836-4f78-4198-8f5d-eb4cc4e951f0', 'guest_format': None, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxFTKOjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2f46a6a8-a043-455a-98f8-dae359594f56', 'attached_at': '', 'detached_at': '', 'volume_id': 'fae83862-cb43-4437-9680-f544f97fe6ee', 'serial': 'fae83862-cb43-4437-9680-f544f97fe6ee'}, 'boot_index': 1, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}, {'attachment_id': 'd8889633-40c1-416b-8745-534fe5d3ca56', 'guest_format': None, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OwQNLdAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2f46a6a8-a043-455a-98f8-dae359594f56', 'attached_at': '', 'detached_at': '', 'volume_id': '16a71fdf-6491-4e87-ac8f-81fff9209a5a', 'serial': '16a71fdf-6491-4e87-ac8f-81fff9209a5a'}, 'boot_index': 2, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "ff1085db-4bfc-4c77-a9e4-39f47ffb6d43" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:17 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:20:17 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:20:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUlHYgXE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:20:17 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:20:17 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:20:17 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:20:17 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:20:17 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18ae6b1-48d0-4d6e-8259-521a38ef1de2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:20:17 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd407983-7b91-4bcc-8b9e-87b923d30f0f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f] added
Aug 26 23:20:17 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fe5b29-e3de-4985-8075-c1eb2ec8827c]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "ff1085db-4bfc-4c77-a9e4-39f47ffb6d43" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "ff1085db-4bfc-4c77-a9e4-39f47ffb6d43" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:17 user nova-compute[73497]: INFO nova.compute.manager [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Attaching volume 917dc081-eb80-4c05-ac91-9e6dd93718eb to /dev/vdb
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[90dc47db-c4c6-42a5-81bf-5d4bea7afd21]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cUlHYgXE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cUlHYgXE" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c357d6f7-d103-4619-8f9d-fac500adc45e]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cUlHYgXE'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[47319093-0b15-467c-83dd-fd5e4f87db3a]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG os_brick.utils [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52d20aa-4bb0-46f6-9139-0e0716b5619f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:20:17 user nova-compute[73497]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:20:17 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:20:17 user nova-compute[73497]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:20:17 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f485cf94-916f-47ab-8d3e-0d915cb243f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef070024-19a0-49e6-9cc8-2395658558b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ee38aa-e612-4da9-9dd4-28486dab5441]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e344fde-3184-4b4f-bef2-77979b8ee649]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1ff836-e51b-425c-b90a-a006678fc778]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f, portal: 172.16.0.220,3260]
Aug 26 23:20:17 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f, portal: 172.16.0.220,3260] successful.
Aug 26 23:20:17 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:20:17 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb3feee-c850-4b43-ae0f-9ea2005ffb0c]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG os_brick.utils [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Updating existing volume attachment record: 71abefd6-7dd1-43bd-93c1-1238dbcc3648 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79c806a-6ea7-4675-8078-d20f07168184]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[181f62a4-a6a8-4ba6-9a14-ab20c6b7f4c9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:20:17 user nova-compute[73497]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:20:17 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:20:17 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:20:17 user nova-compute[73497]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:20:17 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:20:17 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[da03d069-2004-4203-8b0a-7825991a46f0]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:17 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: None {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbmOUkyq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:20:18 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:20:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUlHYgXE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '26335633664333439', 'path': '/dev/sdd'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335633664333439', 'path': '/dev/sdd'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.576s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:20:18 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:20:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:20:18 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:20:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[aace6d72-0b93-4445-b799-a0ffff729b2a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:20:18 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxFTKOjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:20:18 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:20:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a502b54d-3ffd-4c11-a304-9491d4e84a1b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c] added
Aug 26 23:20:18 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c851f2f7-8bea-48c5-9e4a-f0593d1d2f39]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c3e882-f0cc-484b-a422-749c1871db13]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BbmOUkyq {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BbmOUkyq" returned: 0 in 0.038s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05ea982-1384-415e-b20c-691f6c1ceac5]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BbmOUkyq'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bd906c-edb4-428e-ab8e-6862787dcda7]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2559f1cd-4d29-4d26-af40-015e0b736039]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:20:18 user nova-compute[73497]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:20:18 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:20:18 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:20:18 user nova-compute[73497]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:20:18 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:20:18 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:20:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hieABtEg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:20:18 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:20:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:20:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d31750-c3b6-44c6-bf72-4bde228f254e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c, portal: 172.16.0.220,3260]
Aug 26 23:20:19 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c, portal: 172.16.0.220,3260] successful.
Aug 26 23:20:19 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afe6b65-f518-4d32-8f84-3760674e06a7]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65367b0-d194-4480-99c4-051cbefd1dd7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:20:19 user nova-compute[73497]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:20:19 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:20:19 user nova-compute[73497]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:20:19 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:20:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:20:19 user nova-compute[73497]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:20:19 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:20:19 user nova-compute[73497]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:20:19 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:20:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:20:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:20:19 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:20:19 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:20:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbd752c-a27c-4abb-b961-ee17e93a8f2d]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:19 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: None {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbmOUkyq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] <== connect_volume: return (1954ms) {'type': 'block', 'scsi_wwn': '23335303436633232', 'path': '/dev/sde'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335303436633232', 'path': '/dev/sde'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.345s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:20:20 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:20:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:20:20 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:20:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG nova.objects.instance [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lazy-loading 'flavor' on Instance uuid ee6283d5-40de-432d-997c-0be52ff673ca {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[05574af7-5110-4e5c-b13c-f6931b4b509b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:20:20 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 23:20:20 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:20:20 user nova-compute[73497]:   <source dev="/dev/sde"/>
Aug 26 23:20:20 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:20:20 user nova-compute[73497]:   <serial>a1647697-14cc-47fd-a9c1-003e0115159c</serial>
Aug 26 23:20:20 user nova-compute[73497]: </disk>
Aug 26 23:20:20 user nova-compute[73497]:  {{(pid=73497) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb3276d-36c6-46b6-9ced-66a16bc158a9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee] added
Aug 26 23:20:20 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bda2a0-31f8-4f72-86dc-f50adbfb6ef6]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa07c295-e952-417c-8576-ebc496e553f0]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YxFTKOjc {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YxFTKOjc" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04afb9c-ccbc-478a-a2f6-5acbb112b2ac]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YxFTKOjc'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[82409972-6086-4189-9129-812ec963501d]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e21cc69-f996-4e83-b518-de22b950e89c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:20:20 user nova-compute[73497]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:20:20 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:20:20 user nova-compute[73497]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:20:20 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:20:20 user nova-compute[73497]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:20:20 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:20:20 user nova-compute[73497]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:20:20 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ea1701-b74b-49e4-b06f-d705c03e5d3b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee, portal: 172.16.0.220,3260]
Aug 26 23:20:20 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee, portal: 172.16.0.220,3260] successful.
Aug 26 23:20:20 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b32dac-d25d-4810-b5e0-ec51727a0b41]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b03fcd3-2bf6-4114-8792-85c5e26d60d0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:20:20 user nova-compute[73497]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:20:20 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:20:20 user nova-compute[73497]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:20:20 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:20:20 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:20:20 user nova-compute[73497]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:20:20 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:20:20 user nova-compute[73497]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:20:20 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:20:20 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] HCTL ('37', '-', '-', 0) found on session 18 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40f262c-4f53-4052-a6c5-2cc29fee8090]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxFTKOjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] No VIF found with MAC fa:16:3e:56:41:f9, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:20:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e9886090-52d5-447a-b385-c9f319ef4d68 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "ee6283d5-40de-432d-997c-0be52ff673ca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.179s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] <== connect_volume: return (2710ms) {'type': 'block', 'scsi_wwn': '23335386566336633', 'path': '/dev/sdf'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335386566336633', 'path': '/dev/sdf'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.497s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:20:21 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:20:21 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:20:21 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:20:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[87463042-bff1-49fd-8a09-e6f39a3b27a6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:20:21 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OwQNLdAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:20:21 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:20:21 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[67242c4d-76f2-4705-8811-7d93d4a722be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45] added
Aug 26 23:20:21 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bd3128-1652-4f92-9416-79e54bb65e88]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd24966c-8d69-412b-a718-3d7ed123eb1b]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hieABtEg {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hieABtEg" returned: 0 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55899ed-09fb-49e5-b88d-b106f9c12fb1]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hieABtEg'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee09de23-0d07-4486-bc0c-6638d8040d3b]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe1e216-55c2-4516-9c7a-6fe3a366a563]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:20:21 user nova-compute[73497]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:20:21 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:20:21 user nova-compute[73497]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:20:21 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:20:21 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:20:21 user nova-compute[73497]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:20:21 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:20:21 user nova-compute[73497]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:20:21 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:20:21 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a573e3-b41e-47ac-877e-35718d26056e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45, portal: 172.16.0.220,3260]
Aug 26 23:20:21 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45, portal: 172.16.0.220,3260] successful.
Aug 26 23:20:21 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7149b6a-6cad-4bae-95be-e85642686c62]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f65bac-7fbc-4cdd-8797-2ed0e33479d6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:20:21 user nova-compute[73497]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:20:21 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:20:21 user nova-compute[73497]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:20:21 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:20:21 user nova-compute[73497]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45 (non-flash)
Aug 26 23:20:21 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:20:21 user nova-compute[73497]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:20:21 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:20:21 user nova-compute[73497]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:20:21 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:20:21 user nova-compute[73497]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45 (non-flash)
Aug 26 23:20:21 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] HCTL ('38', '-', '-', 0) found on session 19 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11460dd-44d1-491c-9414-3e84dbc46201]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Searching for a device in session 19 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:20:21 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hieABtEg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:20:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:22 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:20:22 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] <== connect_volume: return (3899ms) {'type': 'block', 'scsi_wwn': '26135336663326261', 'path': '/dev/sdg'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:20:22 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135336663326261', 'path': '/dev/sdg'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:20:22 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.362s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:20:22 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:20:22 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:20:22 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:20:22 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:20:22 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:22 user nova-compute[73497]: DEBUG nova.objects.instance [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lazy-loading 'flavor' on Instance uuid 4c68f140-4235-4dcb-b99d-1347bc949d15 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:20:22 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:22 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6f40f5-5730-49b0-8e16-fbd2809bc5f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:22 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:20:22 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:22 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:22 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 23:20:22 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:20:22 user nova-compute[73497]:   <source dev="/dev/sdg"/>
Aug 26 23:20:22 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:20:22 user nova-compute[73497]:   <serial>4e31d512-8b34-4754-ae73-aba20997de45</serial>
Aug 26 23:20:22 user nova-compute[73497]: </disk>
Aug 26 23:20:22 user nova-compute[73497]:  {{(pid=73497) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 23:20:22 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:22 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f7d9b5-4c52-4dac-8a52-27168ddc8c1c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:22 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a] added
Aug 26 23:20:22 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:22 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:22 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:22 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4284a5f-83f0-4c3e-9e5a-6281a9300343]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:22 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:22 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:22 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:22 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[344eb3a5-5622-4192-a979-720488a4a458]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:22 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:22 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OwQNLdAx {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:22 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OwQNLdAx" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee41571-9c36-4d46-bff4-e60fd9d6e01b]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OwQNLdAx'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e5af2c-29dd-4ab2-a099-5148be3262f4]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d033cb-66d0-461f-be9a-4b7f69986a38]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:20:23 user nova-compute[73497]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:20:23 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:20:23 user nova-compute[73497]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:20:23 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:20:23 user nova-compute[73497]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45 (non-flash)
Aug 26 23:20:23 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:20:23 user nova-compute[73497]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:20:23 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:20:23 user nova-compute[73497]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:20:23 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:20:23 user nova-compute[73497]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45 (non-flash)
Aug 26 23:20:23 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7e1a6b-a9d0-4fd4-9cb8-8b65a2dc0743]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a, portal: 172.16.0.220,3260]
Aug 26 23:20:23 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a, portal: 172.16.0.220,3260] successful.
Aug 26 23:20:23 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f5c66c-287b-4bdd-967c-e602ef13ed62]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8aa27c-5a6e-4323-8c1f-2cd8ffcd362b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:20:23 user nova-compute[73497]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:20:23 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:20:23 user nova-compute[73497]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:20:23 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:20:23 user nova-compute[73497]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45 (non-flash)
Aug 26 23:20:23 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:20:23 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:20:23 user nova-compute[73497]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:20:23 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:20:23 user nova-compute[73497]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:20:23 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:20:23 user nova-compute[73497]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45 (non-flash)
Aug 26 23:20:23 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:20:23 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] HCTL ('39', '-', '-', 0) found on session 20 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[813d08b0-ab8d-4eec-b1e8-0e08728841bb]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Searching for a device in session 20 and hctl ['39', '*', '*', 0] yield: None {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG nova.compute.manager [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Stashing vm_state: active {{(pid=73497) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] No VIF found with MAC fa:16:3e:d0:86:2a, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-928d993f-3a9c-44b1-bd0e-288769685765 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "4c68f140-4235-4dcb-b99d-1347bc949d15" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.160s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:20:23 user nova-compute[73497]: INFO nova.compute.claims [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Claim successful on node user
Aug 26 23:20:23 user nova-compute[73497]: INFO nova.compute.resource_tracker [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Updating resource usage from migration 14136b35-f57f-4887-b829-d288d7ca3655
Aug 26 23:20:23 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.484s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:23 user nova-compute[73497]: INFO nova.compute.manager [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Migrating
Aug 26 23:20:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:20:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Acquired lock "compute-rpcapi-router" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:20:24 user nova-compute[73497]: INFO nova.compute.rpcapi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 26 23:20:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Releasing lock "compute-rpcapi-router" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Acquiring lock "refresh_cache-ee6283d5-40de-432d-997c-0be52ff673ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Acquired lock "refresh_cache-ee6283d5-40de-432d-997c-0be52ff673ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.network.neutron [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Searching for a device in session 20 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OwQNLdAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.502s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] <== connect_volume: return (2864ms) {'type': 'block', 'scsi_wwn': '23462343838386637', 'path': '/dev/sdh'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462343838386637', 'path': '/dev/sdh'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1775784956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1775784956',id=21,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9PcDWaqvZjQMAm2aFt+GxNtEgti/NEeHD88SVIby22zzwNaIAqngw48wB+G3YfNVc+s3B1+0Mu4lcCj5+9KN6J/GDGAN+VKjqnDSozbka/CKrR8HOKCotXzucPkwM8Jw==',key_name='tempest-keypair-312567637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70d34ef8af644207b59d77a2d42c5f21',ramdisk_id='',reservation_id='r-xfpadl0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-802076125',owner_user_name='tempest-TaggedBootDevicesTest-802076125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:19:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db2fc512067944a7aa32ec31c9db0252',uuid=2f46a6a8-a043-455a-98f8-dae359594f56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbc2a5c3-3411-4be9-aa3b-a902180c81c2", "address": "fa:16:3e:7e:8e:8a", "network": {"id": "43d07640-08ec-4f81-9b86-a9b192b9aaf3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-376476172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbc2a5c3-34", "ovs_interfaceid": "dbc2a5c3-3411-4be9-aa3b-a902180c81c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converting VIF {"id": "dbc2a5c3-3411-4be9-aa3b-a902180c81c2", "address": "fa:16:3e:7e:8e:8a", "network": {"id": "43d07640-08ec-4f81-9b86-a9b192b9aaf3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-376476172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbc2a5c3-34", "ovs_interfaceid": "dbc2a5c3-3411-4be9-aa3b-a902180c81c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:8e:8a,bridge_name='br-int',has_traffic_filtering=True,id=dbc2a5c3-3411-4be9-aa3b-a902180c81c2,network=Network(43d07640-08ec-4f81-9b86-a9b192b9aaf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbc2a5c3-34') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1775784956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1775784956',id=21,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9PcDWaqvZjQMAm2aFt+GxNtEgti/NEeHD88SVIby22zzwNaIAqngw48wB+G3YfNVc+s3B1+0Mu4lcCj5+9KN6J/GDGAN+VKjqnDSozbka/CKrR8HOKCotXzucPkwM8Jw==',key_name='tempest-keypair-312567637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70d34ef8af644207b59d77a2d42c5f21',ramdisk_id='',reservation_id='r-xfpadl0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-802076125',owner_user_name='tempest-TaggedBootDevicesTest-802076125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:19:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db2fc512067944a7aa32ec31c9db0252',uuid=2f46a6a8-a043-455a-98f8-dae359594f56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5dbd55d2-5e99-474c-a1f5-8c87c783aa07", "address": "fa:16:3e:07:92:18", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbd55d2-5e", "ovs_interfaceid": "5dbd55d2-5e99-474c-a1f5-8c87c783aa07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converting VIF {"id": "5dbd55d2-5e99-474c-a1f5-8c87c783aa07", "address": "fa:16:3e:07:92:18", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbd55d2-5e", "ovs_interfaceid": "5dbd55d2-5e99-474c-a1f5-8c87c783aa07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:92:18,bridge_name='br-int',has_traffic_filtering=True,id=5dbd55d2-5e99-474c-a1f5-8c87c783aa07,network=Network(cf1f6776-4e09-43f5-8ab1-3a654646b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5dbd55d2-5e') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1775784956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1775784956',id=21,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9PcDWaqvZjQMAm2aFt+GxNtEgti/NEeHD88SVIby22zzwNaIAqngw48wB+G3YfNVc+s3B1+0Mu4lcCj5+9KN6J/GDGAN+VKjqnDSozbka/CKrR8HOKCotXzucPkwM8Jw==',key_name='tempest-keypair-312567637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70d34ef8af644207b59d77a2d42c5f21',ramdisk_id='',reservation_id='r-xfpadl0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-802076125',owner_user_name='tempest-TaggedBootDevicesTest-802076125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:19:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db2fc512067944a7aa32ec31c9db0252',uuid=2f46a6a8-a043-455a-98f8-dae359594f56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66a415ff-2dea-4458-bdba-35ac845cd7d6", "address": "fa:16:3e:7c:f6:90", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a415ff-2d", "ovs_interfaceid": "66a415ff-2dea-4458-bdba-35ac845cd7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converting VIF {"id": "66a415ff-2dea-4458-bdba-35ac845cd7d6", "address": "fa:16:3e:7c:f6:90", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a415ff-2d", "ovs_interfaceid": "66a415ff-2dea-4458-bdba-35ac845cd7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:f6:90,bridge_name='br-int',has_traffic_filtering=True,id=66a415ff-2dea-4458-bdba-35ac845cd7d6,network=Network(cf1f6776-4e09-43f5-8ab1-3a654646b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap66a415ff-2d') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1775784956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1775784956',id=21,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9PcDWaqvZjQMAm2aFt+GxNtEgti/NEeHD88SVIby22zzwNaIAqngw48wB+G3YfNVc+s3B1+0Mu4lcCj5+9KN6J/GDGAN+VKjqnDSozbka/CKrR8HOKCotXzucPkwM8Jw==',key_name='tempest-keypair-312567637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70d34ef8af644207b59d77a2d42c5f21',ramdisk_id='',reservation_id='r-xfpadl0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-802076125',owner_user_name='tempest-TaggedBootDevicesTest-802076125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:19:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db2fc512067944a7aa32ec31c9db0252',uuid=2f46a6a8-a043-455a-98f8-dae359594f56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e19373c-aa09-49fa-a349-1a7caafa8b61", "address": "fa:16:3e:46:67:4c", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e19373c-aa", "ovs_interfaceid": "0e19373c-aa09-49fa-a349-1a7caafa8b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converting VIF {"id": "0e19373c-aa09-49fa-a349-1a7caafa8b61", "address": "fa:16:3e:46:67:4c", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e19373c-aa", "ovs_interfaceid": "0e19373c-aa09-49fa-a349-1a7caafa8b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:67:4c,bridge_name='br-int',has_traffic_filtering=True,id=0e19373c-aa09-49fa-a349-1a7caafa8b61,network=Network(cf1f6776-4e09-43f5-8ab1-3a654646b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e19373c-aa') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1775784956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1775784956',id=21,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9PcDWaqvZjQMAm2aFt+GxNtEgti/NEeHD88SVIby22zzwNaIAqngw48wB+G3YfNVc+s3B1+0Mu4lcCj5+9KN6J/GDGAN+VKjqnDSozbka/CKrR8HOKCotXzucPkwM8Jw==',key_name='tempest-keypair-312567637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70d34ef8af644207b59d77a2d42c5f21',ramdisk_id='',reservation_id='r-xfpadl0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-802076125',owner_user_name='tempest-TaggedBootDevicesTest-802076125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:19:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db2fc512067944a7aa32ec31c9db0252',uuid=2f46a6a8-a043-455a-98f8-dae359594f56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb8cf209-6174-4bcd-9beb-d2f21ef40e5e", "address": "fa:16:3e:86:4c:dd", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8cf209-61", "ovs_interfaceid": "fb8cf209-6174-4bcd-9beb-d2f21ef40e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converting VIF {"id": "fb8cf209-6174-4bcd-9beb-d2f21ef40e5e", "address": "fa:16:3e:86:4c:dd", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8cf209-61", "ovs_interfaceid": "fb8cf209-6174-4bcd-9beb-d2f21ef40e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:4c:dd,bridge_name='br-int',has_traffic_filtering=True,id=fb8cf209-6174-4bcd-9beb-d2f21ef40e5e,network=Network(cf1f6776-4e09-43f5-8ab1-3a654646b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb8cf209-61') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1775784956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1775784956',id=21,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9PcDWaqvZjQMAm2aFt+GxNtEgti/NEeHD88SVIby22zzwNaIAqngw48wB+G3YfNVc+s3B1+0Mu4lcCj5+9KN6J/GDGAN+VKjqnDSozbka/CKrR8HOKCotXzucPkwM8Jw==',key_name='tempest-keypair-312567637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70d34ef8af644207b59d77a2d42c5f21',ramdisk_id='',reservation_id='r-xfpadl0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-802076125',owner_user_name='tempest-TaggedBootDevicesTest-802076125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:19:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db2fc512067944a7aa32ec31c9db0252',uuid=2f46a6a8-a043-455a-98f8-dae359594f56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2bc5017-c7ab-43ff-b092-f49336426174", "address": "fa:16:3e:15:05:18", "network": {"id": "061595cf-a510-4019-9445-60a0fa5b2338", "bridge": "br-int", "label": "tempest-device-tagging-net2-827609296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bc5017-c7", "ovs_interfaceid": "b2bc5017-c7ab-43ff-b092-f49336426174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converting VIF {"id": "b2bc5017-c7ab-43ff-b092-f49336426174", "address": "fa:16:3e:15:05:18", "network": {"id": "061595cf-a510-4019-9445-60a0fa5b2338", "bridge": "br-int", "label": "tempest-device-tagging-net2-827609296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bc5017-c7", "ovs_interfaceid": "b2bc5017-c7ab-43ff-b092-f49336426174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:05:18,bridge_name='br-int',has_traffic_filtering=True,id=b2bc5017-c7ab-43ff-b092-f49336426174,network=Network(061595cf-a510-4019-9445-60a0fa5b2338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2bc5017-c7') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1775784956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1775784956',id=21,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9PcDWaqvZjQMAm2aFt+GxNtEgti/NEeHD88SVIby22zzwNaIAqngw48wB+G3YfNVc+s3B1+0Mu4lcCj5+9KN6J/GDGAN+VKjqnDSozbka/CKrR8HOKCotXzucPkwM8Jw==',key_name='tempest-keypair-312567637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70d34ef8af644207b59d77a2d42c5f21',ramdisk_id='',reservation_id='r-xfpadl0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-802076125',owner_user_name='tempest-TaggedBootDevicesTest-802076125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:19:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db2fc512067944a7aa32ec31c9db0252',uuid=2f46a6a8-a043-455a-98f8-dae359594f56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9571bef-59d5-4a2d-9803-69bf1e5335d1", "address": "fa:16:3e:75:bf:5d", "network": {"id": "061595cf-a510-4019-9445-60a0fa5b2338", "bridge": "br-int", "label": "tempest-device-tagging-net2-827609296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9571bef-59", "ovs_interfaceid": "a9571bef-59d5-4a2d-9803-69bf1e5335d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converting VIF {"id": "a9571bef-59d5-4a2d-9803-69bf1e5335d1", "address": "fa:16:3e:75:bf:5d", "network": {"id": "061595cf-a510-4019-9445-60a0fa5b2338", "bridge": "br-int", "label": "tempest-device-tagging-net2-827609296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9571bef-59", "ovs_interfaceid": "a9571bef-59d5-4a2d-9803-69bf1e5335d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:bf:5d,bridge_name='br-int',has_traffic_filtering=True,id=a9571bef-59d5-4a2d-9803-69bf1e5335d1,network=Network(061595cf-a510-4019-9445-60a0fa5b2338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9571bef-59') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.objects.instance [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f46a6a8-a043-455a-98f8-dae359594f56 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:20:24 user nova-compute[73497]:   <uuid>2f46a6a8-a043-455a-98f8-dae359594f56</uuid>
Aug 26 23:20:24 user nova-compute[73497]:   <name>instance-00000015</name>
Aug 26 23:20:24 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:20:24 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:20:24 user nova-compute[73497]:   <metadata>
Aug 26 23:20:24 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:20:24 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:20:24 user nova-compute[73497]:       <nova:name>tempest-device-tagging-server-1775784956</nova:name>
Aug 26 23:20:24 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:20:17</nova:creationTime>
Aug 26 23:20:24 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:20:24 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:20:24 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:20:24 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:20:24 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:20:24 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:20:24 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:20:24 user nova-compute[73497]:       <nova:owner>
Aug 26 23:20:24 user nova-compute[73497]:         <nova:user uuid="db2fc512067944a7aa32ec31c9db0252">tempest-TaggedBootDevicesTest-802076125-project-member</nova:user>
Aug 26 23:20:24 user nova-compute[73497]:         <nova:project uuid="70d34ef8af644207b59d77a2d42c5f21">tempest-TaggedBootDevicesTest-802076125</nova:project>
Aug 26 23:20:24 user nova-compute[73497]:       </nova:owner>
Aug 26 23:20:24 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:20:24 user nova-compute[73497]:       <nova:ports>
Aug 26 23:20:24 user nova-compute[73497]:         <nova:port uuid="dbc2a5c3-3411-4be9-aa3b-a902180c81c2">
Aug 26 23:20:24 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 23:20:24 user nova-compute[73497]:         </nova:port>
Aug 26 23:20:24 user nova-compute[73497]:         <nova:port uuid="5dbd55d2-5e99-474c-a1f5-8c87c783aa07">
Aug 26 23:20:24 user nova-compute[73497]:           <nova:ip type="fixed" address="10.1.1.17" ipVersion="4"/>
Aug 26 23:20:24 user nova-compute[73497]:         </nova:port>
Aug 26 23:20:24 user nova-compute[73497]:         <nova:port uuid="66a415ff-2dea-4458-bdba-35ac845cd7d6">
Aug 26 23:20:24 user nova-compute[73497]:           <nova:ip type="fixed" address="10.1.1.245" ipVersion="4"/>
Aug 26 23:20:24 user nova-compute[73497]:         </nova:port>
Aug 26 23:20:24 user nova-compute[73497]:         <nova:port uuid="0e19373c-aa09-49fa-a349-1a7caafa8b61">
Aug 26 23:20:24 user nova-compute[73497]:           <nova:ip type="fixed" address="10.1.1.251" ipVersion="4"/>
Aug 26 23:20:24 user nova-compute[73497]:         </nova:port>
Aug 26 23:20:24 user nova-compute[73497]:         <nova:port uuid="fb8cf209-6174-4bcd-9beb-d2f21ef40e5e">
Aug 26 23:20:24 user nova-compute[73497]:           <nova:ip type="fixed" address="10.1.1.102" ipVersion="4"/>
Aug 26 23:20:24 user nova-compute[73497]:         </nova:port>
Aug 26 23:20:24 user nova-compute[73497]:         <nova:port uuid="b2bc5017-c7ab-43ff-b092-f49336426174">
Aug 26 23:20:24 user nova-compute[73497]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 26 23:20:24 user nova-compute[73497]:         </nova:port>
Aug 26 23:20:24 user nova-compute[73497]:         <nova:port uuid="a9571bef-59d5-4a2d-9803-69bf1e5335d1">
Aug 26 23:20:24 user nova-compute[73497]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 26 23:20:24 user nova-compute[73497]:         </nova:port>
Aug 26 23:20:24 user nova-compute[73497]:       </nova:ports>
Aug 26 23:20:24 user nova-compute[73497]:     </nova:instance>
Aug 26 23:20:24 user nova-compute[73497]:   </metadata>
Aug 26 23:20:24 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:20:24 user nova-compute[73497]:     <system>
Aug 26 23:20:24 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:20:24 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:20:24 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:20:24 user nova-compute[73497]:       <entry name="serial">2f46a6a8-a043-455a-98f8-dae359594f56</entry>
Aug 26 23:20:24 user nova-compute[73497]:       <entry name="uuid">2f46a6a8-a043-455a-98f8-dae359594f56</entry>
Aug 26 23:20:24 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:20:24 user nova-compute[73497]:     </system>
Aug 26 23:20:24 user nova-compute[73497]:   </sysinfo>
Aug 26 23:20:24 user nova-compute[73497]:   <os>
Aug 26 23:20:24 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:20:24 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:20:24 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:20:24 user nova-compute[73497]:   </os>
Aug 26 23:20:24 user nova-compute[73497]:   <features>
Aug 26 23:20:24 user nova-compute[73497]:     <acpi/>
Aug 26 23:20:24 user nova-compute[73497]:     <apic/>
Aug 26 23:20:24 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:20:24 user nova-compute[73497]:   </features>
Aug 26 23:20:24 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:20:24 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:20:24 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:20:24 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:20:24 user nova-compute[73497]:   </clock>
Aug 26 23:20:24 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:20:24 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:20:24 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:20:24 user nova-compute[73497]:   </cpu>
Aug 26 23:20:24 user nova-compute[73497]:   <devices>
Aug 26 23:20:24 user nova-compute[73497]:     <disk type="file" device="cdrom">
Aug 26 23:20:24 user nova-compute[73497]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 23:20:24 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/2f46a6a8-a043-455a-98f8-dae359594f56/disk.config"/>
Aug 26 23:20:24 user nova-compute[73497]:       <target dev="hda" bus="ide"/>
Aug 26 23:20:24 user nova-compute[73497]:     </disk>
Aug 26 23:20:24 user nova-compute[73497]:     <disk type="block" device="disk">
Aug 26 23:20:24 user nova-compute[73497]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:20:24 user nova-compute[73497]:       <source dev="/dev/sdd"/>
Aug 26 23:20:24 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:20:24 user nova-compute[73497]:       <serial>4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f</serial>
Aug 26 23:20:24 user nova-compute[73497]:     </disk>
Aug 26 23:20:24 user nova-compute[73497]:     <disk type="block" device="disk">
Aug 26 23:20:24 user nova-compute[73497]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:20:24 user nova-compute[73497]:       <source dev="/dev/sdf"/>
Aug 26 23:20:24 user nova-compute[73497]:       <target dev="vdb" bus="virtio"/>
Aug 26 23:20:24 user nova-compute[73497]:       <serial>fae83862-cb43-4437-9680-f544f97fe6ee</serial>
Aug 26 23:20:24 user nova-compute[73497]:     </disk>
Aug 26 23:20:24 user nova-compute[73497]:     <disk type="block" device="disk">
Aug 26 23:20:24 user nova-compute[73497]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:20:24 user nova-compute[73497]:       <source dev="/dev/sdh"/>
Aug 26 23:20:24 user nova-compute[73497]:       <target dev="vdc" bus="virtio"/>
Aug 26 23:20:24 user nova-compute[73497]:       <serial>16a71fdf-6491-4e87-ac8f-81fff9209a5a</serial>
Aug 26 23:20:24 user nova-compute[73497]:     </disk>
Aug 26 23:20:24 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:20:24 user nova-compute[73497]:       <mac address="fa:16:3e:7e:8e:8a"/>
Aug 26 23:20:24 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:20:24 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:20:24 user nova-compute[73497]:       <target dev="tapdbc2a5c3-34"/>
Aug 26 23:20:24 user nova-compute[73497]:     </interface>
Aug 26 23:20:24 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:20:24 user nova-compute[73497]:       <mac address="fa:16:3e:07:92:18"/>
Aug 26 23:20:24 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:20:24 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:20:24 user nova-compute[73497]:       <target dev="tap5dbd55d2-5e"/>
Aug 26 23:20:24 user nova-compute[73497]:     </interface>
Aug 26 23:20:24 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:20:24 user nova-compute[73497]:       <mac address="fa:16:3e:7c:f6:90"/>
Aug 26 23:20:24 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:20:24 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:20:24 user nova-compute[73497]:       <target dev="tap66a415ff-2d"/>
Aug 26 23:20:24 user nova-compute[73497]:     </interface>
Aug 26 23:20:24 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:20:24 user nova-compute[73497]:       <mac address="fa:16:3e:46:67:4c"/>
Aug 26 23:20:24 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:20:24 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:20:24 user nova-compute[73497]:       <target dev="tap0e19373c-aa"/>
Aug 26 23:20:24 user nova-compute[73497]:     </interface>
Aug 26 23:20:24 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:20:24 user nova-compute[73497]:       <mac address="fa:16:3e:86:4c:dd"/>
Aug 26 23:20:24 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:20:24 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:20:24 user nova-compute[73497]:       <target dev="tapfb8cf209-61"/>
Aug 26 23:20:24 user nova-compute[73497]:     </interface>
Aug 26 23:20:24 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:20:24 user nova-compute[73497]:       <mac address="fa:16:3e:15:05:18"/>
Aug 26 23:20:24 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:20:24 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:20:24 user nova-compute[73497]:       <target dev="tapb2bc5017-c7"/>
Aug 26 23:20:24 user nova-compute[73497]:     </interface>
Aug 26 23:20:24 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:20:24 user nova-compute[73497]:       <mac address="fa:16:3e:75:bf:5d"/>
Aug 26 23:20:24 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:20:24 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:20:24 user nova-compute[73497]:       <target dev="tapa9571bef-59"/>
Aug 26 23:20:24 user nova-compute[73497]:     </interface>
Aug 26 23:20:24 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:20:24 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/2f46a6a8-a043-455a-98f8-dae359594f56/console.log" append="off"/>
Aug 26 23:20:24 user nova-compute[73497]:     </serial>
Aug 26 23:20:24 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:20:24 user nova-compute[73497]:     <video>
Aug 26 23:20:24 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:20:24 user nova-compute[73497]:     </video>
Aug 26 23:20:24 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:20:24 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:20:24 user nova-compute[73497]:     </rng>
Aug 26 23:20:24 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:20:24 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:20:24 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:20:24 user nova-compute[73497]:     </memballoon>
Aug 26 23:20:24 user nova-compute[73497]:   </devices>
Aug 26 23:20:24 user nova-compute[73497]: </domain>
Aug 26 23:20:24 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1775784956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1775784956',id=21,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9PcDWaqvZjQMAm2aFt+GxNtEgti/NEeHD88SVIby22zzwNaIAqngw48wB+G3YfNVc+s3B1+0Mu4lcCj5+9KN6J/GDGAN+VKjqnDSozbka/CKrR8HOKCotXzucPkwM8Jw==',key_name='tempest-keypair-312567637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70d34ef8af644207b59d77a2d42c5f21',ramdisk_id='',reservation_id='r-xfpadl0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-802076125',owner_user_name='tempest-TaggedBootDevicesTest-802076125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:19:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db2fc512067944a7aa32ec31c9db0252',uuid=2f46a6a8-a043-455a-98f8-dae359594f56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbc2a5c3-3411-4be9-aa3b-a902180c81c2", "address": "fa:16:3e:7e:8e:8a", "network": {"id": "43d07640-08ec-4f81-9b86-a9b192b9aaf3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-376476172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbc2a5c3-34", "ovs_interfaceid": "dbc2a5c3-3411-4be9-aa3b-a902180c81c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converting VIF {"id": "dbc2a5c3-3411-4be9-aa3b-a902180c81c2", "address": "fa:16:3e:7e:8e:8a", "network": {"id": "43d07640-08ec-4f81-9b86-a9b192b9aaf3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-376476172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbc2a5c3-34", "ovs_interfaceid": "dbc2a5c3-3411-4be9-aa3b-a902180c81c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:8e:8a,bridge_name='br-int',has_traffic_filtering=True,id=dbc2a5c3-3411-4be9-aa3b-a902180c81c2,network=Network(43d07640-08ec-4f81-9b86-a9b192b9aaf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbc2a5c3-34') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG os_vif [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:8e:8a,bridge_name='br-int',has_traffic_filtering=True,id=dbc2a5c3-3411-4be9-aa3b-a902180c81c2,network=Network(43d07640-08ec-4f81-9b86-a9b192b9aaf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbc2a5c3-34') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbc2a5c3-34, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdbc2a5c3-34, col_values=(('external_ids', {'iface-id': 'dbc2a5c3-3411-4be9-aa3b-a902180c81c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:8e:8a', 'vm-uuid': '2f46a6a8-a043-455a-98f8-dae359594f56'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:24 user nova-compute[73497]: INFO os_vif [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:8e:8a,bridge_name='br-int',has_traffic_filtering=True,id=dbc2a5c3-3411-4be9-aa3b-a902180c81c2,network=Network(43d07640-08ec-4f81-9b86-a9b192b9aaf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbc2a5c3-34')
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1775784956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1775784956',id=21,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9PcDWaqvZjQMAm2aFt+GxNtEgti/NEeHD88SVIby22zzwNaIAqngw48wB+G3YfNVc+s3B1+0Mu4lcCj5+9KN6J/GDGAN+VKjqnDSozbka/CKrR8HOKCotXzucPkwM8Jw==',key_name='tempest-keypair-312567637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70d34ef8af644207b59d77a2d42c5f21',ramdisk_id='',reservation_id='r-xfpadl0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-802076125',owner_user_name='tempest-TaggedBootDevicesTest-802076125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:19:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db2fc512067944a7aa32ec31c9db0252',uuid=2f46a6a8-a043-455a-98f8-dae359594f56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5dbd55d2-5e99-474c-a1f5-8c87c783aa07", "address": "fa:16:3e:07:92:18", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbd55d2-5e", "ovs_interfaceid": "5dbd55d2-5e99-474c-a1f5-8c87c783aa07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converting VIF {"id": "5dbd55d2-5e99-474c-a1f5-8c87c783aa07", "address": "fa:16:3e:07:92:18", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbd55d2-5e", "ovs_interfaceid": "5dbd55d2-5e99-474c-a1f5-8c87c783aa07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:92:18,bridge_name='br-int',has_traffic_filtering=True,id=5dbd55d2-5e99-474c-a1f5-8c87c783aa07,network=Network(cf1f6776-4e09-43f5-8ab1-3a654646b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5dbd55d2-5e') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG os_vif [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:92:18,bridge_name='br-int',has_traffic_filtering=True,id=5dbd55d2-5e99-474c-a1f5-8c87c783aa07,network=Network(cf1f6776-4e09-43f5-8ab1-3a654646b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5dbd55d2-5e') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5dbd55d2-5e, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5dbd55d2-5e, col_values=(('external_ids', {'iface-id': '5dbd55d2-5e99-474c-a1f5-8c87c783aa07', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:92:18', 'vm-uuid': '2f46a6a8-a043-455a-98f8-dae359594f56'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:24 user nova-compute[73497]: INFO os_vif [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:92:18,bridge_name='br-int',has_traffic_filtering=True,id=5dbd55d2-5e99-474c-a1f5-8c87c783aa07,network=Network(cf1f6776-4e09-43f5-8ab1-3a654646b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5dbd55d2-5e')
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1775784956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1775784956',id=21,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9PcDWaqvZjQMAm2aFt+GxNtEgti/NEeHD88SVIby22zzwNaIAqngw48wB+G3YfNVc+s3B1+0Mu4lcCj5+9KN6J/GDGAN+VKjqnDSozbka/CKrR8HOKCotXzucPkwM8Jw==',key_name='tempest-keypair-312567637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70d34ef8af644207b59d77a2d42c5f21',ramdisk_id='',reservation_id='r-xfpadl0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-802076125',owner_user_name='tempest-TaggedBootDevicesTest-802076125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:19:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db2fc512067944a7aa32ec31c9db0252',uuid=2f46a6a8-a043-455a-98f8-dae359594f56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66a415ff-2dea-4458-bdba-35ac845cd7d6", "address": "fa:16:3e:7c:f6:90", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a415ff-2d", "ovs_interfaceid": "66a415ff-2dea-4458-bdba-35ac845cd7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converting VIF {"id": "66a415ff-2dea-4458-bdba-35ac845cd7d6", "address": "fa:16:3e:7c:f6:90", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a415ff-2d", "ovs_interfaceid": "66a415ff-2dea-4458-bdba-35ac845cd7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:f6:90,bridge_name='br-int',has_traffic_filtering=True,id=66a415ff-2dea-4458-bdba-35ac845cd7d6,network=Network(cf1f6776-4e09-43f5-8ab1-3a654646b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap66a415ff-2d') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG os_vif [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:f6:90,bridge_name='br-int',has_traffic_filtering=True,id=66a415ff-2dea-4458-bdba-35ac845cd7d6,network=Network(cf1f6776-4e09-43f5-8ab1-3a654646b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap66a415ff-2d') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66a415ff-2d, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap66a415ff-2d, col_values=(('external_ids', {'iface-id': '66a415ff-2dea-4458-bdba-35ac845cd7d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:f6:90', 'vm-uuid': '2f46a6a8-a043-455a-98f8-dae359594f56'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:24 user nova-compute[73497]: INFO os_vif [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:f6:90,bridge_name='br-int',has_traffic_filtering=True,id=66a415ff-2dea-4458-bdba-35ac845cd7d6,network=Network(cf1f6776-4e09-43f5-8ab1-3a654646b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap66a415ff-2d')
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1775784956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1775784956',id=21,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9PcDWaqvZjQMAm2aFt+GxNtEgti/NEeHD88SVIby22zzwNaIAqngw48wB+G3YfNVc+s3B1+0Mu4lcCj5+9KN6J/GDGAN+VKjqnDSozbka/CKrR8HOKCotXzucPkwM8Jw==',key_name='tempest-keypair-312567637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70d34ef8af644207b59d77a2d42c5f21',ramdisk_id='',reservation_id='r-xfpadl0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-802076125',owner_user_name='tempest-TaggedBootDevicesTest-802076125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:19:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db2fc512067944a7aa32ec31c9db0252',uuid=2f46a6a8-a043-455a-98f8-dae359594f56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e19373c-aa09-49fa-a349-1a7caafa8b61", "address": "fa:16:3e:46:67:4c", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e19373c-aa", "ovs_interfaceid": "0e19373c-aa09-49fa-a349-1a7caafa8b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converting VIF {"id": "0e19373c-aa09-49fa-a349-1a7caafa8b61", "address": "fa:16:3e:46:67:4c", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e19373c-aa", "ovs_interfaceid": "0e19373c-aa09-49fa-a349-1a7caafa8b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:67:4c,bridge_name='br-int',has_traffic_filtering=True,id=0e19373c-aa09-49fa-a349-1a7caafa8b61,network=Network(cf1f6776-4e09-43f5-8ab1-3a654646b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e19373c-aa') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG os_vif [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:67:4c,bridge_name='br-int',has_traffic_filtering=True,id=0e19373c-aa09-49fa-a349-1a7caafa8b61,network=Network(cf1f6776-4e09-43f5-8ab1-3a654646b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e19373c-aa') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e19373c-aa, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0e19373c-aa, col_values=(('external_ids', {'iface-id': '0e19373c-aa09-49fa-a349-1a7caafa8b61', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:67:4c', 'vm-uuid': '2f46a6a8-a043-455a-98f8-dae359594f56'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:24 user nova-compute[73497]: INFO os_vif [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:67:4c,bridge_name='br-int',has_traffic_filtering=True,id=0e19373c-aa09-49fa-a349-1a7caafa8b61,network=Network(cf1f6776-4e09-43f5-8ab1-3a654646b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e19373c-aa')
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1775784956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1775784956',id=21,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9PcDWaqvZjQMAm2aFt+GxNtEgti/NEeHD88SVIby22zzwNaIAqngw48wB+G3YfNVc+s3B1+0Mu4lcCj5+9KN6J/GDGAN+VKjqnDSozbka/CKrR8HOKCotXzucPkwM8Jw==',key_name='tempest-keypair-312567637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70d34ef8af644207b59d77a2d42c5f21',ramdisk_id='',reservation_id='r-xfpadl0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-802076125',owner_user_name='tempest-TaggedBootDevicesTest-802076125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:19:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db2fc512067944a7aa32ec31c9db0252',uuid=2f46a6a8-a043-455a-98f8-dae359594f56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb8cf209-6174-4bcd-9beb-d2f21ef40e5e", "address": "fa:16:3e:86:4c:dd", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8cf209-61", "ovs_interfaceid": "fb8cf209-6174-4bcd-9beb-d2f21ef40e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converting VIF {"id": "fb8cf209-6174-4bcd-9beb-d2f21ef40e5e", "address": "fa:16:3e:86:4c:dd", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8cf209-61", "ovs_interfaceid": "fb8cf209-6174-4bcd-9beb-d2f21ef40e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:4c:dd,bridge_name='br-int',has_traffic_filtering=True,id=fb8cf209-6174-4bcd-9beb-d2f21ef40e5e,network=Network(cf1f6776-4e09-43f5-8ab1-3a654646b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb8cf209-61') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG os_vif [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:4c:dd,bridge_name='br-int',has_traffic_filtering=True,id=fb8cf209-6174-4bcd-9beb-d2f21ef40e5e,network=Network(cf1f6776-4e09-43f5-8ab1-3a654646b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb8cf209-61') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb8cf209-61, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfb8cf209-61, col_values=(('external_ids', {'iface-id': 'fb8cf209-6174-4bcd-9beb-d2f21ef40e5e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:4c:dd', 'vm-uuid': '2f46a6a8-a043-455a-98f8-dae359594f56'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:24 user nova-compute[73497]: INFO os_vif [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:4c:dd,bridge_name='br-int',has_traffic_filtering=True,id=fb8cf209-6174-4bcd-9beb-d2f21ef40e5e,network=Network(cf1f6776-4e09-43f5-8ab1-3a654646b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb8cf209-61')
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1775784956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1775784956',id=21,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9PcDWaqvZjQMAm2aFt+GxNtEgti/NEeHD88SVIby22zzwNaIAqngw48wB+G3YfNVc+s3B1+0Mu4lcCj5+9KN6J/GDGAN+VKjqnDSozbka/CKrR8HOKCotXzucPkwM8Jw==',key_name='tempest-keypair-312567637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70d34ef8af644207b59d77a2d42c5f21',ramdisk_id='',reservation_id='r-xfpadl0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-802076125',owner_user_name='tempest-TaggedBootDevicesTest-802076125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:19:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db2fc512067944a7aa32ec31c9db0252',uuid=2f46a6a8-a043-455a-98f8-dae359594f56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2bc5017-c7ab-43ff-b092-f49336426174", "address": "fa:16:3e:15:05:18", "network": {"id": "061595cf-a510-4019-9445-60a0fa5b2338", "bridge": "br-int", "label": "tempest-device-tagging-net2-827609296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bc5017-c7", "ovs_interfaceid": "b2bc5017-c7ab-43ff-b092-f49336426174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converting VIF {"id": "b2bc5017-c7ab-43ff-b092-f49336426174", "address": "fa:16:3e:15:05:18", "network": {"id": "061595cf-a510-4019-9445-60a0fa5b2338", "bridge": "br-int", "label": "tempest-device-tagging-net2-827609296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bc5017-c7", "ovs_interfaceid": "b2bc5017-c7ab-43ff-b092-f49336426174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:05:18,bridge_name='br-int',has_traffic_filtering=True,id=b2bc5017-c7ab-43ff-b092-f49336426174,network=Network(061595cf-a510-4019-9445-60a0fa5b2338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2bc5017-c7') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG os_vif [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:05:18,bridge_name='br-int',has_traffic_filtering=True,id=b2bc5017-c7ab-43ff-b092-f49336426174,network=Network(061595cf-a510-4019-9445-60a0fa5b2338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2bc5017-c7') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2bc5017-c7, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb2bc5017-c7, col_values=(('external_ids', {'iface-id': 'b2bc5017-c7ab-43ff-b092-f49336426174', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:05:18', 'vm-uuid': '2f46a6a8-a043-455a-98f8-dae359594f56'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:24 user nova-compute[73497]: INFO os_vif [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:05:18,bridge_name='br-int',has_traffic_filtering=True,id=b2bc5017-c7ab-43ff-b092-f49336426174,network=Network(061595cf-a510-4019-9445-60a0fa5b2338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2bc5017-c7')
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1775784956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1775784956',id=21,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9PcDWaqvZjQMAm2aFt+GxNtEgti/NEeHD88SVIby22zzwNaIAqngw48wB+G3YfNVc+s3B1+0Mu4lcCj5+9KN6J/GDGAN+VKjqnDSozbka/CKrR8HOKCotXzucPkwM8Jw==',key_name='tempest-keypair-312567637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70d34ef8af644207b59d77a2d42c5f21',ramdisk_id='',reservation_id='r-xfpadl0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-802076125',owner_user_name='tempest-TaggedBootDevicesTest-802076125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:19:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db2fc512067944a7aa32ec31c9db0252',uuid=2f46a6a8-a043-455a-98f8-dae359594f56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9571bef-59d5-4a2d-9803-69bf1e5335d1", "address": "fa:16:3e:75:bf:5d", "network": {"id": "061595cf-a510-4019-9445-60a0fa5b2338", "bridge": "br-int", "label": "tempest-device-tagging-net2-827609296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9571bef-59", "ovs_interfaceid": "a9571bef-59d5-4a2d-9803-69bf1e5335d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converting VIF {"id": "a9571bef-59d5-4a2d-9803-69bf1e5335d1", "address": "fa:16:3e:75:bf:5d", "network": {"id": "061595cf-a510-4019-9445-60a0fa5b2338", "bridge": "br-int", "label": "tempest-device-tagging-net2-827609296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9571bef-59", "ovs_interfaceid": "a9571bef-59d5-4a2d-9803-69bf1e5335d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:bf:5d,bridge_name='br-int',has_traffic_filtering=True,id=a9571bef-59d5-4a2d-9803-69bf1e5335d1,network=Network(061595cf-a510-4019-9445-60a0fa5b2338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9571bef-59') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG os_vif [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:bf:5d,bridge_name='br-int',has_traffic_filtering=True,id=a9571bef-59d5-4a2d-9803-69bf1e5335d1,network=Network(061595cf-a510-4019-9445-60a0fa5b2338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9571bef-59') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9571bef-59, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa9571bef-59, col_values=(('external_ids', {'iface-id': 'a9571bef-59d5-4a2d-9803-69bf1e5335d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:bf:5d', 'vm-uuid': '2f46a6a8-a043-455a-98f8-dae359594f56'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.network.neutron [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Updating instance_info_cache with network_info: [{"id": "61639246-9d84-4629-9666-154897feaeae", "address": "fa:16:3e:56:41:f9", "network": {"id": "108c66fb-49a3-4c69-a3ac-93d9643a1d3e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025099504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e765258a50d46dea25bfd9c72970eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61639246-9d", "ovs_interfaceid": "61639246-9d84-4629-9666-154897feaeae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:24 user nova-compute[73497]: INFO os_vif [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:bf:5d,bridge_name='br-int',has_traffic_filtering=True,id=a9571bef-59d5-4a2d-9803-69bf1e5335d1,network=Network(061595cf-a510-4019-9445-60a0fa5b2338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9571bef-59')
Aug 26 23:20:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Releasing lock "refresh_cache-ee6283d5-40de-432d-997c-0be52ff673ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] No BDM found with device name hda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] No VIF found with MAC fa:16:3e:7e:8e:8a, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:20:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] No VIF found with MAC fa:16:3e:86:4c:dd, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:20:24 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Using config drive
Aug 26 23:20:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Starting migrate_disk_and_power_off {{(pid=73497) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 26 23:20:25 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Creating config drive at /opt/stack/data/nova/instances/2f46a6a8-a043-455a-98f8-dae359594f56/disk.config
Aug 26 23:20:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2f46a6a8-a043-455a-98f8-dae359594f56/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxp4cuv95 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2f46a6a8-a043-455a-98f8-dae359594f56/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxp4cuv95" returned: 0 in 0.066s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:25 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:25 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:25 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-95aa5171-a612-4635-b58a-e3f030b08786 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Acquiring lock "4c68f140-4235-4dcb-b99d-1347bc949d15" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-95aa5171-a612-4635-b58a-e3f030b08786 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "4c68f140-4235-4dcb-b99d-1347bc949d15" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:25 user nova-compute[73497]: INFO nova.compute.manager [None req-95aa5171-a612-4635-b58a-e3f030b08786 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Detaching volume 4e31d512-8b34-4754-ae73-aba20997de45
Aug 26 23:20:25 user nova-compute[73497]: INFO nova.virt.block_device [None req-95aa5171-a612-4635-b58a-e3f030b08786 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Attempting to driver detach volume 4e31d512-8b34-4754-ae73-aba20997de45 from mountpoint /dev/vdb
Aug 26 23:20:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-95aa5171-a612-4635-b58a-e3f030b08786 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Attempting to detach device vdb from instance 4c68f140-4235-4dcb-b99d-1347bc949d15 from the persistent domain config. {{(pid=73497) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 23:20:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-95aa5171-a612-4635-b58a-e3f030b08786 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:20:25 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:20:25 user nova-compute[73497]:   <source dev="/dev/sdg"/>
Aug 26 23:20:25 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:20:25 user nova-compute[73497]:   <serial>4e31d512-8b34-4754-ae73-aba20997de45</serial>
Aug 26 23:20:25 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:20:25 user nova-compute[73497]: </disk>
Aug 26 23:20:25 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:20:25 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:25 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-95aa5171-a612-4635-b58a-e3f030b08786 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Successfully detached device vdb from instance 4c68f140-4235-4dcb-b99d-1347bc949d15 from the persistent domain config.
Aug 26 23:20:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-95aa5171-a612-4635-b58a-e3f030b08786 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4c68f140-4235-4dcb-b99d-1347bc949d15 from the live domain config. {{(pid=73497) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 23:20:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-95aa5171-a612-4635-b58a-e3f030b08786 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:20:25 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:20:25 user nova-compute[73497]:   <source dev="/dev/sdg"/>
Aug 26 23:20:25 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:20:25 user nova-compute[73497]:   <serial>4e31d512-8b34-4754-ae73-aba20997de45</serial>
Aug 26 23:20:25 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:20:25 user nova-compute[73497]: </disk>
Aug 26 23:20:25 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:20:25 user nova-compute[73497]: DEBUG nova.compute.manager [req-43e061bb-613f-438d-a3ab-1272cb908482 req-54578782-77bd-4919-b467-30d53e0bc349 service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Received event network-vif-unplugged-61639246-9d84-4629-9666-154897feaeae {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:20:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-43e061bb-613f-438d-a3ab-1272cb908482 req-54578782-77bd-4919-b467-30d53e0bc349 service nova] Acquiring lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-43e061bb-613f-438d-a3ab-1272cb908482 req-54578782-77bd-4919-b467-30d53e0bc349 service nova] Lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-43e061bb-613f-438d-a3ab-1272cb908482 req-54578782-77bd-4919-b467-30d53e0bc349 service nova] Lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:25 user nova-compute[73497]: DEBUG nova.compute.manager [req-43e061bb-613f-438d-a3ab-1272cb908482 req-54578782-77bd-4919-b467-30d53e0bc349 service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] No waiting events found dispatching network-vif-unplugged-61639246-9d84-4629-9666-154897feaeae {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:20:25 user nova-compute[73497]: WARNING nova.compute.manager [req-43e061bb-613f-438d-a3ab-1272cb908482 req-54578782-77bd-4919-b467-30d53e0bc349 service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Received unexpected event network-vif-unplugged-61639246-9d84-4629-9666-154897feaeae for instance with vm_state active and task_state resize_migrating.
Aug 26 23:20:25 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:25 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Received event <DeviceRemovedEvent: 1693092026.3054068, 4c68f140-4235-4dcb-b99d-1347bc949d15 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73497) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-95aa5171-a612-4635-b58a-e3f030b08786 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4c68f140-4235-4dcb-b99d-1347bc949d15 {{(pid=73497) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 23:20:26 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-95aa5171-a612-4635-b58a-e3f030b08786 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Successfully detached device vdb from instance 4c68f140-4235-4dcb-b99d-1347bc949d15 from the live domain config.
Aug 26 23:20:26 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95aa5171-a612-4635-b58a-e3f030b08786 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-95aa5171-a612-4635-b58a-e3f030b08786 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hieABtEg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:20:26 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-95aa5171-a612-4635-b58a-e3f030b08786 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:20:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-95aa5171-a612-4635-b58a-e3f030b08786 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-95aa5171-a612-4635-b58a-e3f030b08786 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-95aa5171-a612-4635-b58a-e3f030b08786 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:26 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Instance destroyed successfully.
Aug 26 23:20:26 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:16:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-956611518',display_name='tempest-ServerActionsTestOtherB-server-956611518',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-956611518',id=13,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqify97xxdfMwMioKw2wicMrkUmyII/F1wNcYn2coMZNsxaRCqyQGjP8va1kHwD6Z9ddCdHd23iUWPYbjiNJPdJt82WzvrKCaPX0PtGf0585mA5lLDP0NEIbnQp6LuyOw==',key_name='tempest-keypair-800864699',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:16:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1e765258a50d46dea25bfd9c72970eb9',ramdisk_id='',reservation_id='r-owyjaonv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-435374476',owner_user_name='tempest-ServerActionsTestOtherB-435374476-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:20:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd09339d0e1d46d4a268f6ac8651a9f5',uuid=ee6283d5-40de-432d-997c-0be52ff673ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61639246-9d84-4629-9666-154897feaeae", "address": "fa:16:3e:56:41:f9", "network": {"id": "108c66fb-49a3-4c69-a3ac-93d9643a1d3e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025099504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2025099504-network", "vif_mac": "fa:16:3e:56:41:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e765258a50d46dea25bfd9c72970eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61639246-9d", "ovs_interfaceid": "61639246-9d84-4629-9666-154897feaeae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Converting VIF {"id": "61639246-9d84-4629-9666-154897feaeae", "address": "fa:16:3e:56:41:f9", "network": {"id": "108c66fb-49a3-4c69-a3ac-93d9643a1d3e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025099504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2025099504-network", "vif_mac": "fa:16:3e:56:41:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e765258a50d46dea25bfd9c72970eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61639246-9d", "ovs_interfaceid": "61639246-9d84-4629-9666-154897feaeae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=61639246-9d84-4629-9666-154897feaeae,network=Network(108c66fb-49a3-4c69-a3ac-93d9643a1d3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61639246-9d') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG os_vif [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=61639246-9d84-4629-9666-154897feaeae,network=Network(108c66fb-49a3-4c69-a3ac-93d9643a1d3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61639246-9d') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61639246-9d, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a35e92-8303-4b6b-9830-c7ca00e4c2ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccd5e9e-8a81-4259-a1e3-5eb61bd22ab1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-95aa5171-a612-4635-b58a-e3f030b08786 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:20:26 user nova-compute[73497]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:20:26 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:20:26 user nova-compute[73497]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:20:26 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:20:26 user nova-compute[73497]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45 (non-flash)
Aug 26 23:20:26 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:20:26 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-95aa5171-a612-4635-b58a-e3f030b08786 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:20:26 user nova-compute[73497]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:20:26 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:20:26 user nova-compute[73497]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:20:26 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:20:26 user nova-compute[73497]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45 (non-flash)
Aug 26 23:20:26 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:20:26 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-95aa5171-a612-4635-b58a-e3f030b08786 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282c53c670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45'): ({'sdg'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-95aa5171-a612-4635-b58a-e3f030b08786 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Removing single pathed devices sdg {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2baff1-296c-4cca-b0d9-f6e514ff8e67]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:26 user nova-compute[73497]: INFO os_vif [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=61639246-9d84-4629-9666-154897feaeae,network=Network(108c66fb-49a3-4c69-a3ac-93d9643a1d3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61639246-9d')
Aug 26 23:20:26 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbmOUkyq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:20:26 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:20:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[138f0e5c-5a17-41f5-9073-f88b04fb474a]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-95aa5171-a612-4635-b58a-e3f030b08786 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Flushing IO for device /dev/sdg {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[576c7eb8-f856-4ef5-86db-e31607829fe8]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-95aa5171-a612-4635-b58a-e3f030b08786 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.031s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4df7cf-0be1-4c84-bea1-2c543a4e4e8b]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-95aa5171-a612-4635-b58a-e3f030b08786 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-95aa5171-a612-4635-b58a-e3f030b08786 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] SCSI volumes sdg have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-95aa5171-a612-4635-b58a-e3f030b08786 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[615b3dce-c91c-4567-97d4-a67d2d1faf16]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-95aa5171-a612-4635-b58a-e3f030b08786 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[795eb309-475e-4416-b30e-ccc62e3ae657]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-95aa5171-a612-4635-b58a-e3f030b08786 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45, portal: 172.16.0.220,3260]
Aug 26 23:20:26 user nova-compute[73497]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45, portal: 172.16.0.220,3260] successful.
Aug 26 23:20:26 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e31d512-8b34-4754-ae73-aba20997de45 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89fc171-aa58-4523-9c6c-5fb8fdaf70e6]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-95aa5171-a612-4635-b58a-e3f030b08786 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-95aa5171-a612-4635-b58a-e3f030b08786 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-95aa5171-a612-4635-b58a-e3f030b08786 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] <== disconnect_volume: return (299ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95aa5171-a612-4635-b58a-e3f030b08786 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.191s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[327ffcdf-facf-448e-a1d1-ce4c546dac4c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b72ac7a-edb2-489e-a740-688d23a52ff3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:20:26 user nova-compute[73497]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:20:26 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:20:26 user nova-compute[73497]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:20:26 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:20:26 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:20:26 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:20:26 user nova-compute[73497]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:20:26 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:20:26 user nova-compute[73497]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:20:26 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:20:26 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:20:26 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281c5f4c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c'): ({'sde'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Removing single pathed devices sde {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73a72ac-227b-4102-994f-0a71a38de275]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfca793-b21f-40fc-bfd5-34b500a39041]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Flushing IO for device /dev/sde {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fb55ad-598b-475c-b243-17426098ac17]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f97a446-89a8-45fd-b945-28805592595f]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] SCSI volumes sde have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d13732-5490-4e68-ada2-20cd8711acc8]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[838e191e-5cf2-4d73-86c4-f12b94e7cb5b]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c, portal: 172.16.0.220,3260]
Aug 26 23:20:26 user nova-compute[73497]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c, portal: 172.16.0.220,3260] successful.
Aug 26 23:20:26 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19c6009-3b85-4ef4-836c-ee3c59c889b7]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] <== disconnect_volume: return (512ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:20:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:27 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:20:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca_resize/disk /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:27 user nova-compute[73497]: DEBUG nova.objects.instance [None req-95aa5171-a612-4635-b58a-e3f030b08786 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lazy-loading 'flavor' on Instance uuid 4c68f140-4235-4dcb-b99d-1347bc949d15 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:20:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-95aa5171-a612-4635-b58a-e3f030b08786 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "4c68f140-4235-4dcb-b99d-1347bc949d15" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.193s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:27 user nova-compute[73497]: DEBUG nova.compute.manager [req-9a453c30-df29-4f91-ab02-bbb8c05e94a7 req-288cab55-3169-47c3-acd0-a7077031d22c service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Received event network-vif-plugged-61639246-9d84-4629-9666-154897feaeae {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:20:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9a453c30-df29-4f91-ab02-bbb8c05e94a7 req-288cab55-3169-47c3-acd0-a7077031d22c service nova] Acquiring lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9a453c30-df29-4f91-ab02-bbb8c05e94a7 req-288cab55-3169-47c3-acd0-a7077031d22c service nova] Lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9a453c30-df29-4f91-ab02-bbb8c05e94a7 req-288cab55-3169-47c3-acd0-a7077031d22c service nova] Lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:27 user nova-compute[73497]: DEBUG nova.compute.manager [req-9a453c30-df29-4f91-ab02-bbb8c05e94a7 req-288cab55-3169-47c3-acd0-a7077031d22c service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] No waiting events found dispatching network-vif-plugged-61639246-9d84-4629-9666-154897feaeae {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:20:27 user nova-compute[73497]: WARNING nova.compute.manager [req-9a453c30-df29-4f91-ab02-bbb8c05e94a7 req-288cab55-3169-47c3-acd0-a7077031d22c service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Received unexpected event network-vif-plugged-61639246-9d84-4629-9666-154897feaeae for instance with vm_state active and task_state resize_migrating.
Aug 26 23:20:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] CMD "cp -r /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca_resize/disk /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk" returned: 0 in 0.293s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca_resize/disk.info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk.info {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] CMD "cp -r /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca_resize/disk.info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk.info" returned: 0 in 0.038s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:27 user nova-compute[73497]: DEBUG nova.compute.manager [req-3c0522f8-d794-4f00-b39c-3c6def1b77d2 req-5154d88b-3e3e-4915-9776-adce9ea9e2b1 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-plugged-dbc2a5c3-3411-4be9-aa3b-a902180c81c2 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:20:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3c0522f8-d794-4f00-b39c-3c6def1b77d2 req-5154d88b-3e3e-4915-9776-adce9ea9e2b1 service nova] Acquiring lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3c0522f8-d794-4f00-b39c-3c6def1b77d2 req-5154d88b-3e3e-4915-9776-adce9ea9e2b1 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3c0522f8-d794-4f00-b39c-3c6def1b77d2 req-5154d88b-3e3e-4915-9776-adce9ea9e2b1 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:27 user nova-compute[73497]: DEBUG nova.compute.manager [req-3c0522f8-d794-4f00-b39c-3c6def1b77d2 req-5154d88b-3e3e-4915-9776-adce9ea9e2b1 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] No waiting events found dispatching network-vif-plugged-dbc2a5c3-3411-4be9-aa3b-a902180c81c2 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:20:27 user nova-compute[73497]: WARNING nova.compute.manager [req-3c0522f8-d794-4f00-b39c-3c6def1b77d2 req-5154d88b-3e3e-4915-9776-adce9ea9e2b1 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received unexpected event network-vif-plugged-dbc2a5c3-3411-4be9-aa3b-a902180c81c2 for instance with vm_state building and task_state spawning.
Aug 26 23:20:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:28 user nova-compute[73497]: DEBUG nova.compute.manager [req-5fb092fc-c2ad-420e-b3fe-0e9c5e736b52 req-ebef023e-c6cf-4789-857c-5beef93e138d service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-plugged-0e19373c-aa09-49fa-a349-1a7caafa8b61 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:20:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-5fb092fc-c2ad-420e-b3fe-0e9c5e736b52 req-ebef023e-c6cf-4789-857c-5beef93e138d service nova] Acquiring lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-5fb092fc-c2ad-420e-b3fe-0e9c5e736b52 req-ebef023e-c6cf-4789-857c-5beef93e138d service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-5fb092fc-c2ad-420e-b3fe-0e9c5e736b52 req-ebef023e-c6cf-4789-857c-5beef93e138d service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:28 user nova-compute[73497]: DEBUG nova.compute.manager [req-5fb092fc-c2ad-420e-b3fe-0e9c5e736b52 req-ebef023e-c6cf-4789-857c-5beef93e138d service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] No waiting events found dispatching network-vif-plugged-0e19373c-aa09-49fa-a349-1a7caafa8b61 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:20:28 user nova-compute[73497]: WARNING nova.compute.manager [req-5fb092fc-c2ad-420e-b3fe-0e9c5e736b52 req-ebef023e-c6cf-4789-857c-5beef93e138d service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received unexpected event network-vif-plugged-0e19373c-aa09-49fa-a349-1a7caafa8b61 for instance with vm_state building and task_state spawning.
Aug 26 23:20:28 user nova-compute[73497]: DEBUG nova.network.neutron [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Port 61639246-9d84-4629-9666-154897feaeae binding to destination host user is already ACTIVE {{(pid=73497) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Acquiring lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Acquiring lock "refresh_cache-ee6283d5-40de-432d-997c-0be52ff673ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Acquired lock "refresh_cache-ee6283d5-40de-432d-997c-0be52ff673ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG nova.network.neutron [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG nova.compute.manager [req-01d62f69-dbea-4203-9043-ac30c0fd9477 req-bb5e3534-71e1-474f-8edb-50a98b066710 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-plugged-66a415ff-2dea-4458-bdba-35ac845cd7d6 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-01d62f69-dbea-4203-9043-ac30c0fd9477 req-bb5e3534-71e1-474f-8edb-50a98b066710 service nova] Acquiring lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-01d62f69-dbea-4203-9043-ac30c0fd9477 req-bb5e3534-71e1-474f-8edb-50a98b066710 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-01d62f69-dbea-4203-9043-ac30c0fd9477 req-bb5e3534-71e1-474f-8edb-50a98b066710 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG nova.compute.manager [req-01d62f69-dbea-4203-9043-ac30c0fd9477 req-bb5e3534-71e1-474f-8edb-50a98b066710 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] No waiting events found dispatching network-vif-plugged-66a415ff-2dea-4458-bdba-35ac845cd7d6 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:20:29 user nova-compute[73497]: WARNING nova.compute.manager [req-01d62f69-dbea-4203-9043-ac30c0fd9477 req-bb5e3534-71e1-474f-8edb-50a98b066710 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received unexpected event network-vif-plugged-66a415ff-2dea-4458-bdba-35ac845cd7d6 for instance with vm_state building and task_state spawning.
Aug 26 23:20:29 user nova-compute[73497]: DEBUG nova.compute.manager [req-01d62f69-dbea-4203-9043-ac30c0fd9477 req-bb5e3534-71e1-474f-8edb-50a98b066710 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-plugged-66a415ff-2dea-4458-bdba-35ac845cd7d6 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-01d62f69-dbea-4203-9043-ac30c0fd9477 req-bb5e3534-71e1-474f-8edb-50a98b066710 service nova] Acquiring lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-01d62f69-dbea-4203-9043-ac30c0fd9477 req-bb5e3534-71e1-474f-8edb-50a98b066710 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-01d62f69-dbea-4203-9043-ac30c0fd9477 req-bb5e3534-71e1-474f-8edb-50a98b066710 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG nova.compute.manager [req-01d62f69-dbea-4203-9043-ac30c0fd9477 req-bb5e3534-71e1-474f-8edb-50a98b066710 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] No waiting events found dispatching network-vif-plugged-66a415ff-2dea-4458-bdba-35ac845cd7d6 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:20:29 user nova-compute[73497]: WARNING nova.compute.manager [req-01d62f69-dbea-4203-9043-ac30c0fd9477 req-bb5e3534-71e1-474f-8edb-50a98b066710 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received unexpected event network-vif-plugged-66a415ff-2dea-4458-bdba-35ac845cd7d6 for instance with vm_state building and task_state spawning.
Aug 26 23:20:29 user nova-compute[73497]: DEBUG nova.network.neutron [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Updating instance_info_cache with network_info: [{"id": "61639246-9d84-4629-9666-154897feaeae", "address": "fa:16:3e:56:41:f9", "network": {"id": "108c66fb-49a3-4c69-a3ac-93d9643a1d3e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025099504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e765258a50d46dea25bfd9c72970eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61639246-9d", "ovs_interfaceid": "61639246-9d84-4629-9666-154897feaeae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG nova.compute.manager [req-a704c0a2-451b-4caf-8411-a0af4dd06fff req-81e306d5-1fed-44a8-9575-e4e8023ca2d6 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-plugged-dbc2a5c3-3411-4be9-aa3b-a902180c81c2 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a704c0a2-451b-4caf-8411-a0af4dd06fff req-81e306d5-1fed-44a8-9575-e4e8023ca2d6 service nova] Acquiring lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a704c0a2-451b-4caf-8411-a0af4dd06fff req-81e306d5-1fed-44a8-9575-e4e8023ca2d6 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a704c0a2-451b-4caf-8411-a0af4dd06fff req-81e306d5-1fed-44a8-9575-e4e8023ca2d6 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG nova.compute.manager [req-a704c0a2-451b-4caf-8411-a0af4dd06fff req-81e306d5-1fed-44a8-9575-e4e8023ca2d6 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] No waiting events found dispatching network-vif-plugged-dbc2a5c3-3411-4be9-aa3b-a902180c81c2 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:20:29 user nova-compute[73497]: WARNING nova.compute.manager [req-a704c0a2-451b-4caf-8411-a0af4dd06fff req-81e306d5-1fed-44a8-9575-e4e8023ca2d6 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received unexpected event network-vif-plugged-dbc2a5c3-3411-4be9-aa3b-a902180c81c2 for instance with vm_state building and task_state spawning.
Aug 26 23:20:29 user nova-compute[73497]: DEBUG nova.compute.manager [req-a704c0a2-451b-4caf-8411-a0af4dd06fff req-81e306d5-1fed-44a8-9575-e4e8023ca2d6 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-plugged-5dbd55d2-5e99-474c-a1f5-8c87c783aa07 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a704c0a2-451b-4caf-8411-a0af4dd06fff req-81e306d5-1fed-44a8-9575-e4e8023ca2d6 service nova] Acquiring lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a704c0a2-451b-4caf-8411-a0af4dd06fff req-81e306d5-1fed-44a8-9575-e4e8023ca2d6 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a704c0a2-451b-4caf-8411-a0af4dd06fff req-81e306d5-1fed-44a8-9575-e4e8023ca2d6 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG nova.compute.manager [req-a704c0a2-451b-4caf-8411-a0af4dd06fff req-81e306d5-1fed-44a8-9575-e4e8023ca2d6 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] No waiting events found dispatching network-vif-plugged-5dbd55d2-5e99-474c-a1f5-8c87c783aa07 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:20:29 user nova-compute[73497]: WARNING nova.compute.manager [req-a704c0a2-451b-4caf-8411-a0af4dd06fff req-81e306d5-1fed-44a8-9575-e4e8023ca2d6 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received unexpected event network-vif-plugged-5dbd55d2-5e99-474c-a1f5-8c87c783aa07 for instance with vm_state building and task_state spawning.
Aug 26 23:20:29 user nova-compute[73497]: DEBUG nova.compute.manager [req-a704c0a2-451b-4caf-8411-a0af4dd06fff req-81e306d5-1fed-44a8-9575-e4e8023ca2d6 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-plugged-5dbd55d2-5e99-474c-a1f5-8c87c783aa07 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a704c0a2-451b-4caf-8411-a0af4dd06fff req-81e306d5-1fed-44a8-9575-e4e8023ca2d6 service nova] Acquiring lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a704c0a2-451b-4caf-8411-a0af4dd06fff req-81e306d5-1fed-44a8-9575-e4e8023ca2d6 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a704c0a2-451b-4caf-8411-a0af4dd06fff req-81e306d5-1fed-44a8-9575-e4e8023ca2d6 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG nova.compute.manager [req-a704c0a2-451b-4caf-8411-a0af4dd06fff req-81e306d5-1fed-44a8-9575-e4e8023ca2d6 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] No waiting events found dispatching network-vif-plugged-5dbd55d2-5e99-474c-a1f5-8c87c783aa07 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:20:29 user nova-compute[73497]: WARNING nova.compute.manager [req-a704c0a2-451b-4caf-8411-a0af4dd06fff req-81e306d5-1fed-44a8-9575-e4e8023ca2d6 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received unexpected event network-vif-plugged-5dbd55d2-5e99-474c-a1f5-8c87c783aa07 for instance with vm_state building and task_state spawning.
Aug 26 23:20:29 user nova-compute[73497]: DEBUG nova.compute.manager [req-a704c0a2-451b-4caf-8411-a0af4dd06fff req-81e306d5-1fed-44a8-9575-e4e8023ca2d6 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-plugged-a9571bef-59d5-4a2d-9803-69bf1e5335d1 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a704c0a2-451b-4caf-8411-a0af4dd06fff req-81e306d5-1fed-44a8-9575-e4e8023ca2d6 service nova] Acquiring lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a704c0a2-451b-4caf-8411-a0af4dd06fff req-81e306d5-1fed-44a8-9575-e4e8023ca2d6 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a704c0a2-451b-4caf-8411-a0af4dd06fff req-81e306d5-1fed-44a8-9575-e4e8023ca2d6 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG nova.compute.manager [req-a704c0a2-451b-4caf-8411-a0af4dd06fff req-81e306d5-1fed-44a8-9575-e4e8023ca2d6 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] No waiting events found dispatching network-vif-plugged-a9571bef-59d5-4a2d-9803-69bf1e5335d1 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:20:29 user nova-compute[73497]: WARNING nova.compute.manager [req-a704c0a2-451b-4caf-8411-a0af4dd06fff req-81e306d5-1fed-44a8-9575-e4e8023ca2d6 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received unexpected event network-vif-plugged-a9571bef-59d5-4a2d-9803-69bf1e5335d1 for instance with vm_state building and task_state spawning.
Aug 26 23:20:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Releasing lock "refresh_cache-ee6283d5-40de-432d-997c-0be52ff673ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG os_brick.utils [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:20:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:30 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0925c049-bcc3-492e-adbb-ccb56151fccb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:30 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e163be-fed7-4305-ba85-affc4b8952ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:30 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[67058243-b7f3-4a9c-9eb1-b8ff2647340b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:30 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[335a7ec0-93fb-4bec-a7c0-e88aa5bb865f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:20:30 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:20:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:20:30 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:20:30 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[971ccebc-95ef-4e12-8a2d-39893b04621a]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:30 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:20:30 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:20:30 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:20:30 user nova-compute[73497]: DEBUG os_brick.utils [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:20:30 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:30 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:30 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:30 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:30 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:30 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG nova.compute.manager [req-4fa7819f-e1ac-4c8f-b6a6-dd800af766db req-8ed4e563-5c03-49cf-90cc-b3d51df8fa87 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-plugged-0e19373c-aa09-49fa-a349-1a7caafa8b61 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4fa7819f-e1ac-4c8f-b6a6-dd800af766db req-8ed4e563-5c03-49cf-90cc-b3d51df8fa87 service nova] Acquiring lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4fa7819f-e1ac-4c8f-b6a6-dd800af766db req-8ed4e563-5c03-49cf-90cc-b3d51df8fa87 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4fa7819f-e1ac-4c8f-b6a6-dd800af766db req-8ed4e563-5c03-49cf-90cc-b3d51df8fa87 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG nova.compute.manager [req-4fa7819f-e1ac-4c8f-b6a6-dd800af766db req-8ed4e563-5c03-49cf-90cc-b3d51df8fa87 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] No waiting events found dispatching network-vif-plugged-0e19373c-aa09-49fa-a349-1a7caafa8b61 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:20:31 user nova-compute[73497]: WARNING nova.compute.manager [req-4fa7819f-e1ac-4c8f-b6a6-dd800af766db req-8ed4e563-5c03-49cf-90cc-b3d51df8fa87 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received unexpected event network-vif-plugged-0e19373c-aa09-49fa-a349-1a7caafa8b61 for instance with vm_state building and task_state spawning.
Aug 26 23:20:31 user nova-compute[73497]: DEBUG nova.compute.manager [req-4fa7819f-e1ac-4c8f-b6a6-dd800af766db req-8ed4e563-5c03-49cf-90cc-b3d51df8fa87 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-plugged-fb8cf209-6174-4bcd-9beb-d2f21ef40e5e {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4fa7819f-e1ac-4c8f-b6a6-dd800af766db req-8ed4e563-5c03-49cf-90cc-b3d51df8fa87 service nova] Acquiring lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4fa7819f-e1ac-4c8f-b6a6-dd800af766db req-8ed4e563-5c03-49cf-90cc-b3d51df8fa87 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4fa7819f-e1ac-4c8f-b6a6-dd800af766db req-8ed4e563-5c03-49cf-90cc-b3d51df8fa87 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG nova.compute.manager [req-4fa7819f-e1ac-4c8f-b6a6-dd800af766db req-8ed4e563-5c03-49cf-90cc-b3d51df8fa87 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] No waiting events found dispatching network-vif-plugged-fb8cf209-6174-4bcd-9beb-d2f21ef40e5e {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:20:31 user nova-compute[73497]: WARNING nova.compute.manager [req-4fa7819f-e1ac-4c8f-b6a6-dd800af766db req-8ed4e563-5c03-49cf-90cc-b3d51df8fa87 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received unexpected event network-vif-plugged-fb8cf209-6174-4bcd-9beb-d2f21ef40e5e for instance with vm_state building and task_state spawning.
Aug 26 23:20:31 user nova-compute[73497]: DEBUG nova.compute.manager [req-4fa7819f-e1ac-4c8f-b6a6-dd800af766db req-8ed4e563-5c03-49cf-90cc-b3d51df8fa87 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-plugged-fb8cf209-6174-4bcd-9beb-d2f21ef40e5e {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4fa7819f-e1ac-4c8f-b6a6-dd800af766db req-8ed4e563-5c03-49cf-90cc-b3d51df8fa87 service nova] Acquiring lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4fa7819f-e1ac-4c8f-b6a6-dd800af766db req-8ed4e563-5c03-49cf-90cc-b3d51df8fa87 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4fa7819f-e1ac-4c8f-b6a6-dd800af766db req-8ed4e563-5c03-49cf-90cc-b3d51df8fa87 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG nova.compute.manager [req-4fa7819f-e1ac-4c8f-b6a6-dd800af766db req-8ed4e563-5c03-49cf-90cc-b3d51df8fa87 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] No waiting events found dispatching network-vif-plugged-fb8cf209-6174-4bcd-9beb-d2f21ef40e5e {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:20:31 user nova-compute[73497]: WARNING nova.compute.manager [req-4fa7819f-e1ac-4c8f-b6a6-dd800af766db req-8ed4e563-5c03-49cf-90cc-b3d51df8fa87 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received unexpected event network-vif-plugged-fb8cf209-6174-4bcd-9beb-d2f21ef40e5e for instance with vm_state building and task_state spawning.
Aug 26 23:20:31 user nova-compute[73497]: DEBUG nova.compute.manager [req-4fa7819f-e1ac-4c8f-b6a6-dd800af766db req-8ed4e563-5c03-49cf-90cc-b3d51df8fa87 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-plugged-b2bc5017-c7ab-43ff-b092-f49336426174 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4fa7819f-e1ac-4c8f-b6a6-dd800af766db req-8ed4e563-5c03-49cf-90cc-b3d51df8fa87 service nova] Acquiring lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4fa7819f-e1ac-4c8f-b6a6-dd800af766db req-8ed4e563-5c03-49cf-90cc-b3d51df8fa87 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4fa7819f-e1ac-4c8f-b6a6-dd800af766db req-8ed4e563-5c03-49cf-90cc-b3d51df8fa87 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG nova.compute.manager [req-4fa7819f-e1ac-4c8f-b6a6-dd800af766db req-8ed4e563-5c03-49cf-90cc-b3d51df8fa87 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] No waiting events found dispatching network-vif-plugged-b2bc5017-c7ab-43ff-b092-f49336426174 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:20:31 user nova-compute[73497]: WARNING nova.compute.manager [req-4fa7819f-e1ac-4c8f-b6a6-dd800af766db req-8ed4e563-5c03-49cf-90cc-b3d51df8fa87 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received unexpected event network-vif-plugged-b2bc5017-c7ab-43ff-b092-f49336426174 for instance with vm_state building and task_state spawning.
Aug 26 23:20:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AOzLgGKJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:20:31 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:20:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:20:31 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:20:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:20:31 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:20:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa31c3ee-9c1e-444e-a626-8bf8d014f344]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:20:31 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092031.7465656, 2f46a6a8-a043-455a-98f8-dae359594f56 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:20:31 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] VM Resumed (Lifecycle Event)
Aug 26 23:20:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3948b8-358a-4567-912c-26f8028fd1cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG nova.compute.manager [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb] added
Aug 26 23:20:31 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:31 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Instance spawned successfully.
Aug 26 23:20:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c76c11-e97b-4128-8aa4-22351df93b91]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:31 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:20:31 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092031.7488945, 2f46a6a8-a043-455a-98f8-dae359594f56 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:20:31 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] VM Started (Lifecycle Event)
Aug 26 23:20:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[71947110-605e-449c-a261-a77f02043c20]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AOzLgGKJ {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AOzLgGKJ" returned: 0 in 0.048s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e6d543-b393-481d-ba9f-6e1b2c0bf722]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AOzLgGKJ'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f0ad0f-5f57-411e-a697-a9df426ed1b9]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:31 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:20:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24766aa-cb58-4756-b75e-bc88917c1323]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:20:31 user nova-compute[73497]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:20:31 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:20:31 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:20:31 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:20:31 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:20:31 user nova-compute[73497]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:20:31 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:20:31 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:20:31 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:20:31 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:20:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:31 user nova-compute[73497]: INFO nova.compute.manager [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Took 14.67 seconds to spawn the instance on the hypervisor.
Aug 26 23:20:31 user nova-compute[73497]: DEBUG nova.compute.manager [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:20:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e879ad-d256-4efd-a144-3efcb15ae2c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb, portal: 172.16.0.220,3260]
Aug 26 23:20:32 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb, portal: 172.16.0.220,3260] successful.
Aug 26 23:20:32 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e818624b-2661-42f0-b6bf-537a0895f0c4]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:32 user nova-compute[73497]: INFO nova.compute.manager [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Took 52.00 seconds to build instance.
Aug 26 23:20:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-18ff279c-47d6-4eb0-8fb5-924859f1cf08 tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Lock "2f46a6a8-a043-455a-98f8-dae359594f56" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 52.121s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[937651ed-ba1f-4c3a-9784-99de7b93333c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:20:32 user nova-compute[73497]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:20:32 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:20:32 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:20:32 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:20:32 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:20:32 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:20:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:20:32 user nova-compute[73497]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:20:32 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:20:32 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:20:32 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:20:32 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:20:32 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:20:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:20:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:20:32 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] HCTL ('36', '-', '-', 0) found on session 21 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:20:32 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:20:32 user nova-compute[73497]: DEBUG nova.compute.manager [req-f04967dc-6132-41cd-9f5b-c794c856e5db req-9919000b-9c4f-485b-a051-c9d307da9775 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-plugged-a9571bef-59d5-4a2d-9803-69bf1e5335d1 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:20:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f04967dc-6132-41cd-9f5b-c794c856e5db req-9919000b-9c4f-485b-a051-c9d307da9775 service nova] Acquiring lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f04967dc-6132-41cd-9f5b-c794c856e5db req-9919000b-9c4f-485b-a051-c9d307da9775 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f04967dc-6132-41cd-9f5b-c794c856e5db req-9919000b-9c4f-485b-a051-c9d307da9775 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:32 user nova-compute[73497]: DEBUG nova.compute.manager [req-f04967dc-6132-41cd-9f5b-c794c856e5db req-9919000b-9c4f-485b-a051-c9d307da9775 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] No waiting events found dispatching network-vif-plugged-a9571bef-59d5-4a2d-9803-69bf1e5335d1 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:20:32 user nova-compute[73497]: WARNING nova.compute.manager [req-f04967dc-6132-41cd-9f5b-c794c856e5db req-9919000b-9c4f-485b-a051-c9d307da9775 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received unexpected event network-vif-plugged-a9571bef-59d5-4a2d-9803-69bf1e5335d1 for instance with vm_state active and task_state None.
Aug 26 23:20:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc02004e-b13c-483e-964b-1b8422b30e05]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:32 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:20:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AOzLgGKJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:20:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-cdecbb54-4697-4286-aa47-5a7e096bd038 req-232fa732-fb2d-4fa5-8c1f-687bd5066c59 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-plugged-b2bc5017-c7ab-43ff-b092-f49336426174 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:20:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cdecbb54-4697-4286-aa47-5a7e096bd038 req-232fa732-fb2d-4fa5-8c1f-687bd5066c59 service nova] Acquiring lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cdecbb54-4697-4286-aa47-5a7e096bd038 req-232fa732-fb2d-4fa5-8c1f-687bd5066c59 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cdecbb54-4697-4286-aa47-5a7e096bd038 req-232fa732-fb2d-4fa5-8c1f-687bd5066c59 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-cdecbb54-4697-4286-aa47-5a7e096bd038 req-232fa732-fb2d-4fa5-8c1f-687bd5066c59 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] No waiting events found dispatching network-vif-plugged-b2bc5017-c7ab-43ff-b092-f49336426174 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:20:33 user nova-compute[73497]: WARNING nova.compute.manager [req-cdecbb54-4697-4286-aa47-5a7e096bd038 req-232fa732-fb2d-4fa5-8c1f-687bd5066c59 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received unexpected event network-vif-plugged-b2bc5017-c7ab-43ff-b092-f49336426174 for instance with vm_state active and task_state None.
Aug 26 23:20:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:20:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '23838656630393539', 'path': '/dev/sde'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:20:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838656630393539', 'path': '/dev/sde'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:20:33 user nova-compute[73497]: DEBUG nova.objects.instance [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lazy-loading 'flavor' on Instance uuid ff1085db-4bfc-4c77-a9e4-39f47ffb6d43 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:20:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 23:20:33 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:20:33 user nova-compute[73497]:   <source dev="/dev/sde"/>
Aug 26 23:20:33 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:20:33 user nova-compute[73497]:   <serial>917dc081-eb80-4c05-ac91-9e6dd93718eb</serial>
Aug 26 23:20:33 user nova-compute[73497]: </disk>
Aug 26 23:20:33 user nova-compute[73497]:  {{(pid=73497) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 23:20:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:20:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:20:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] No VIF found with MAC fa:16:3e:15:e9:03, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:20:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8f462221-7631-41a8-b82f-747c9aad226a tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "ff1085db-4bfc-4c77-a9e4-39f47ffb6d43" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.316s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "bde0a05a-a075-4298-907e-cb00798c90af" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "bde0a05a-a075-4298-907e-cb00798c90af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:38 user nova-compute[73497]: DEBUG nova.compute.manager [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:20:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:38 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:20:38 user nova-compute[73497]: INFO nova.compute.claims [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Claim successful on node user
Aug 26 23:20:39 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:20:39 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:20:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:39 user nova-compute[73497]: DEBUG nova.compute.manager [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:20:39 user nova-compute[73497]: DEBUG nova.compute.manager [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:20:39 user nova-compute[73497]: DEBUG nova.network.neutron [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: bde0a05a-a075-4298-907e-cb00798c90af] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:20:39 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:20:39 user nova-compute[73497]: DEBUG nova.compute.manager [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:20:39 user nova-compute[73497]: DEBUG nova.policy [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e38409b92a95475db83540cbc4222466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd784b1d6c31e41d6a03fc377b0be69f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:20:39 user nova-compute[73497]: DEBUG nova.compute.manager [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:20:39 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:20:39 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Creating image(s)
Aug 26 23:20:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "/opt/stack/data/nova/instances/bde0a05a-a075-4298-907e-cb00798c90af/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "/opt/stack/data/nova/instances/bde0a05a-a075-4298-907e-cb00798c90af/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "/opt/stack/data/nova/instances/bde0a05a-a075-4298-907e-cb00798c90af/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:39 user nova-compute[73497]: INFO nova.compute.manager [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Rescuing
Aug 26 23:20:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "refresh_cache-e9e5c83f-0678-48d4-a81f-1a3f959aabcf" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:20:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquired lock "refresh_cache-e9e5c83f-0678-48d4-a81f-1a3f959aabcf" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:20:39 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:20:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.206s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.199s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/bde0a05a-a075-4298-907e-cb00798c90af/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/bde0a05a-a075-4298-907e-cb00798c90af/disk 1073741824" returned: 0 in 0.074s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.201s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:40 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bde0a05a-a075-4298-907e-cb00798c90af/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:20:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bde0a05a-a075-4298-907e-cb00798c90af/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bde0a05a-a075-4298-907e-cb00798c90af/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:40 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Cannot resize image /opt/stack/data/nova/instances/bde0a05a-a075-4298-907e-cb00798c90af/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:20:40 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:20:40 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Ensure instance console log exists: /opt/stack/data/nova/instances/bde0a05a-a075-4298-907e-cb00798c90af/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:20:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:40 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Updating instance_info_cache with network_info: [{"id": "3de77772-78de-4261-b064-d1c2d8e30b31", "address": "fa:16:3e:d7:8d:5d", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de77772-78", "ovs_interfaceid": "3de77772-78de-4261-b064-d1c2d8e30b31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:20:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Releasing lock "refresh_cache-e9e5c83f-0678-48d4-a81f-1a3f959aabcf" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:20:40 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:40 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:40 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:40 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:41 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Instance destroyed successfully.
Aug 26 23:20:41 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Attempting rescue
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73497) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Instance directory exists: not creating {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 23:20:41 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Creating image(s)
Aug 26 23:20:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "/opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "/opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "/opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.objects.instance [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lazy-loading 'trusted_certs' on Instance uuid e9e5c83f-0678-48d4-a81f-1a3f959aabcf {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.compute.manager [req-604bb2ba-4b8e-4cb5-a251-91a0f01e1920 req-cadce842-b12a-4499-b668-5d45c1006981 service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Received event network-vif-unplugged-3de77772-78de-4261-b064-d1c2d8e30b31 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-604bb2ba-4b8e-4cb5-a251-91a0f01e1920 req-cadce842-b12a-4499-b668-5d45c1006981 service nova] Acquiring lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-604bb2ba-4b8e-4cb5-a251-91a0f01e1920 req-cadce842-b12a-4499-b668-5d45c1006981 service nova] Lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-604bb2ba-4b8e-4cb5-a251-91a0f01e1920 req-cadce842-b12a-4499-b668-5d45c1006981 service nova] Lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.compute.manager [req-604bb2ba-4b8e-4cb5-a251-91a0f01e1920 req-cadce842-b12a-4499-b668-5d45c1006981 service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] No waiting events found dispatching network-vif-unplugged-3de77772-78de-4261-b064-d1c2d8e30b31 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:20:41 user nova-compute[73497]: WARNING nova.compute.manager [req-604bb2ba-4b8e-4cb5-a251-91a0f01e1920 req-cadce842-b12a-4499-b668-5d45c1006981 service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Received unexpected event network-vif-unplugged-3de77772-78de-4261-b064-d1c2d8e30b31 for instance with vm_state active and task_state rescuing.
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.network.neutron [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Successfully created port: a712145b-99c7-4279-b125-c98565a252f2 {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.199s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue" returned: 0 in 0.052s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.objects.instance [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lazy-loading 'migration_context' on Instance uuid e9e5c83f-0678-48d4-a81f-1a3f959aabcf {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693092026.3335652, ee6283d5-40de-432d-997c-0be52ff673ca => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:20:41 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] VM Stopped (Lifecycle Event)
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.objects.base [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Object Instance<e9e5c83f-0678-48d4-a81f-1a3f959aabcf> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Start _get_guest_xml network_info=[{"id": "3de77772-78de-4261-b064-d1c2d8e30b31", "address": "fa:16:3e:d7:8d:5d", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "vif_mac": "fa:16:3e:d7:8d:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de77772-78", "ovs_interfaceid": "3de77772-78de-4261-b064-d1c2d8e30b31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.objects.instance [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lazy-loading 'resources' on Instance uuid e9e5c83f-0678-48d4-a81f-1a3f959aabcf {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.objects.base [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Object Instance<e9e5c83f-0678-48d4-a81f-1a3f959aabcf> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.objects.instance [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lazy-loading 'numa_topology' on Instance uuid e9e5c83f-0678-48d4-a81f-1a3f959aabcf {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.compute.manager [None req-b8a75ef8-8bc3-4a49-9f33-4f3eadf30418 None None] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.objects.base [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Object Instance<e9e5c83f-0678-48d4-a81f-1a3f959aabcf> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.compute.manager [None req-b8a75ef8-8bc3-4a49-9f33-4f3eadf30418 None None] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:20:41 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:20:41 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:20:41 user nova-compute[73497]: INFO nova.compute.manager [None req-b8a75ef8-8bc3-4a49-9f33-4f3eadf30418 None None] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.objects.instance [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lazy-loading 'vcpu_model' on Instance uuid e9e5c83f-0678-48d4-a81f-1a3f959aabcf {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.objects.base [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Object Instance<e9e5c83f-0678-48d4-a81f-1a3f959aabcf> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:18:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-10306177',display_name='tempest-ServerRescueNegativeTestJSON-server-10306177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-10306177',id=20,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:18:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c4ca787dd33440d98779668507369ee',ramdisk_id='',reservation_id='r-x1p8i7zq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1946187856',owner_user_name='tempest-ServerRescueNegativeTestJSON-1946187856-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:18:58Z,user_data=None,user_id='af64aa253eec41a0976c3e527fe41831',uuid=e9e5c83f-0678-48d4-a81f-1a3f959aabcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3de77772-78de-4261-b064-d1c2d8e30b31", "address": "fa:16:3e:d7:8d:5d", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "vif_mac": "fa:16:3e:d7:8d:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de77772-78", "ovs_interfaceid": "3de77772-78de-4261-b064-d1c2d8e30b31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Converting VIF {"id": "3de77772-78de-4261-b064-d1c2d8e30b31", "address": "fa:16:3e:d7:8d:5d", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "vif_mac": "fa:16:3e:d7:8d:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de77772-78", "ovs_interfaceid": "3de77772-78de-4261-b064-d1c2d8e30b31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:8d:5d,bridge_name='br-int',has_traffic_filtering=True,id=3de77772-78de-4261-b064-d1c2d8e30b31,network=Network(6f13f07f-104d-4d8d-b5fa-afa402402a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de77772-78') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.objects.instance [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lazy-loading 'pci_devices' on Instance uuid e9e5c83f-0678-48d4-a81f-1a3f959aabcf {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.objects.base [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Object Instance<e9e5c83f-0678-48d4-a81f-1a3f959aabcf> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:20:41 user nova-compute[73497]:   <uuid>e9e5c83f-0678-48d4-a81f-1a3f959aabcf</uuid>
Aug 26 23:20:41 user nova-compute[73497]:   <name>instance-00000014</name>
Aug 26 23:20:41 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:20:41 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:20:41 user nova-compute[73497]:   <metadata>
Aug 26 23:20:41 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:20:41 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:20:41 user nova-compute[73497]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-10306177</nova:name>
Aug 26 23:20:41 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:20:41</nova:creationTime>
Aug 26 23:20:41 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:20:41 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:20:41 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:20:41 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:20:41 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:20:41 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:20:41 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:20:41 user nova-compute[73497]:       <nova:owner>
Aug 26 23:20:41 user nova-compute[73497]:         <nova:user uuid="af64aa253eec41a0976c3e527fe41831">tempest-ServerRescueNegativeTestJSON-1946187856-project-member</nova:user>
Aug 26 23:20:41 user nova-compute[73497]:         <nova:project uuid="0c4ca787dd33440d98779668507369ee">tempest-ServerRescueNegativeTestJSON-1946187856</nova:project>
Aug 26 23:20:41 user nova-compute[73497]:       </nova:owner>
Aug 26 23:20:41 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:20:41 user nova-compute[73497]:       <nova:ports>
Aug 26 23:20:41 user nova-compute[73497]:         <nova:port uuid="3de77772-78de-4261-b064-d1c2d8e30b31">
Aug 26 23:20:41 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 23:20:41 user nova-compute[73497]:         </nova:port>
Aug 26 23:20:41 user nova-compute[73497]:       </nova:ports>
Aug 26 23:20:41 user nova-compute[73497]:     </nova:instance>
Aug 26 23:20:41 user nova-compute[73497]:   </metadata>
Aug 26 23:20:41 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:20:41 user nova-compute[73497]:     <system>
Aug 26 23:20:41 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:20:41 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:20:41 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:20:41 user nova-compute[73497]:       <entry name="serial">e9e5c83f-0678-48d4-a81f-1a3f959aabcf</entry>
Aug 26 23:20:41 user nova-compute[73497]:       <entry name="uuid">e9e5c83f-0678-48d4-a81f-1a3f959aabcf</entry>
Aug 26 23:20:41 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:20:41 user nova-compute[73497]:     </system>
Aug 26 23:20:41 user nova-compute[73497]:   </sysinfo>
Aug 26 23:20:41 user nova-compute[73497]:   <os>
Aug 26 23:20:41 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:20:41 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:20:41 user nova-compute[73497]:   </os>
Aug 26 23:20:41 user nova-compute[73497]:   <features>
Aug 26 23:20:41 user nova-compute[73497]:     <acpi/>
Aug 26 23:20:41 user nova-compute[73497]:     <apic/>
Aug 26 23:20:41 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:20:41 user nova-compute[73497]:   </features>
Aug 26 23:20:41 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:20:41 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:20:41 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:20:41 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:20:41 user nova-compute[73497]:   </clock>
Aug 26 23:20:41 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:20:41 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:20:41 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:20:41 user nova-compute[73497]:   </cpu>
Aug 26 23:20:41 user nova-compute[73497]:   <devices>
Aug 26 23:20:41 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:20:41 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:20:41 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue"/>
Aug 26 23:20:41 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:20:41 user nova-compute[73497]:     </disk>
Aug 26 23:20:41 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:20:41 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:20:41 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk"/>
Aug 26 23:20:41 user nova-compute[73497]:       <target dev="vdb" bus="virtio"/>
Aug 26 23:20:41 user nova-compute[73497]:     </disk>
Aug 26 23:20:41 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:20:41 user nova-compute[73497]:       <mac address="fa:16:3e:d7:8d:5d"/>
Aug 26 23:20:41 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:20:41 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:20:41 user nova-compute[73497]:       <target dev="tap3de77772-78"/>
Aug 26 23:20:41 user nova-compute[73497]:     </interface>
Aug 26 23:20:41 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:20:41 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/console.log" append="off"/>
Aug 26 23:20:41 user nova-compute[73497]:     </serial>
Aug 26 23:20:41 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:20:41 user nova-compute[73497]:     <video>
Aug 26 23:20:41 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:20:41 user nova-compute[73497]:     </video>
Aug 26 23:20:41 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:20:41 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:20:41 user nova-compute[73497]:     </rng>
Aug 26 23:20:41 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:20:41 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:20:41 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:20:41 user nova-compute[73497]:     </memballoon>
Aug 26 23:20:41 user nova-compute[73497]:   </devices>
Aug 26 23:20:41 user nova-compute[73497]: </domain>
Aug 26 23:20:41 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:20:41 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Instance destroyed successfully.
Aug 26 23:20:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] No VIF found with MAC fa:16:3e:d7:8d:5d, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:20:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:42 user nova-compute[73497]: DEBUG nova.network.neutron [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Successfully updated port: a712145b-99c7-4279-b125-c98565a252f2 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:20:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "refresh_cache-bde0a05a-a075-4298-907e-cb00798c90af" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:20:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquired lock "refresh_cache-bde0a05a-a075-4298-907e-cb00798c90af" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:20:42 user nova-compute[73497]: DEBUG nova.network.neutron [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:20:42 user nova-compute[73497]: DEBUG nova.network.neutron [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:20:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG nova.network.neutron [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Updating instance_info_cache with network_info: [{"id": "a712145b-99c7-4279-b125-c98565a252f2", "address": "fa:16:3e:c7:e6:d8", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa712145b-99", "ovs_interfaceid": "a712145b-99c7-4279-b125-c98565a252f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Releasing lock "refresh_cache-bde0a05a-a075-4298-907e-cb00798c90af" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG nova.compute.manager [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Instance network_info: |[{"id": "a712145b-99c7-4279-b125-c98565a252f2", "address": "fa:16:3e:c7:e6:d8", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa712145b-99", "ovs_interfaceid": "a712145b-99c7-4279-b125-c98565a252f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Start _get_guest_xml network_info=[{"id": "a712145b-99c7-4279-b125-c98565a252f2", "address": "fa:16:3e:c7:e6:d8", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa712145b-99", "ovs_interfaceid": "a712145b-99c7-4279-b125-c98565a252f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:20:43 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:20:43 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:20:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:20:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-627150927',display_name='tempest-AttachVolumeNegativeTest-server-627150927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-627150927',id=22,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/9qhd/GhkzSHpHihosoi6JmUsgRits6X8Unh98xfGdlKbs6a+O5gbOAdwvif6YLfQVufvUt7j2vE7T8022llM5qcU032JWrmL3/vNxxLEr1FEmU+L9CId1VlHMWffA7A==',key_name='tempest-keypair-535794588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d784b1d6c31e41d6a03fc377b0be69f5',ramdisk_id='',reservation_id='r-bt1za8ho',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1095215256',owner_user_name='tempest-AttachVolumeNegativeTest-1095215256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:20:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e38409b92a95475db83540cbc4222466',uuid=bde0a05a-a075-4298-907e-cb00798c90af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a712145b-99c7-4279-b125-c98565a252f2", "address": "fa:16:3e:c7:e6:d8", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa712145b-99", "ovs_interfaceid": "a712145b-99c7-4279-b125-c98565a252f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Converting VIF {"id": "a712145b-99c7-4279-b125-c98565a252f2", "address": "fa:16:3e:c7:e6:d8", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa712145b-99", "ovs_interfaceid": "a712145b-99c7-4279-b125-c98565a252f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:e6:d8,bridge_name='br-int',has_traffic_filtering=True,id=a712145b-99c7-4279-b125-c98565a252f2,network=Network(7bae9729-050d-4ff3-a842-91d0ec2c08d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa712145b-99') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG nova.objects.instance [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lazy-loading 'pci_devices' on Instance uuid bde0a05a-a075-4298-907e-cb00798c90af {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: bde0a05a-a075-4298-907e-cb00798c90af] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:20:43 user nova-compute[73497]:   <uuid>bde0a05a-a075-4298-907e-cb00798c90af</uuid>
Aug 26 23:20:43 user nova-compute[73497]:   <name>instance-00000016</name>
Aug 26 23:20:43 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:20:43 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:20:43 user nova-compute[73497]:   <metadata>
Aug 26 23:20:43 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:20:43 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:20:43 user nova-compute[73497]:       <nova:name>tempest-AttachVolumeNegativeTest-server-627150927</nova:name>
Aug 26 23:20:43 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:20:43</nova:creationTime>
Aug 26 23:20:43 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:20:43 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:20:43 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:20:43 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:20:43 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:20:43 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:20:43 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:20:43 user nova-compute[73497]:       <nova:owner>
Aug 26 23:20:43 user nova-compute[73497]:         <nova:user uuid="e38409b92a95475db83540cbc4222466">tempest-AttachVolumeNegativeTest-1095215256-project-member</nova:user>
Aug 26 23:20:43 user nova-compute[73497]:         <nova:project uuid="d784b1d6c31e41d6a03fc377b0be69f5">tempest-AttachVolumeNegativeTest-1095215256</nova:project>
Aug 26 23:20:43 user nova-compute[73497]:       </nova:owner>
Aug 26 23:20:43 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:20:43 user nova-compute[73497]:       <nova:ports>
Aug 26 23:20:43 user nova-compute[73497]:         <nova:port uuid="a712145b-99c7-4279-b125-c98565a252f2">
Aug 26 23:20:43 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 23:20:43 user nova-compute[73497]:         </nova:port>
Aug 26 23:20:43 user nova-compute[73497]:       </nova:ports>
Aug 26 23:20:43 user nova-compute[73497]:     </nova:instance>
Aug 26 23:20:43 user nova-compute[73497]:   </metadata>
Aug 26 23:20:43 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:20:43 user nova-compute[73497]:     <system>
Aug 26 23:20:43 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:20:43 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:20:43 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:20:43 user nova-compute[73497]:       <entry name="serial">bde0a05a-a075-4298-907e-cb00798c90af</entry>
Aug 26 23:20:43 user nova-compute[73497]:       <entry name="uuid">bde0a05a-a075-4298-907e-cb00798c90af</entry>
Aug 26 23:20:43 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:20:43 user nova-compute[73497]:     </system>
Aug 26 23:20:43 user nova-compute[73497]:   </sysinfo>
Aug 26 23:20:43 user nova-compute[73497]:   <os>
Aug 26 23:20:43 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:20:43 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:20:43 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:20:43 user nova-compute[73497]:   </os>
Aug 26 23:20:43 user nova-compute[73497]:   <features>
Aug 26 23:20:43 user nova-compute[73497]:     <acpi/>
Aug 26 23:20:43 user nova-compute[73497]:     <apic/>
Aug 26 23:20:43 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:20:43 user nova-compute[73497]:   </features>
Aug 26 23:20:43 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:20:43 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:20:43 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:20:43 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:20:43 user nova-compute[73497]:   </clock>
Aug 26 23:20:43 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:20:43 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:20:43 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:20:43 user nova-compute[73497]:   </cpu>
Aug 26 23:20:43 user nova-compute[73497]:   <devices>
Aug 26 23:20:43 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:20:43 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:20:43 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/bde0a05a-a075-4298-907e-cb00798c90af/disk"/>
Aug 26 23:20:43 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:20:43 user nova-compute[73497]:     </disk>
Aug 26 23:20:43 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:20:43 user nova-compute[73497]:       <mac address="fa:16:3e:c7:e6:d8"/>
Aug 26 23:20:43 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:20:43 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:20:43 user nova-compute[73497]:       <target dev="tapa712145b-99"/>
Aug 26 23:20:43 user nova-compute[73497]:     </interface>
Aug 26 23:20:43 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:20:43 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/bde0a05a-a075-4298-907e-cb00798c90af/console.log" append="off"/>
Aug 26 23:20:43 user nova-compute[73497]:     </serial>
Aug 26 23:20:43 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:20:43 user nova-compute[73497]:     <video>
Aug 26 23:20:43 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:20:43 user nova-compute[73497]:     </video>
Aug 26 23:20:43 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:20:43 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:20:43 user nova-compute[73497]:     </rng>
Aug 26 23:20:43 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:20:43 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:20:43 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:20:43 user nova-compute[73497]:     </memballoon>
Aug 26 23:20:43 user nova-compute[73497]:   </devices>
Aug 26 23:20:43 user nova-compute[73497]: </domain>
Aug 26 23:20:43 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:20:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-627150927',display_name='tempest-AttachVolumeNegativeTest-server-627150927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-627150927',id=22,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/9qhd/GhkzSHpHihosoi6JmUsgRits6X8Unh98xfGdlKbs6a+O5gbOAdwvif6YLfQVufvUt7j2vE7T8022llM5qcU032JWrmL3/vNxxLEr1FEmU+L9CId1VlHMWffA7A==',key_name='tempest-keypair-535794588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d784b1d6c31e41d6a03fc377b0be69f5',ramdisk_id='',reservation_id='r-bt1za8ho',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1095215256',owner_user_name='tempest-AttachVolumeNegativeTest-1095215256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:20:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e38409b92a95475db83540cbc4222466',uuid=bde0a05a-a075-4298-907e-cb00798c90af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a712145b-99c7-4279-b125-c98565a252f2", "address": "fa:16:3e:c7:e6:d8", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa712145b-99", "ovs_interfaceid": "a712145b-99c7-4279-b125-c98565a252f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Converting VIF {"id": "a712145b-99c7-4279-b125-c98565a252f2", "address": "fa:16:3e:c7:e6:d8", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa712145b-99", "ovs_interfaceid": "a712145b-99c7-4279-b125-c98565a252f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:e6:d8,bridge_name='br-int',has_traffic_filtering=True,id=a712145b-99c7-4279-b125-c98565a252f2,network=Network(7bae9729-050d-4ff3-a842-91d0ec2c08d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa712145b-99') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG os_vif [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:e6:d8,bridge_name='br-int',has_traffic_filtering=True,id=a712145b-99c7-4279-b125-c98565a252f2,network=Network(7bae9729-050d-4ff3-a842-91d0ec2c08d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa712145b-99') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa712145b-99, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa712145b-99, col_values=(('external_ids', {'iface-id': 'a712145b-99c7-4279-b125-c98565a252f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:e6:d8', 'vm-uuid': 'bde0a05a-a075-4298-907e-cb00798c90af'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:43 user nova-compute[73497]: INFO os_vif [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:e6:d8,bridge_name='br-int',has_traffic_filtering=True,id=a712145b-99c7-4279-b125-c98565a252f2,network=Network(7bae9729-050d-4ff3-a842-91d0ec2c08d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa712145b-99')
Aug 26 23:20:43 user nova-compute[73497]: DEBUG nova.compute.manager [req-e702afe2-0c50-4974-8989-cc35717aa443 req-120b14cc-0f84-4d44-8b14-ff9cc63252df service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Received event network-vif-plugged-3de77772-78de-4261-b064-d1c2d8e30b31 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-e702afe2-0c50-4974-8989-cc35717aa443 req-120b14cc-0f84-4d44-8b14-ff9cc63252df service nova] Acquiring lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-e702afe2-0c50-4974-8989-cc35717aa443 req-120b14cc-0f84-4d44-8b14-ff9cc63252df service nova] Lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-e702afe2-0c50-4974-8989-cc35717aa443 req-120b14cc-0f84-4d44-8b14-ff9cc63252df service nova] Lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG nova.compute.manager [req-e702afe2-0c50-4974-8989-cc35717aa443 req-120b14cc-0f84-4d44-8b14-ff9cc63252df service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] No waiting events found dispatching network-vif-plugged-3de77772-78de-4261-b064-d1c2d8e30b31 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:20:43 user nova-compute[73497]: WARNING nova.compute.manager [req-e702afe2-0c50-4974-8989-cc35717aa443 req-120b14cc-0f84-4d44-8b14-ff9cc63252df service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Received unexpected event network-vif-plugged-3de77772-78de-4261-b064-d1c2d8e30b31 for instance with vm_state active and task_state rescuing.
Aug 26 23:20:43 user nova-compute[73497]: DEBUG nova.compute.manager [req-e702afe2-0c50-4974-8989-cc35717aa443 req-120b14cc-0f84-4d44-8b14-ff9cc63252df service nova] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Received event network-changed-a712145b-99c7-4279-b125-c98565a252f2 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG nova.compute.manager [req-e702afe2-0c50-4974-8989-cc35717aa443 req-120b14cc-0f84-4d44-8b14-ff9cc63252df service nova] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Refreshing instance network info cache due to event network-changed-a712145b-99c7-4279-b125-c98565a252f2. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-e702afe2-0c50-4974-8989-cc35717aa443 req-120b14cc-0f84-4d44-8b14-ff9cc63252df service nova] Acquiring lock "refresh_cache-bde0a05a-a075-4298-907e-cb00798c90af" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-e702afe2-0c50-4974-8989-cc35717aa443 req-120b14cc-0f84-4d44-8b14-ff9cc63252df service nova] Acquired lock "refresh_cache-bde0a05a-a075-4298-907e-cb00798c90af" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG nova.network.neutron [req-e702afe2-0c50-4974-8989-cc35717aa443 req-120b14cc-0f84-4d44-8b14-ff9cc63252df service nova] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Refreshing network info cache for port a712145b-99c7-4279-b125-c98565a252f2 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] No VIF found with MAC fa:16:3e:c7:e6:d8, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG nova.network.neutron [req-e702afe2-0c50-4974-8989-cc35717aa443 req-120b14cc-0f84-4d44-8b14-ff9cc63252df service nova] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Updated VIF entry in instance network info cache for port a712145b-99c7-4279-b125-c98565a252f2. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG nova.network.neutron [req-e702afe2-0c50-4974-8989-cc35717aa443 req-120b14cc-0f84-4d44-8b14-ff9cc63252df service nova] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Updating instance_info_cache with network_info: [{"id": "a712145b-99c7-4279-b125-c98565a252f2", "address": "fa:16:3e:c7:e6:d8", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa712145b-99", "ovs_interfaceid": "a712145b-99c7-4279-b125-c98565a252f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:20:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-e702afe2-0c50-4974-8989-cc35717aa443 req-120b14cc-0f84-4d44-8b14-ff9cc63252df service nova] Releasing lock "refresh_cache-bde0a05a-a075-4298-907e-cb00798c90af" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:20:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:44 user nova-compute[73497]: DEBUG nova.compute.manager [req-9ee5c180-f691-4fb2-9239-ad496475fa35 req-38f84489-52ae-4354-8df5-b9b83c516294 service nova] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Received event network-vif-plugged-a712145b-99c7-4279-b125-c98565a252f2 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:20:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9ee5c180-f691-4fb2-9239-ad496475fa35 req-38f84489-52ae-4354-8df5-b9b83c516294 service nova] Acquiring lock "bde0a05a-a075-4298-907e-cb00798c90af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9ee5c180-f691-4fb2-9239-ad496475fa35 req-38f84489-52ae-4354-8df5-b9b83c516294 service nova] Lock "bde0a05a-a075-4298-907e-cb00798c90af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9ee5c180-f691-4fb2-9239-ad496475fa35 req-38f84489-52ae-4354-8df5-b9b83c516294 service nova] Lock "bde0a05a-a075-4298-907e-cb00798c90af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:44 user nova-compute[73497]: DEBUG nova.compute.manager [req-9ee5c180-f691-4fb2-9239-ad496475fa35 req-38f84489-52ae-4354-8df5-b9b83c516294 service nova] [instance: bde0a05a-a075-4298-907e-cb00798c90af] No waiting events found dispatching network-vif-plugged-a712145b-99c7-4279-b125-c98565a252f2 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:20:44 user nova-compute[73497]: WARNING nova.compute.manager [req-9ee5c180-f691-4fb2-9239-ad496475fa35 req-38f84489-52ae-4354-8df5-b9b83c516294 service nova] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Received unexpected event network-vif-plugged-a712145b-99c7-4279-b125-c98565a252f2 for instance with vm_state building and task_state spawning.
Aug 26 23:20:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:45 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:45 user nova-compute[73497]: DEBUG nova.compute.manager [req-cdcecf34-7c61-4084-bc60-f3cbdb59c291 req-6222de3c-9e42-41ca-bcd8-a05643ee51af service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Received event network-vif-plugged-3de77772-78de-4261-b064-d1c2d8e30b31 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:20:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cdcecf34-7c61-4084-bc60-f3cbdb59c291 req-6222de3c-9e42-41ca-bcd8-a05643ee51af service nova] Acquiring lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cdcecf34-7c61-4084-bc60-f3cbdb59c291 req-6222de3c-9e42-41ca-bcd8-a05643ee51af service nova] Lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cdcecf34-7c61-4084-bc60-f3cbdb59c291 req-6222de3c-9e42-41ca-bcd8-a05643ee51af service nova] Lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:45 user nova-compute[73497]: DEBUG nova.compute.manager [req-cdcecf34-7c61-4084-bc60-f3cbdb59c291 req-6222de3c-9e42-41ca-bcd8-a05643ee51af service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] No waiting events found dispatching network-vif-plugged-3de77772-78de-4261-b064-d1c2d8e30b31 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:20:45 user nova-compute[73497]: WARNING nova.compute.manager [req-cdcecf34-7c61-4084-bc60-f3cbdb59c291 req-6222de3c-9e42-41ca-bcd8-a05643ee51af service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Received unexpected event network-vif-plugged-3de77772-78de-4261-b064-d1c2d8e30b31 for instance with vm_state active and task_state rescuing.
Aug 26 23:20:45 user nova-compute[73497]: DEBUG nova.compute.manager [req-cdcecf34-7c61-4084-bc60-f3cbdb59c291 req-6222de3c-9e42-41ca-bcd8-a05643ee51af service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Received event network-vif-plugged-3de77772-78de-4261-b064-d1c2d8e30b31 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:20:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cdcecf34-7c61-4084-bc60-f3cbdb59c291 req-6222de3c-9e42-41ca-bcd8-a05643ee51af service nova] Acquiring lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cdcecf34-7c61-4084-bc60-f3cbdb59c291 req-6222de3c-9e42-41ca-bcd8-a05643ee51af service nova] Lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cdcecf34-7c61-4084-bc60-f3cbdb59c291 req-6222de3c-9e42-41ca-bcd8-a05643ee51af service nova] Lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:45 user nova-compute[73497]: DEBUG nova.compute.manager [req-cdcecf34-7c61-4084-bc60-f3cbdb59c291 req-6222de3c-9e42-41ca-bcd8-a05643ee51af service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] No waiting events found dispatching network-vif-plugged-3de77772-78de-4261-b064-d1c2d8e30b31 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:20:45 user nova-compute[73497]: WARNING nova.compute.manager [req-cdcecf34-7c61-4084-bc60-f3cbdb59c291 req-6222de3c-9e42-41ca-bcd8-a05643ee51af service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Received unexpected event network-vif-plugged-3de77772-78de-4261-b064-d1c2d8e30b31 for instance with vm_state active and task_state rescuing.
Aug 26 23:20:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Removed pending event for e9e5c83f-0678-48d4-a81f-1a3f959aabcf due to event {{(pid=73497) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 23:20:46 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092046.3850331, e9e5c83f-0678-48d4-a81f-1a3f959aabcf => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:20:46 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] VM Resumed (Lifecycle Event)
Aug 26 23:20:46 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e56bc46a-f786-4cc6-b5c1-fe6ec7575a8e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:20:46 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:20:46 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:20:46 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 23:20:46 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092046.3882034, e9e5c83f-0678-48d4-a81f-1a3f959aabcf => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:20:46 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] VM Started (Lifecycle Event)
Aug 26 23:20:46 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:20:46 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:20:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:46 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.compute.manager [req-3f516896-e101-4976-a809-26e4a3334c34 req-d0d8e9ef-1666-488c-99b7-fc6aec5bc861 service nova] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Received event network-vif-plugged-a712145b-99c7-4279-b125-c98565a252f2 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3f516896-e101-4976-a809-26e4a3334c34 req-d0d8e9ef-1666-488c-99b7-fc6aec5bc861 service nova] Acquiring lock "bde0a05a-a075-4298-907e-cb00798c90af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3f516896-e101-4976-a809-26e4a3334c34 req-d0d8e9ef-1666-488c-99b7-fc6aec5bc861 service nova] Lock "bde0a05a-a075-4298-907e-cb00798c90af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3f516896-e101-4976-a809-26e4a3334c34 req-d0d8e9ef-1666-488c-99b7-fc6aec5bc861 service nova] Lock "bde0a05a-a075-4298-907e-cb00798c90af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.compute.manager [req-3f516896-e101-4976-a809-26e4a3334c34 req-d0d8e9ef-1666-488c-99b7-fc6aec5bc861 service nova] [instance: bde0a05a-a075-4298-907e-cb00798c90af] No waiting events found dispatching network-vif-plugged-a712145b-99c7-4279-b125-c98565a252f2 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:20:47 user nova-compute[73497]: WARNING nova.compute.manager [req-3f516896-e101-4976-a809-26e4a3334c34 req-d0d8e9ef-1666-488c-99b7-fc6aec5bc861 service nova] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Received unexpected event network-vif-plugged-a712145b-99c7-4279-b125-c98565a252f2 for instance with vm_state building and task_state spawning.
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092047.0846663, bde0a05a-a075-4298-907e-cb00798c90af => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:20:47 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: bde0a05a-a075-4298-907e-cb00798c90af] VM Resumed (Lifecycle Event)
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.compute.manager [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:20:47 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Instance spawned successfully.
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Starting finish_migration {{(pid=73497) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Instance directory exists: not creating {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 23:20:47 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Creating image(s)
Aug 26 23:20:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:20:47 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: bde0a05a-a075-4298-907e-cb00798c90af] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092047.0853648, bde0a05a-a075-4298-907e-cb00798c90af => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:20:47 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: bde0a05a-a075-4298-907e-cb00798c90af] VM Started (Lifecycle Event)
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.191s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk. size=21474836480 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:47 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: bde0a05a-a075-4298-907e-cb00798c90af] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:20:47 user nova-compute[73497]: INFO nova.compute.manager [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Took 8.01 seconds to spawn the instance on the hypervisor.
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.compute.manager [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:20:47 user nova-compute[73497]: INFO nova.compute.manager [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Took 8.95 seconds to build instance.
Aug 26 23:20:47 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-97af5770-cfe3-40d4-bc4b-350287ee43e9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "bde0a05a-a075-4298-907e-cb00798c90af" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.066s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk 21474836480 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk 21474836480" returned: 0 in 0.055s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Did not create local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Ensure instance console log exists: /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Start _get_guest_xml network_info=[{"id": "61639246-9d84-4629-9666-154897feaeae", "address": "fa:16:3e:56:41:f9", "network": {"id": "108c66fb-49a3-4c69-a3ac-93d9643a1d3e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025099504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2025099504-network", "vif_mac": "fa:16:3e:56:41:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e765258a50d46dea25bfd9c72970eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61639246-9d", "ovs_interfaceid": "61639246-9d84-4629-9666-154897feaeae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a0aaf607-4b69-430a-91a8-921d8126d0a7', 'guest_format': None, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbmOUkyq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ee6283d5-40de-432d-997c-0be52ff673ca', 'attached_at': '2023-08-26T23:20:47.000000', 'detached_at': '', 'volume_id': 'a1647697-14cc-47fd-a9c1-003e0115159c', 'serial': 'a1647697-14cc-47fd-a9c1-003e0115159c'}, 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:20:47 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:20:47 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbmOUkyq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:20:47 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:20:47 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:20:47 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:20:47 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:20:47 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:20:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a5575c-c166-4a87-aa02-839f2d74282b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:20:47 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.034s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ff7f06-17f1-4da7-a111-eabda7de974f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c] added
Aug 26 23:20:47 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[142735dd-b196-4380-a6c1-a895a1391154]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7001df-ae85-4248-a7d7-94ab0d9bfe39]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BbmOUkyq {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BbmOUkyq" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bdc3f0-6daa-43e8-b906-3cdddb6397ec]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BbmOUkyq'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[951d2f52-4c81-41b5-b569-3751aff77c46]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d78cc74-a1bd-4b2f-9aab-b9f1179eb9a2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:20:47 user nova-compute[73497]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:20:47 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:20:47 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:20:47 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:20:47 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:20:47 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:20:47 user nova-compute[73497]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:20:47 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:20:47 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:20:47 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:20:47 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:20:47 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:20:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:48 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da4b77c-1b3e-4e27-bd20-0fe453d17780]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:48 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c, portal: 172.16.0.220,3260]
Aug 26 23:20:48 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c, portal: 172.16.0.220,3260] successful.
Aug 26 23:20:48 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:48 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccff9ae-9780-4e12-bc64-df5174c6ded7]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:48 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:20:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:48 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ff1622-1102-4652-bad7-b42c339ec4ac]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:48 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:20:48 user nova-compute[73497]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:20:48 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:20:48 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:20:48 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:20:48 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:20:48 user nova-compute[73497]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:20:48 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:20:48 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:20:48 user nova-compute[73497]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:20:48 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:20:48 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:20:48 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:20:48 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:20:48 user nova-compute[73497]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:20:48 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:20:48 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:20:48 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:20:48 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] HCTL ('38', '-', '-', 0) found on session 22 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:20:48 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:20:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:48 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19b50e9-c18e-4f56-bb0f-26b503fdb10f]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:20:48 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Searching for a device in session 22 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:20:48 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbmOUkyq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:20:48 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:20:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '23335303436633232', 'path': '/dev/sdg'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:20:49 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335303436633232', 'path': '/dev/sdg'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:20:49 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:16:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-956611518',display_name='tempest-ServerActionsTestOtherB-server-956611518',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-956611518',id=13,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqify97xxdfMwMioKw2wicMrkUmyII/F1wNcYn2coMZNsxaRCqyQGjP8va1kHwD6Z9ddCdHd23iUWPYbjiNJPdJt82WzvrKCaPX0PtGf0585mA5lLDP0NEIbnQp6LuyOw==',key_name='tempest-keypair-800864699',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:16:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1e765258a50d46dea25bfd9c72970eb9',ramdisk_id='',reservation_id='r-owyjaonv',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-435374476',owner_user_name='tempest-ServerActionsTestOtherB-435374476-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:20:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd09339d0e1d46d4a268f6ac8651a9f5',uuid=ee6283d5-40de-432d-997c-0be52ff673ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61639246-9d84-4629-9666-154897feaeae", "address": "fa:16:3e:56:41:f9", "network": {"id": "108c66fb-49a3-4c69-a3ac-93d9643a1d3e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025099504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2025099504-network", "vif_mac": "fa:16:3e:56:41:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e765258a50d46dea25bfd9c72970eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61639246-9d", "ovs_interfaceid": "61639246-9d84-4629-9666-154897feaeae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:20:49 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Converting VIF {"id": "61639246-9d84-4629-9666-154897feaeae", "address": "fa:16:3e:56:41:f9", "network": {"id": "108c66fb-49a3-4c69-a3ac-93d9643a1d3e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025099504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2025099504-network", "vif_mac": "fa:16:3e:56:41:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e765258a50d46dea25bfd9c72970eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61639246-9d", "ovs_interfaceid": "61639246-9d84-4629-9666-154897feaeae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:20:49 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=61639246-9d84-4629-9666-154897feaeae,network=Network(108c66fb-49a3-4c69-a3ac-93d9643a1d3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61639246-9d') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:20:49 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:20:49 user nova-compute[73497]:   <uuid>ee6283d5-40de-432d-997c-0be52ff673ca</uuid>
Aug 26 23:20:49 user nova-compute[73497]:   <name>instance-0000000d</name>
Aug 26 23:20:49 user nova-compute[73497]:   <memory>2097152</memory>
Aug 26 23:20:49 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:20:49 user nova-compute[73497]:   <metadata>
Aug 26 23:20:49 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:20:49 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:20:49 user nova-compute[73497]:       <nova:name>tempest-ServerActionsTestOtherB-server-956611518</nova:name>
Aug 26 23:20:49 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:20:47</nova:creationTime>
Aug 26 23:20:49 user nova-compute[73497]:       <nova:flavor name="m1.small">
Aug 26 23:20:49 user nova-compute[73497]:         <nova:memory>2048</nova:memory>
Aug 26 23:20:49 user nova-compute[73497]:         <nova:disk>20</nova:disk>
Aug 26 23:20:49 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:20:49 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:20:49 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:20:49 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:20:49 user nova-compute[73497]:       <nova:owner>
Aug 26 23:20:49 user nova-compute[73497]:         <nova:user uuid="cd09339d0e1d46d4a268f6ac8651a9f5">tempest-ServerActionsTestOtherB-435374476-project-member</nova:user>
Aug 26 23:20:49 user nova-compute[73497]:         <nova:project uuid="1e765258a50d46dea25bfd9c72970eb9">tempest-ServerActionsTestOtherB-435374476</nova:project>
Aug 26 23:20:49 user nova-compute[73497]:       </nova:owner>
Aug 26 23:20:49 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:20:49 user nova-compute[73497]:       <nova:ports>
Aug 26 23:20:49 user nova-compute[73497]:         <nova:port uuid="61639246-9d84-4629-9666-154897feaeae">
Aug 26 23:20:49 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 23:20:49 user nova-compute[73497]:         </nova:port>
Aug 26 23:20:49 user nova-compute[73497]:       </nova:ports>
Aug 26 23:20:49 user nova-compute[73497]:     </nova:instance>
Aug 26 23:20:49 user nova-compute[73497]:   </metadata>
Aug 26 23:20:49 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:20:49 user nova-compute[73497]:     <system>
Aug 26 23:20:49 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:20:49 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:20:49 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:20:49 user nova-compute[73497]:       <entry name="serial">ee6283d5-40de-432d-997c-0be52ff673ca</entry>
Aug 26 23:20:49 user nova-compute[73497]:       <entry name="uuid">ee6283d5-40de-432d-997c-0be52ff673ca</entry>
Aug 26 23:20:49 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:20:49 user nova-compute[73497]:     </system>
Aug 26 23:20:49 user nova-compute[73497]:   </sysinfo>
Aug 26 23:20:49 user nova-compute[73497]:   <os>
Aug 26 23:20:49 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:20:49 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:20:49 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:20:49 user nova-compute[73497]:   </os>
Aug 26 23:20:49 user nova-compute[73497]:   <features>
Aug 26 23:20:49 user nova-compute[73497]:     <acpi/>
Aug 26 23:20:49 user nova-compute[73497]:     <apic/>
Aug 26 23:20:49 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:20:49 user nova-compute[73497]:   </features>
Aug 26 23:20:49 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:20:49 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:20:49 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:20:49 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:20:49 user nova-compute[73497]:   </clock>
Aug 26 23:20:49 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:20:49 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:20:49 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:20:49 user nova-compute[73497]:   </cpu>
Aug 26 23:20:49 user nova-compute[73497]:   <devices>
Aug 26 23:20:49 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:20:49 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:20:49 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk"/>
Aug 26 23:20:49 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:20:49 user nova-compute[73497]:     </disk>
Aug 26 23:20:49 user nova-compute[73497]:     <disk type="block" device="disk">
Aug 26 23:20:49 user nova-compute[73497]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:20:49 user nova-compute[73497]:       <source dev="/dev/sdg"/>
Aug 26 23:20:49 user nova-compute[73497]:       <target dev="vdb" bus="virtio"/>
Aug 26 23:20:49 user nova-compute[73497]:       <serial>a1647697-14cc-47fd-a9c1-003e0115159c</serial>
Aug 26 23:20:49 user nova-compute[73497]:     </disk>
Aug 26 23:20:49 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:20:49 user nova-compute[73497]:       <mac address="fa:16:3e:56:41:f9"/>
Aug 26 23:20:49 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:20:49 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:20:49 user nova-compute[73497]:       <target dev="tap61639246-9d"/>
Aug 26 23:20:49 user nova-compute[73497]:     </interface>
Aug 26 23:20:49 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:20:49 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/console.log" append="off"/>
Aug 26 23:20:49 user nova-compute[73497]:     </serial>
Aug 26 23:20:49 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:20:49 user nova-compute[73497]:     <video>
Aug 26 23:20:49 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:20:49 user nova-compute[73497]:     </video>
Aug 26 23:20:49 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:20:49 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:20:49 user nova-compute[73497]:     </rng>
Aug 26 23:20:49 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:20:49 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:20:49 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:20:49 user nova-compute[73497]:     </memballoon>
Aug 26 23:20:49 user nova-compute[73497]:   </devices>
Aug 26 23:20:49 user nova-compute[73497]: </domain>
Aug 26 23:20:49 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:20:49 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:16:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-956611518',display_name='tempest-ServerActionsTestOtherB-server-956611518',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-956611518',id=13,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqify97xxdfMwMioKw2wicMrkUmyII/F1wNcYn2coMZNsxaRCqyQGjP8va1kHwD6Z9ddCdHd23iUWPYbjiNJPdJt82WzvrKCaPX0PtGf0585mA5lLDP0NEIbnQp6LuyOw==',key_name='tempest-keypair-800864699',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:16:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1e765258a50d46dea25bfd9c72970eb9',ramdisk_id='',reservation_id='r-owyjaonv',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-435374476',owner_user_name='tempest-ServerActionsTestOtherB-435374476-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:20:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd09339d0e1d46d4a268f6ac8651a9f5',uuid=ee6283d5-40de-432d-997c-0be52ff673ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61639246-9d84-4629-9666-154897feaeae", "address": "fa:16:3e:56:41:f9", "network": {"id": "108c66fb-49a3-4c69-a3ac-93d9643a1d3e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025099504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2025099504-network", "vif_mac": "fa:16:3e:56:41:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e765258a50d46dea25bfd9c72970eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61639246-9d", "ovs_interfaceid": "61639246-9d84-4629-9666-154897feaeae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:20:49 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Converting VIF {"id": "61639246-9d84-4629-9666-154897feaeae", "address": "fa:16:3e:56:41:f9", "network": {"id": "108c66fb-49a3-4c69-a3ac-93d9643a1d3e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025099504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2025099504-network", "vif_mac": "fa:16:3e:56:41:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e765258a50d46dea25bfd9c72970eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61639246-9d", "ovs_interfaceid": "61639246-9d84-4629-9666-154897feaeae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:20:49 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=61639246-9d84-4629-9666-154897feaeae,network=Network(108c66fb-49a3-4c69-a3ac-93d9643a1d3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61639246-9d') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:20:49 user nova-compute[73497]: DEBUG os_vif [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=61639246-9d84-4629-9666-154897feaeae,network=Network(108c66fb-49a3-4c69-a3ac-93d9643a1d3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61639246-9d') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:20:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:20:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:20:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61639246-9d, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:20:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap61639246-9d, col_values=(('external_ids', {'iface-id': '61639246-9d84-4629-9666-154897feaeae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:41:f9', 'vm-uuid': 'ee6283d5-40de-432d-997c-0be52ff673ca'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:20:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:20:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:49 user nova-compute[73497]: INFO os_vif [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=61639246-9d84-4629-9666-154897feaeae,network=Network(108c66fb-49a3-4c69-a3ac-93d9643a1d3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61639246-9d')
Aug 26 23:20:49 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:20:49 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:20:49 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] No VIF found with MAC fa:16:3e:56:41:f9, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:20:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:51 user nova-compute[73497]: DEBUG nova.compute.manager [req-456388f4-9494-4549-a287-b4c144a59a09 req-57d51b88-0938-4ad7-b00a-6540c289a616 service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Received event network-vif-plugged-61639246-9d84-4629-9666-154897feaeae {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:20:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-456388f4-9494-4549-a287-b4c144a59a09 req-57d51b88-0938-4ad7-b00a-6540c289a616 service nova] Acquiring lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-456388f4-9494-4549-a287-b4c144a59a09 req-57d51b88-0938-4ad7-b00a-6540c289a616 service nova] Lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-456388f4-9494-4549-a287-b4c144a59a09 req-57d51b88-0938-4ad7-b00a-6540c289a616 service nova] Lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:51 user nova-compute[73497]: DEBUG nova.compute.manager [req-456388f4-9494-4549-a287-b4c144a59a09 req-57d51b88-0938-4ad7-b00a-6540c289a616 service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] No waiting events found dispatching network-vif-plugged-61639246-9d84-4629-9666-154897feaeae {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:20:51 user nova-compute[73497]: WARNING nova.compute.manager [req-456388f4-9494-4549-a287-b4c144a59a09 req-57d51b88-0938-4ad7-b00a-6540c289a616 service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Received unexpected event network-vif-plugged-61639246-9d84-4629-9666-154897feaeae for instance with vm_state active and task_state resize_finish.
Aug 26 23:20:51 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:20:51 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:20:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:52 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:20:53 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:20:53 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:20:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:53 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:20:53 user nova-compute[73497]: DEBUG nova.compute.manager [req-902fb288-95eb-4dcb-8a97-6b1713a90bf9 req-6aeb0cad-2508-450e-a442-6a5560e0f4b8 service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Received event network-vif-plugged-61639246-9d84-4629-9666-154897feaeae {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:20:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-902fb288-95eb-4dcb-8a97-6b1713a90bf9 req-6aeb0cad-2508-450e-a442-6a5560e0f4b8 service nova] Acquiring lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-902fb288-95eb-4dcb-8a97-6b1713a90bf9 req-6aeb0cad-2508-450e-a442-6a5560e0f4b8 service nova] Lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-902fb288-95eb-4dcb-8a97-6b1713a90bf9 req-6aeb0cad-2508-450e-a442-6a5560e0f4b8 service nova] Lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:20:53 user nova-compute[73497]: DEBUG nova.compute.manager [req-902fb288-95eb-4dcb-8a97-6b1713a90bf9 req-6aeb0cad-2508-450e-a442-6a5560e0f4b8 service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] No waiting events found dispatching network-vif-plugged-61639246-9d84-4629-9666-154897feaeae {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:20:53 user nova-compute[73497]: WARNING nova.compute.manager [req-902fb288-95eb-4dcb-8a97-6b1713a90bf9 req-6aeb0cad-2508-450e-a442-6a5560e0f4b8 service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Received unexpected event network-vif-plugged-61639246-9d84-4629-9666-154897feaeae for instance with vm_state active and task_state resize_finish.
Aug 26 23:20:53 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092053.3560097, ee6283d5-40de-432d-997c-0be52ff673ca => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:20:53 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] VM Resumed (Lifecycle Event)
Aug 26 23:20:53 user nova-compute[73497]: DEBUG nova.compute.manager [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:20:53 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Instance running successfully.
Aug 26 23:20:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Failed to set time: agent not configured {{(pid=73497) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 26 23:20:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0bb0c08d-0e90-4035-b5de-4e189fccf63c tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] finish_migration finished successfully. {{(pid=73497) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 26 23:20:53 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:20:53 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:20:53 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 23:20:53 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092053.3607593, ee6283d5-40de-432d-997c-0be52ff673ca => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:20:53 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] VM Started (Lifecycle Event)
Aug 26 23:20:53 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:20:53 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:20:53 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 23:20:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:20:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:20:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:20:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:20:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json" returned: 0 in 0.306s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:20:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bde0a05a-a075-4298-907e-cb00798c90af/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bde0a05a-a075-4298-907e-cb00798c90af/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bde0a05a-a075-4298-907e-cb00798c90af/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bde0a05a-a075-4298-907e-cb00798c90af/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:20:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:20:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:20:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:20:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:20:59 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:20:59 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:20:59 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=7225MB free_disk=25.20966339111328GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:20:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:20:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:20:59 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Applying migration context for instance ee6283d5-40de-432d-997c-0be52ff673ca as it has an incoming, in-progress migration 14136b35-f57f-4887-b829-d288d7ca3655. Migration status is finished {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 23:20:59 user nova-compute[73497]: INFO nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Updating resource usage from migration 14136b35-f57f-4887-b829-d288d7ca3655
Aug 26 23:20:59 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 926f8e5c-8d8a-4f07-bf08-e60700ce4698 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:20:59 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 994093f0-e6b2-4c96-b259-c559ef2b1fbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:20:59 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 171985a3-358d-4b26-a66c-372b9b99b386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:20:59 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance aebaeda6-23d1-43a1-afc8-bdc8992067e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:20:59 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance b68b6975-a24a-4861-a583-406b02446ea0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:20:59 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance ff1085db-4bfc-4c77-a9e4-39f47ffb6d43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:20:59 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 7c124dd9-4dce-4c6f-925c-6eda8e187d84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:20:59 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 4c68f140-4235-4dcb-b99d-1347bc949d15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:20:59 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 043294e5-0618-4a31-bb19-1227ef1f5d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:20:59 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance e9e5c83f-0678-48d4-a81f-1a3f959aabcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:20:59 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 2f46a6a8-a043-455a-98f8-dae359594f56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:20:59 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Migration 14136b35-f57f-4887-b829-d288d7ca3655 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 23:20:59 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance ee6283d5-40de-432d-997c-0be52ff673ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:20:59 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance bde0a05a-a075-4298-907e-cb00798c90af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:20:59 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:20:59 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:21:00 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:21:00 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:21:00 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:21:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.699s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:21:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:02 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:21:02 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:21:02 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:21:02 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:21:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-994093f0-e6b2-4c96-b259-c559ef2b1fbc" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:21:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-994093f0-e6b2-4c96-b259-c559ef2b1fbc" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:21:02 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:21:02 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Updating instance_info_cache with network_info: [{"id": "9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2", "address": "fa:16:3e:b8:5f:1d", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b0aca2b-85", "ovs_interfaceid": "9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:21:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-994093f0-e6b2-4c96-b259-c559ef2b1fbc" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:21:02 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:21:02 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:21:02 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:21:02 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:21:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Acquiring lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:21:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:21:16 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:21:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:21:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:21:16 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:21:16 user nova-compute[73497]: INFO nova.compute.claims [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Claim successful on node user
Aug 26 23:21:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:16 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:21:16 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:21:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.505s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:21:16 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:21:16 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:21:16 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:21:16 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:21:16 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:21:16 user nova-compute[73497]: INFO nova.virt.block_device [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Booting with volume 5a291925-0e24-48cd-bb57-40dc15ac7912 at /dev/vda
Aug 26 23:21:16 user nova-compute[73497]: DEBUG os_brick.utils [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:21:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:16 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4db8a9c-2dd1-417a-8698-16bac2764fdd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:16 user nova-compute[73497]: DEBUG nova.policy [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '30c55eba7b184a4cbf56d776ae544721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3ec8f2aad4d71b65787eabb90dd6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:21:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:16 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a67b804-76ad-4a56-acf9-f8b0850a8b81]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:16 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[728c8d55-9fc4-4b8b-8160-4035a33e7a8a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:16 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5076c88-eab8-402d-a0e5-0e9ec45c2835]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:21:17 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:21:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:21:17 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:21:17 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7659a42e-1ed7-4262-99e1-4f29be204d55]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:17 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:21:17 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:21:17 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:21:17 user nova-compute[73497]: DEBUG os_brick.utils [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:21:17 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Updating existing volume attachment record: 337d578a-1769-4077-ab2e-1bc651e9a276 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:21:17 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Successfully created port: d114632c-d651-4419-9f82-ecaa90cd381b {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:21:18 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Successfully created port: 7c81f6a7-92b5-496b-867f-c10965da8e40 {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:21:18 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Successfully created port: 792a72cb-3624-45eb-a8f7-01cf52196f2d {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:21:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:19 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Successfully created port: 35958938-f4c5-4745-99ca-0f0761fd801c {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:21:20 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Successfully created port: 6361122d-0a82-4b1d-8ea5-dedb8984f15f {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:21:21 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Successfully updated port: d114632c-d651-4419-9f82-ecaa90cd381b {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:21:21 user nova-compute[73497]: DEBUG nova.compute.manager [req-588b5a03-21f0-461c-84f1-7072a69c02be req-382cdb43-d6d3-4bba-b167-2e48ca29c12b service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-changed-d114632c-d651-4419-9f82-ecaa90cd381b {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:21:21 user nova-compute[73497]: DEBUG nova.compute.manager [req-588b5a03-21f0-461c-84f1-7072a69c02be req-382cdb43-d6d3-4bba-b167-2e48ca29c12b service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Refreshing instance network info cache due to event network-changed-d114632c-d651-4419-9f82-ecaa90cd381b. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:21:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-588b5a03-21f0-461c-84f1-7072a69c02be req-382cdb43-d6d3-4bba-b167-2e48ca29c12b service nova] Acquiring lock "refresh_cache-a6c7669c-f338-4e2b-9ba7-96d8e66d10ed" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:21:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-588b5a03-21f0-461c-84f1-7072a69c02be req-382cdb43-d6d3-4bba-b167-2e48ca29c12b service nova] Acquired lock "refresh_cache-a6c7669c-f338-4e2b-9ba7-96d8e66d10ed" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:21:21 user nova-compute[73497]: DEBUG nova.network.neutron [req-588b5a03-21f0-461c-84f1-7072a69c02be req-382cdb43-d6d3-4bba-b167-2e48ca29c12b service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Refreshing network info cache for port d114632c-d651-4419-9f82-ecaa90cd381b {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:21:21 user nova-compute[73497]: DEBUG nova.network.neutron [req-588b5a03-21f0-461c-84f1-7072a69c02be req-382cdb43-d6d3-4bba-b167-2e48ca29c12b service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:21:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:21 user nova-compute[73497]: DEBUG nova.network.neutron [req-588b5a03-21f0-461c-84f1-7072a69c02be req-382cdb43-d6d3-4bba-b167-2e48ca29c12b service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:21:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-588b5a03-21f0-461c-84f1-7072a69c02be req-382cdb43-d6d3-4bba-b167-2e48ca29c12b service nova] Releasing lock "refresh_cache-a6c7669c-f338-4e2b-9ba7-96d8e66d10ed" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:21:22 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Successfully updated port: c268fbf7-6a36-44b5-8361-42160a69b1d4 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:21:22 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Successfully updated port: 372fa1fa-b52b-479a-b228-91eebb1d3e3f {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:21:23 user nova-compute[73497]: DEBUG nova.compute.manager [req-92a3714c-965b-4953-8282-23158b3d24fc req-6da03707-5719-4a53-9b53-8a4f10206553 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-changed-c268fbf7-6a36-44b5-8361-42160a69b1d4 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:21:23 user nova-compute[73497]: DEBUG nova.compute.manager [req-92a3714c-965b-4953-8282-23158b3d24fc req-6da03707-5719-4a53-9b53-8a4f10206553 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Refreshing instance network info cache due to event network-changed-c268fbf7-6a36-44b5-8361-42160a69b1d4. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:21:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-92a3714c-965b-4953-8282-23158b3d24fc req-6da03707-5719-4a53-9b53-8a4f10206553 service nova] Acquiring lock "refresh_cache-a6c7669c-f338-4e2b-9ba7-96d8e66d10ed" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:21:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-92a3714c-965b-4953-8282-23158b3d24fc req-6da03707-5719-4a53-9b53-8a4f10206553 service nova] Acquired lock "refresh_cache-a6c7669c-f338-4e2b-9ba7-96d8e66d10ed" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:21:23 user nova-compute[73497]: DEBUG nova.network.neutron [req-92a3714c-965b-4953-8282-23158b3d24fc req-6da03707-5719-4a53-9b53-8a4f10206553 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Refreshing network info cache for port c268fbf7-6a36-44b5-8361-42160a69b1d4 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:21:23 user nova-compute[73497]: DEBUG nova.network.neutron [req-92a3714c-965b-4953-8282-23158b3d24fc req-6da03707-5719-4a53-9b53-8a4f10206553 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:21:23 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Successfully updated port: 7c81f6a7-92b5-496b-867f-c10965da8e40 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:21:23 user nova-compute[73497]: DEBUG nova.network.neutron [req-92a3714c-965b-4953-8282-23158b3d24fc req-6da03707-5719-4a53-9b53-8a4f10206553 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:21:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-92a3714c-965b-4953-8282-23158b3d24fc req-6da03707-5719-4a53-9b53-8a4f10206553 service nova] Releasing lock "refresh_cache-a6c7669c-f338-4e2b-9ba7-96d8e66d10ed" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:21:23 user nova-compute[73497]: DEBUG nova.compute.manager [req-92a3714c-965b-4953-8282-23158b3d24fc req-6da03707-5719-4a53-9b53-8a4f10206553 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-changed-372fa1fa-b52b-479a-b228-91eebb1d3e3f {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:21:23 user nova-compute[73497]: DEBUG nova.compute.manager [req-92a3714c-965b-4953-8282-23158b3d24fc req-6da03707-5719-4a53-9b53-8a4f10206553 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Refreshing instance network info cache due to event network-changed-372fa1fa-b52b-479a-b228-91eebb1d3e3f. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:21:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-92a3714c-965b-4953-8282-23158b3d24fc req-6da03707-5719-4a53-9b53-8a4f10206553 service nova] Acquiring lock "refresh_cache-a6c7669c-f338-4e2b-9ba7-96d8e66d10ed" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:21:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-92a3714c-965b-4953-8282-23158b3d24fc req-6da03707-5719-4a53-9b53-8a4f10206553 service nova] Acquired lock "refresh_cache-a6c7669c-f338-4e2b-9ba7-96d8e66d10ed" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:21:23 user nova-compute[73497]: DEBUG nova.network.neutron [req-92a3714c-965b-4953-8282-23158b3d24fc req-6da03707-5719-4a53-9b53-8a4f10206553 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Refreshing network info cache for port 372fa1fa-b52b-479a-b228-91eebb1d3e3f {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:21:23 user nova-compute[73497]: DEBUG nova.network.neutron [req-92a3714c-965b-4953-8282-23158b3d24fc req-6da03707-5719-4a53-9b53-8a4f10206553 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:21:24 user nova-compute[73497]: DEBUG nova.network.neutron [req-92a3714c-965b-4953-8282-23158b3d24fc req-6da03707-5719-4a53-9b53-8a4f10206553 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:21:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-92a3714c-965b-4953-8282-23158b3d24fc req-6da03707-5719-4a53-9b53-8a4f10206553 service nova] Releasing lock "refresh_cache-a6c7669c-f338-4e2b-9ba7-96d8e66d10ed" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:21:24 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Successfully updated port: 792a72cb-3624-45eb-a8f7-01cf52196f2d {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:21:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:24 user nova-compute[73497]: DEBUG nova.compute.manager [req-38df82c0-c7b8-4ab0-b8df-1ede46e74f07 req-3cf55444-17ad-41fd-a8d4-b820b98410c9 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-changed-792a72cb-3624-45eb-a8f7-01cf52196f2d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:21:24 user nova-compute[73497]: DEBUG nova.compute.manager [req-38df82c0-c7b8-4ab0-b8df-1ede46e74f07 req-3cf55444-17ad-41fd-a8d4-b820b98410c9 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Refreshing instance network info cache due to event network-changed-792a72cb-3624-45eb-a8f7-01cf52196f2d. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:21:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-38df82c0-c7b8-4ab0-b8df-1ede46e74f07 req-3cf55444-17ad-41fd-a8d4-b820b98410c9 service nova] Acquiring lock "refresh_cache-a6c7669c-f338-4e2b-9ba7-96d8e66d10ed" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:21:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-38df82c0-c7b8-4ab0-b8df-1ede46e74f07 req-3cf55444-17ad-41fd-a8d4-b820b98410c9 service nova] Acquired lock "refresh_cache-a6c7669c-f338-4e2b-9ba7-96d8e66d10ed" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:21:24 user nova-compute[73497]: DEBUG nova.network.neutron [req-38df82c0-c7b8-4ab0-b8df-1ede46e74f07 req-3cf55444-17ad-41fd-a8d4-b820b98410c9 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Refreshing network info cache for port 792a72cb-3624-45eb-a8f7-01cf52196f2d {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:21:24 user nova-compute[73497]: DEBUG nova.network.neutron [req-38df82c0-c7b8-4ab0-b8df-1ede46e74f07 req-3cf55444-17ad-41fd-a8d4-b820b98410c9 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:21:24 user nova-compute[73497]: DEBUG nova.network.neutron [req-38df82c0-c7b8-4ab0-b8df-1ede46e74f07 req-3cf55444-17ad-41fd-a8d4-b820b98410c9 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:21:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-38df82c0-c7b8-4ab0-b8df-1ede46e74f07 req-3cf55444-17ad-41fd-a8d4-b820b98410c9 service nova] Releasing lock "refresh_cache-a6c7669c-f338-4e2b-9ba7-96d8e66d10ed" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:21:25 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Successfully updated port: 35958938-f4c5-4745-99ca-0f0761fd801c {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:21:25 user nova-compute[73497]: DEBUG nova.compute.manager [req-87e2c801-59bc-483e-8bc2-04b793a70623 req-65173465-31b6-49f6-819a-2e0c9b841848 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-changed-7c81f6a7-92b5-496b-867f-c10965da8e40 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:21:25 user nova-compute[73497]: DEBUG nova.compute.manager [req-87e2c801-59bc-483e-8bc2-04b793a70623 req-65173465-31b6-49f6-819a-2e0c9b841848 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Refreshing instance network info cache due to event network-changed-7c81f6a7-92b5-496b-867f-c10965da8e40. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:21:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-87e2c801-59bc-483e-8bc2-04b793a70623 req-65173465-31b6-49f6-819a-2e0c9b841848 service nova] Acquiring lock "refresh_cache-a6c7669c-f338-4e2b-9ba7-96d8e66d10ed" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:21:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-87e2c801-59bc-483e-8bc2-04b793a70623 req-65173465-31b6-49f6-819a-2e0c9b841848 service nova] Acquired lock "refresh_cache-a6c7669c-f338-4e2b-9ba7-96d8e66d10ed" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:21:25 user nova-compute[73497]: DEBUG nova.network.neutron [req-87e2c801-59bc-483e-8bc2-04b793a70623 req-65173465-31b6-49f6-819a-2e0c9b841848 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Refreshing network info cache for port 7c81f6a7-92b5-496b-867f-c10965da8e40 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:21:25 user nova-compute[73497]: DEBUG nova.network.neutron [req-87e2c801-59bc-483e-8bc2-04b793a70623 req-65173465-31b6-49f6-819a-2e0c9b841848 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:21:25 user nova-compute[73497]: DEBUG nova.network.neutron [req-87e2c801-59bc-483e-8bc2-04b793a70623 req-65173465-31b6-49f6-819a-2e0c9b841848 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:21:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-87e2c801-59bc-483e-8bc2-04b793a70623 req-65173465-31b6-49f6-819a-2e0c9b841848 service nova] Releasing lock "refresh_cache-a6c7669c-f338-4e2b-9ba7-96d8e66d10ed" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:21:26 user nova-compute[73497]: DEBUG nova.compute.manager [None req-8a327e67-6e7f-4cb7-88c9-a031e9fa6588 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:21:26 user nova-compute[73497]: INFO nova.compute.manager [None req-8a327e67-6e7f-4cb7-88c9-a031e9fa6588 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] instance snapshotting
Aug 26 23:21:26 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-8a327e67-6e7f-4cb7-88c9-a031e9fa6588 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Beginning live snapshot process
Aug 26 23:21:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8a327e67-6e7f-4cb7-88c9-a031e9fa6588 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk --force-share --output=json -f qcow2 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:26 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Successfully updated port: 6361122d-0a82-4b1d-8ea5-dedb8984f15f {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:21:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Acquiring lock "refresh_cache-a6c7669c-f338-4e2b-9ba7-96d8e66d10ed" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:21:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Acquired lock "refresh_cache-a6c7669c-f338-4e2b-9ba7-96d8e66d10ed" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:21:26 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:21:26 user nova-compute[73497]: DEBUG nova.compute.manager [req-db2c17b4-6f84-41be-bc82-3b78443b3967 req-c34b9165-6661-49ef-b5eb-75260ca6c329 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-changed-35958938-f4c5-4745-99ca-0f0761fd801c {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:21:26 user nova-compute[73497]: DEBUG nova.compute.manager [req-db2c17b4-6f84-41be-bc82-3b78443b3967 req-c34b9165-6661-49ef-b5eb-75260ca6c329 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Refreshing instance network info cache due to event network-changed-35958938-f4c5-4745-99ca-0f0761fd801c. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:21:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-db2c17b4-6f84-41be-bc82-3b78443b3967 req-c34b9165-6661-49ef-b5eb-75260ca6c329 service nova] Acquiring lock "refresh_cache-a6c7669c-f338-4e2b-9ba7-96d8e66d10ed" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:21:26 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:21:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8a327e67-6e7f-4cb7-88c9-a031e9fa6588 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk --force-share --output=json -f qcow2" returned: 0 in 0.277s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8a327e67-6e7f-4cb7-88c9-a031e9fa6588 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk --force-share --output=json -f qcow2 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8a327e67-6e7f-4cb7-88c9-a031e9fa6588 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8a327e67-6e7f-4cb7-88c9-a031e9fa6588 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8a327e67-6e7f-4cb7-88c9-a031e9fa6588 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.178s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8a327e67-6e7f-4cb7-88c9-a031e9fa6588 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpyuserzac/e2485a63e3e9431da97dd87b8655efe7.delta 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8a327e67-6e7f-4cb7-88c9-a031e9fa6588 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpyuserzac/e2485a63e3e9431da97dd87b8655efe7.delta 1073741824" returned: 0 in 0.054s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:27 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-8a327e67-6e7f-4cb7-88c9-a031e9fa6588 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 23:21:27 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-8a327e67-6e7f-4cb7-88c9-a031e9fa6588 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=73497) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 23:21:28 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-8a327e67-6e7f-4cb7-88c9-a031e9fa6588 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73497) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 23:21:28 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-8a327e67-6e7f-4cb7-88c9-a031e9fa6588 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 23:21:28 user nova-compute[73497]: DEBUG nova.privsep.utils [None req-8a327e67-6e7f-4cb7-88c9-a031e9fa6588 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73497) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 23:21:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8a327e67-6e7f-4cb7-88c9-a031e9fa6588 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpyuserzac/e2485a63e3e9431da97dd87b8655efe7.delta /opt/stack/data/nova/instances/snapshots/tmpyuserzac/e2485a63e3e9431da97dd87b8655efe7 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:28 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Updating instance_info_cache with network_info: [{"id": "d114632c-d651-4419-9f82-ecaa90cd381b", "address": "fa:16:3e:7a:e8:f3", "network": {"id": "d6df8ba3-c833-4cf3-8865-2e449087bead", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-54509536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd114632c-d6", "ovs_interfaceid": "d114632c-d651-4419-9f82-ecaa90cd381b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c268fbf7-6a36-44b5-8361-42160a69b1d4", "address": "fa:16:3e:e6:16:95", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc268fbf7-6a", "ovs_interfaceid": "c268fbf7-6a36-44b5-8361-42160a69b1d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "372fa1fa-b52b-479a-b228-91eebb1d3e3f", "address": "fa:16:3e:b0:c0:5e", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372fa1fa-b5", "ovs_interfaceid": "372fa1fa-b52b-479a-b228-91eebb1d3e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7c81f6a7-92b5-496b-867f-c10965da8e40", "address": "fa:16:3e:8e:33:9e", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c81f6a7-92", "ovs_interfaceid": "7c81f6a7-92b5-496b-867f-c10965da8e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "792a72cb-3624-45eb-a8f7-01cf52196f2d", "address": "fa:16:3e:73:4e:ac", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap792a72cb-36", "ovs_interfaceid": "792a72cb-3624-45eb-a8f7-01cf52196f2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "35958938-f4c5-4745-99ca-0f0761fd801c", "address": "fa:16:3e:d2:d0:65", "network": {"id": "15044bd5-0863-41a2-ad57-abbdad59baa3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1012445693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35958938-f4", "ovs_interfaceid": "35958938-f4c5-4745-99ca-0f0761fd801c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6361122d-0a82-4b1d-8ea5-dedb8984f15f", "address": "fa:16:3e:e1:fa:e3", "network": {"id": "15044bd5-0863-41a2-ad57-abbdad59baa3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1012445693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6361122d-0a", "ovs_interfaceid": "6361122d-0a82-4b1d-8ea5-dedb8984f15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:21:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Releasing lock "refresh_cache-a6c7669c-f338-4e2b-9ba7-96d8e66d10ed" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:21:28 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Instance network_info: |[{"id": "d114632c-d651-4419-9f82-ecaa90cd381b", "address": "fa:16:3e:7a:e8:f3", "network": {"id": "d6df8ba3-c833-4cf3-8865-2e449087bead", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-54509536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd114632c-d6", "ovs_interfaceid": "d114632c-d651-4419-9f82-ecaa90cd381b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c268fbf7-6a36-44b5-8361-42160a69b1d4", "address": "fa:16:3e:e6:16:95", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc268fbf7-6a", "ovs_interfaceid": "c268fbf7-6a36-44b5-8361-42160a69b1d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "372fa1fa-b52b-479a-b228-91eebb1d3e3f", "address": "fa:16:3e:b0:c0:5e", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372fa1fa-b5", "ovs_interfaceid": "372fa1fa-b52b-479a-b228-91eebb1d3e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7c81f6a7-92b5-496b-867f-c10965da8e40", "address": "fa:16:3e:8e:33:9e", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c81f6a7-92", "ovs_interfaceid": "7c81f6a7-92b5-496b-867f-c10965da8e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "792a72cb-3624-45eb-a8f7-01cf52196f2d", "address": "fa:16:3e:73:4e:ac", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap792a72cb-36", "ovs_interfaceid": "792a72cb-3624-45eb-a8f7-01cf52196f2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "35958938-f4c5-4745-99ca-0f0761fd801c", "address": "fa:16:3e:d2:d0:65", "network": {"id": "15044bd5-0863-41a2-ad57-abbdad59baa3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1012445693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35958938-f4", "ovs_interfaceid": "35958938-f4c5-4745-99ca-0f0761fd801c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6361122d-0a82-4b1d-8ea5-dedb8984f15f", "address": "fa:16:3e:e1:fa:e3", "network": {"id": "15044bd5-0863-41a2-ad57-abbdad59baa3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1012445693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6361122d-0a", "ovs_interfaceid": "6361122d-0a82-4b1d-8ea5-dedb8984f15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:21:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-db2c17b4-6f84-41be-bc82-3b78443b3967 req-c34b9165-6661-49ef-b5eb-75260ca6c329 service nova] Acquired lock "refresh_cache-a6c7669c-f338-4e2b-9ba7-96d8e66d10ed" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:21:28 user nova-compute[73497]: DEBUG nova.network.neutron [req-db2c17b4-6f84-41be-bc82-3b78443b3967 req-c34b9165-6661-49ef-b5eb-75260ca6c329 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Refreshing network info cache for port 35958938-f4c5-4745-99ca-0f0761fd801c {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:21:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8a327e67-6e7f-4cb7-88c9-a031e9fa6588 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpyuserzac/e2485a63e3e9431da97dd87b8655efe7.delta /opt/stack/data/nova/instances/snapshots/tmpyuserzac/e2485a63e3e9431da97dd87b8655efe7" returned: 0 in 0.341s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:28 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-8a327e67-6e7f-4cb7-88c9-a031e9fa6588 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Snapshot extracted, beginning image upload
Aug 26 23:21:29 user nova-compute[73497]: DEBUG nova.network.neutron [req-db2c17b4-6f84-41be-bc82-3b78443b3967 req-c34b9165-6661-49ef-b5eb-75260ca6c329 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Updated VIF entry in instance network info cache for port 35958938-f4c5-4745-99ca-0f0761fd801c. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:21:29 user nova-compute[73497]: DEBUG nova.network.neutron [req-db2c17b4-6f84-41be-bc82-3b78443b3967 req-c34b9165-6661-49ef-b5eb-75260ca6c329 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Updating instance_info_cache with network_info: [{"id": "d114632c-d651-4419-9f82-ecaa90cd381b", "address": "fa:16:3e:7a:e8:f3", "network": {"id": "d6df8ba3-c833-4cf3-8865-2e449087bead", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-54509536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd114632c-d6", "ovs_interfaceid": "d114632c-d651-4419-9f82-ecaa90cd381b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c268fbf7-6a36-44b5-8361-42160a69b1d4", "address": "fa:16:3e:e6:16:95", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc268fbf7-6a", "ovs_interfaceid": "c268fbf7-6a36-44b5-8361-42160a69b1d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "372fa1fa-b52b-479a-b228-91eebb1d3e3f", "address": "fa:16:3e:b0:c0:5e", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372fa1fa-b5", "ovs_interfaceid": "372fa1fa-b52b-479a-b228-91eebb1d3e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7c81f6a7-92b5-496b-867f-c10965da8e40", "address": "fa:16:3e:8e:33:9e", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c81f6a7-92", "ovs_interfaceid": "7c81f6a7-92b5-496b-867f-c10965da8e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "792a72cb-3624-45eb-a8f7-01cf52196f2d", "address": "fa:16:3e:73:4e:ac", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap792a72cb-36", "ovs_interfaceid": "792a72cb-3624-45eb-a8f7-01cf52196f2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "35958938-f4c5-4745-99ca-0f0761fd801c", "address": "fa:16:3e:d2:d0:65", "network": {"id": "15044bd5-0863-41a2-ad57-abbdad59baa3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1012445693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35958938-f4", "ovs_interfaceid": "35958938-f4c5-4745-99ca-0f0761fd801c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6361122d-0a82-4b1d-8ea5-dedb8984f15f", "address": "fa:16:3e:e1:fa:e3", "network": {"id": "15044bd5-0863-41a2-ad57-abbdad59baa3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1012445693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6361122d-0a", "ovs_interfaceid": "6361122d-0a82-4b1d-8ea5-dedb8984f15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:21:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-db2c17b4-6f84-41be-bc82-3b78443b3967 req-c34b9165-6661-49ef-b5eb-75260ca6c329 service nova] Releasing lock "refresh_cache-a6c7669c-f338-4e2b-9ba7-96d8e66d10ed" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:21:29 user nova-compute[73497]: DEBUG nova.compute.manager [req-db2c17b4-6f84-41be-bc82-3b78443b3967 req-c34b9165-6661-49ef-b5eb-75260ca6c329 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-changed-6361122d-0a82-4b1d-8ea5-dedb8984f15f {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:21:29 user nova-compute[73497]: DEBUG nova.compute.manager [req-db2c17b4-6f84-41be-bc82-3b78443b3967 req-c34b9165-6661-49ef-b5eb-75260ca6c329 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Refreshing instance network info cache due to event network-changed-6361122d-0a82-4b1d-8ea5-dedb8984f15f. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:21:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-db2c17b4-6f84-41be-bc82-3b78443b3967 req-c34b9165-6661-49ef-b5eb-75260ca6c329 service nova] Acquiring lock "refresh_cache-a6c7669c-f338-4e2b-9ba7-96d8e66d10ed" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:21:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-db2c17b4-6f84-41be-bc82-3b78443b3967 req-c34b9165-6661-49ef-b5eb-75260ca6c329 service nova] Acquired lock "refresh_cache-a6c7669c-f338-4e2b-9ba7-96d8e66d10ed" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:21:29 user nova-compute[73497]: DEBUG nova.network.neutron [req-db2c17b4-6f84-41be-bc82-3b78443b3967 req-c34b9165-6661-49ef-b5eb-75260ca6c329 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Refreshing network info cache for port 6361122d-0a82-4b1d-8ea5-dedb8984f15f {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:21:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:29 user nova-compute[73497]: DEBUG nova.network.neutron [req-db2c17b4-6f84-41be-bc82-3b78443b3967 req-c34b9165-6661-49ef-b5eb-75260ca6c329 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Updated VIF entry in instance network info cache for port 6361122d-0a82-4b1d-8ea5-dedb8984f15f. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:21:29 user nova-compute[73497]: DEBUG nova.network.neutron [req-db2c17b4-6f84-41be-bc82-3b78443b3967 req-c34b9165-6661-49ef-b5eb-75260ca6c329 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Updating instance_info_cache with network_info: [{"id": "d114632c-d651-4419-9f82-ecaa90cd381b", "address": "fa:16:3e:7a:e8:f3", "network": {"id": "d6df8ba3-c833-4cf3-8865-2e449087bead", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-54509536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd114632c-d6", "ovs_interfaceid": "d114632c-d651-4419-9f82-ecaa90cd381b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c268fbf7-6a36-44b5-8361-42160a69b1d4", "address": "fa:16:3e:e6:16:95", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc268fbf7-6a", "ovs_interfaceid": "c268fbf7-6a36-44b5-8361-42160a69b1d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "372fa1fa-b52b-479a-b228-91eebb1d3e3f", "address": "fa:16:3e:b0:c0:5e", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372fa1fa-b5", "ovs_interfaceid": "372fa1fa-b52b-479a-b228-91eebb1d3e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7c81f6a7-92b5-496b-867f-c10965da8e40", "address": "fa:16:3e:8e:33:9e", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c81f6a7-92", "ovs_interfaceid": "7c81f6a7-92b5-496b-867f-c10965da8e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "792a72cb-3624-45eb-a8f7-01cf52196f2d", "address": "fa:16:3e:73:4e:ac", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap792a72cb-36", "ovs_interfaceid": "792a72cb-3624-45eb-a8f7-01cf52196f2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "35958938-f4c5-4745-99ca-0f0761fd801c", "address": "fa:16:3e:d2:d0:65", "network": {"id": "15044bd5-0863-41a2-ad57-abbdad59baa3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1012445693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35958938-f4", "ovs_interfaceid": "35958938-f4c5-4745-99ca-0f0761fd801c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6361122d-0a82-4b1d-8ea5-dedb8984f15f", "address": "fa:16:3e:e1:fa:e3", "network": {"id": "15044bd5-0863-41a2-ad57-abbdad59baa3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1012445693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6361122d-0a", "ovs_interfaceid": "6361122d-0a82-4b1d-8ea5-dedb8984f15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:21:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-db2c17b4-6f84-41be-bc82-3b78443b3967 req-c34b9165-6661-49ef-b5eb-75260ca6c329 service nova] Releasing lock "refresh_cache-a6c7669c-f338-4e2b-9ba7-96d8e66d10ed" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:21:29 user nova-compute[73497]: INFO nova.virt.block_device [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Booting with volume 6da56445-077b-42eb-90ee-12eba93589a3 at /dev/vdb
Aug 26 23:21:29 user nova-compute[73497]: DEBUG os_brick.utils [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:21:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:29 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a05e54c-faf4-46c6-ba95-0da5d1acb0ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:29 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d24b7cc-9c1a-4228-a943-65b3a56a5353]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:29 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f0f011-0217-419b-985d-e50ab626a2a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:29 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e0b292-2d24-44d9-8dc8-9ec5f33c2da2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:21:29 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:21:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:21:29 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:21:29 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2786d02-fa7f-4903-bc2b-fb8938c073da]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:29 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:21:29 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:21:29 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:21:29 user nova-compute[73497]: DEBUG os_brick.utils [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:21:29 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Updating existing volume attachment record: b32e2a1f-6342-437c-bdb3-3a941b1f98d9 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:21:31 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-8a327e67-6e7f-4cb7-88c9-a031e9fa6588 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Snapshot image upload complete
Aug 26 23:21:31 user nova-compute[73497]: INFO nova.compute.manager [None req-8a327e67-6e7f-4cb7-88c9-a031e9fa6588 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Took 5.02 seconds to snapshot the instance on the hypervisor.
Aug 26 23:21:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "c601f97e-9e52-40c6-9085-45f38e709721" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:21:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "c601f97e-9e52-40c6-9085-45f38e709721" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:21:31 user nova-compute[73497]: DEBUG nova.compute.manager [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:21:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:21:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:21:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:21:31 user nova-compute[73497]: INFO nova.compute.claims [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Claim successful on node user
Aug 26 23:21:32 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:21:32 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:21:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.648s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:21:32 user nova-compute[73497]: DEBUG nova.compute.manager [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:21:32 user nova-compute[73497]: DEBUG nova.compute.manager [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:21:32 user nova-compute[73497]: DEBUG nova.network.neutron [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:21:32 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:21:32 user nova-compute[73497]: DEBUG nova.compute.manager [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:21:32 user nova-compute[73497]: DEBUG nova.policy [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '83005131fdc2411abe7a198157910743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee8ef1c899342b38a624c1c28309d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:21:32 user nova-compute[73497]: DEBUG nova.compute.manager [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:21:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:21:32 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Creating image(s)
Aug 26 23:21:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "/opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:21:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "/opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:21:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "/opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:21:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.217s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:21:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:21:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.207s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Acquiring lock "244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:21:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:21:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk 1073741824" returned: 0 in 0.067s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:21:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:33 user nova-compute[73497]: DEBUG nova.compute.manager [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:21:33 user nova-compute[73497]: DEBUG nova.network.neutron [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Successfully created port: 628385fc-dbf3-4ae6-87d8-fe1678966a73 {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:21:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:21:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:21:33 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:21:33 user nova-compute[73497]: INFO nova.compute.claims [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Claim successful on node user
Aug 26 23:21:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.202s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:33 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:21:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:33 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Cannot resize image /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:21:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:21:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Ensure instance console log exists: /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:21:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:21:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:21:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:21:34 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:21:34 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:21:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.842s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:21:34 user nova-compute[73497]: DEBUG nova.compute.manager [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:21:34 user nova-compute[73497]: DEBUG nova.compute.manager [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:21:34 user nova-compute[73497]: DEBUG nova.network.neutron [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:21:34 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:21:34 user nova-compute[73497]: DEBUG nova.network.neutron [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Successfully updated port: 628385fc-dbf3-4ae6-87d8-fe1678966a73 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:21:34 user nova-compute[73497]: DEBUG nova.compute.manager [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:21:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "refresh_cache-c601f97e-9e52-40c6-9085-45f38e709721" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:21:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquired lock "refresh_cache-c601f97e-9e52-40c6-9085-45f38e709721" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:21:34 user nova-compute[73497]: DEBUG nova.network.neutron [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:21:34 user nova-compute[73497]: DEBUG nova.compute.manager [req-62d3818e-7200-492d-bb37-c2bf75afad24 req-1628cb82-0406-4b34-96de-71d38dd12195 service nova] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Received event network-changed-628385fc-dbf3-4ae6-87d8-fe1678966a73 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:21:34 user nova-compute[73497]: DEBUG nova.compute.manager [req-62d3818e-7200-492d-bb37-c2bf75afad24 req-1628cb82-0406-4b34-96de-71d38dd12195 service nova] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Refreshing instance network info cache due to event network-changed-628385fc-dbf3-4ae6-87d8-fe1678966a73. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:21:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-62d3818e-7200-492d-bb37-c2bf75afad24 req-1628cb82-0406-4b34-96de-71d38dd12195 service nova] Acquiring lock "refresh_cache-c601f97e-9e52-40c6-9085-45f38e709721" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:21:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:21:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:21:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:21:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:21:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:34 user nova-compute[73497]: DEBUG nova.policy [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e79225b05f24fb89cb3537ec6d983d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a539515b1f47d39d42e182bef80e63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:21:34 user nova-compute[73497]: DEBUG nova.network.neutron [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:21:34 user nova-compute[73497]: DEBUG nova.compute.manager [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:21:34 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:21:34 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Creating image(s)
Aug 26 23:21:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Acquiring lock "/opt/stack/data/nova/instances/244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:21:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "/opt/stack/data/nova/instances/244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:21:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "/opt/stack/data/nova/instances/244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:21:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Acquiring lock "f56ba919411ad91408e2d93c58a1f340e4bd8b77" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:21:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "f56ba919411ad91408e2d93c58a1f340e4bd8b77" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f56ba919411ad91408e2d93c58a1f340e4bd8b77.part --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG nova.network.neutron [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Successfully created port: efa7322e-6cca-40b1-9667-83d76383e165 {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG nova.network.neutron [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Updating instance_info_cache with network_info: [{"id": "628385fc-dbf3-4ae6-87d8-fe1678966a73", "address": "fa:16:3e:c0:51:9f", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap628385fc-db", "ovs_interfaceid": "628385fc-dbf3-4ae6-87d8-fe1678966a73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Releasing lock "refresh_cache-c601f97e-9e52-40c6-9085-45f38e709721" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG nova.compute.manager [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Instance network_info: |[{"id": "628385fc-dbf3-4ae6-87d8-fe1678966a73", "address": "fa:16:3e:c0:51:9f", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap628385fc-db", "ovs_interfaceid": "628385fc-dbf3-4ae6-87d8-fe1678966a73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-62d3818e-7200-492d-bb37-c2bf75afad24 req-1628cb82-0406-4b34-96de-71d38dd12195 service nova] Acquired lock "refresh_cache-c601f97e-9e52-40c6-9085-45f38e709721" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG nova.network.neutron [req-62d3818e-7200-492d-bb37-c2bf75afad24 req-1628cb82-0406-4b34-96de-71d38dd12195 service nova] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Refreshing network info cache for port 628385fc-dbf3-4ae6-87d8-fe1678966a73 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Start _get_guest_xml network_info=[{"id": "628385fc-dbf3-4ae6-87d8-fe1678966a73", "address": "fa:16:3e:c0:51:9f", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap628385fc-db", "ovs_interfaceid": "628385fc-dbf3-4ae6-87d8-fe1678966a73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:21:35 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:21:35 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:21:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f56ba919411ad91408e2d93c58a1f340e4bd8b77.part --force-share --output=json" returned: 0 in 0.188s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG nova.virt.images [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] d9778fd8-4597-4905-9763-d2396509a33e was qcow2, converting to raw {{(pid=73497) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG nova.privsep.utils [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73497) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f56ba919411ad91408e2d93c58a1f340e4bd8b77.part /opt/stack/data/nova/instances/_base/f56ba919411ad91408e2d93c58a1f340e4bd8b77.converted {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:21:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1232471816',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1232471816',id=24,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ee8ef1c899342b38a624c1c28309d41',ramdisk_id='',reservation_id='r-offwgzp4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1276656289',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:21:33Z,user_data=None,user_id='83005131fdc2411abe7a198157910743',uuid=c601f97e-9e52-40c6-9085-45f38e709721,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "628385fc-dbf3-4ae6-87d8-fe1678966a73", "address": "fa:16:3e:c0:51:9f", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap628385fc-db", "ovs_interfaceid": "628385fc-dbf3-4ae6-87d8-fe1678966a73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Converting VIF {"id": "628385fc-dbf3-4ae6-87d8-fe1678966a73", "address": "fa:16:3e:c0:51:9f", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap628385fc-db", "ovs_interfaceid": "628385fc-dbf3-4ae6-87d8-fe1678966a73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:51:9f,bridge_name='br-int',has_traffic_filtering=True,id=628385fc-dbf3-4ae6-87d8-fe1678966a73,network=Network(f8ba0a6b-e4fc-4236-9df3-90ffab8824fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap628385fc-db') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG nova.objects.instance [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lazy-loading 'pci_devices' on Instance uuid c601f97e-9e52-40c6-9085-45f38e709721 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:21:35 user nova-compute[73497]:   <uuid>c601f97e-9e52-40c6-9085-45f38e709721</uuid>
Aug 26 23:21:35 user nova-compute[73497]:   <name>instance-00000018</name>
Aug 26 23:21:35 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:21:35 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:21:35 user nova-compute[73497]:   <metadata>
Aug 26 23:21:35 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:21:35 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:21:35 user nova-compute[73497]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1232471816</nova:name>
Aug 26 23:21:35 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:21:35</nova:creationTime>
Aug 26 23:21:35 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:21:35 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:21:35 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:21:35 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:21:35 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:21:35 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:21:35 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:21:35 user nova-compute[73497]:       <nova:owner>
Aug 26 23:21:35 user nova-compute[73497]:         <nova:user uuid="83005131fdc2411abe7a198157910743">tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member</nova:user>
Aug 26 23:21:35 user nova-compute[73497]:         <nova:project uuid="3ee8ef1c899342b38a624c1c28309d41">tempest-ServerBootFromVolumeStableRescueTest-1276656289</nova:project>
Aug 26 23:21:35 user nova-compute[73497]:       </nova:owner>
Aug 26 23:21:35 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:21:35 user nova-compute[73497]:       <nova:ports>
Aug 26 23:21:35 user nova-compute[73497]:         <nova:port uuid="628385fc-dbf3-4ae6-87d8-fe1678966a73">
Aug 26 23:21:35 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 23:21:35 user nova-compute[73497]:         </nova:port>
Aug 26 23:21:35 user nova-compute[73497]:       </nova:ports>
Aug 26 23:21:35 user nova-compute[73497]:     </nova:instance>
Aug 26 23:21:35 user nova-compute[73497]:   </metadata>
Aug 26 23:21:35 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:21:35 user nova-compute[73497]:     <system>
Aug 26 23:21:35 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:21:35 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:21:35 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:21:35 user nova-compute[73497]:       <entry name="serial">c601f97e-9e52-40c6-9085-45f38e709721</entry>
Aug 26 23:21:35 user nova-compute[73497]:       <entry name="uuid">c601f97e-9e52-40c6-9085-45f38e709721</entry>
Aug 26 23:21:35 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:21:35 user nova-compute[73497]:     </system>
Aug 26 23:21:35 user nova-compute[73497]:   </sysinfo>
Aug 26 23:21:35 user nova-compute[73497]:   <os>
Aug 26 23:21:35 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:21:35 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:21:35 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:21:35 user nova-compute[73497]:   </os>
Aug 26 23:21:35 user nova-compute[73497]:   <features>
Aug 26 23:21:35 user nova-compute[73497]:     <acpi/>
Aug 26 23:21:35 user nova-compute[73497]:     <apic/>
Aug 26 23:21:35 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:21:35 user nova-compute[73497]:   </features>
Aug 26 23:21:35 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:21:35 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:21:35 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:21:35 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:21:35 user nova-compute[73497]:   </clock>
Aug 26 23:21:35 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:21:35 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:21:35 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:21:35 user nova-compute[73497]:   </cpu>
Aug 26 23:21:35 user nova-compute[73497]:   <devices>
Aug 26 23:21:35 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:21:35 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:21:35 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk"/>
Aug 26 23:21:35 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:21:35 user nova-compute[73497]:     </disk>
Aug 26 23:21:35 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:21:35 user nova-compute[73497]:       <mac address="fa:16:3e:c0:51:9f"/>
Aug 26 23:21:35 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:21:35 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:21:35 user nova-compute[73497]:       <target dev="tap628385fc-db"/>
Aug 26 23:21:35 user nova-compute[73497]:     </interface>
Aug 26 23:21:35 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:21:35 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/console.log" append="off"/>
Aug 26 23:21:35 user nova-compute[73497]:     </serial>
Aug 26 23:21:35 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:21:35 user nova-compute[73497]:     <video>
Aug 26 23:21:35 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:21:35 user nova-compute[73497]:     </video>
Aug 26 23:21:35 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:21:35 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:21:35 user nova-compute[73497]:     </rng>
Aug 26 23:21:35 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:21:35 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:21:35 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:21:35 user nova-compute[73497]:     </memballoon>
Aug 26 23:21:35 user nova-compute[73497]:   </devices>
Aug 26 23:21:35 user nova-compute[73497]: </domain>
Aug 26 23:21:35 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:21:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1232471816',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1232471816',id=24,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ee8ef1c899342b38a624c1c28309d41',ramdisk_id='',reservation_id='r-offwgzp4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1276656289',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:21:33Z,user_data=None,user_id='83005131fdc2411abe7a198157910743',uuid=c601f97e-9e52-40c6-9085-45f38e709721,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "628385fc-dbf3-4ae6-87d8-fe1678966a73", "address": "fa:16:3e:c0:51:9f", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap628385fc-db", "ovs_interfaceid": "628385fc-dbf3-4ae6-87d8-fe1678966a73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Converting VIF {"id": "628385fc-dbf3-4ae6-87d8-fe1678966a73", "address": "fa:16:3e:c0:51:9f", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap628385fc-db", "ovs_interfaceid": "628385fc-dbf3-4ae6-87d8-fe1678966a73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:51:9f,bridge_name='br-int',has_traffic_filtering=True,id=628385fc-dbf3-4ae6-87d8-fe1678966a73,network=Network(f8ba0a6b-e4fc-4236-9df3-90ffab8824fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap628385fc-db') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG os_vif [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:51:9f,bridge_name='br-int',has_traffic_filtering=True,id=628385fc-dbf3-4ae6-87d8-fe1678966a73,network=Network(f8ba0a6b-e4fc-4236-9df3-90ffab8824fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap628385fc-db') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap628385fc-db, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap628385fc-db, col_values=(('external_ids', {'iface-id': '628385fc-dbf3-4ae6-87d8-fe1678966a73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:51:9f', 'vm-uuid': 'c601f97e-9e52-40c6-9085-45f38e709721'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:35 user nova-compute[73497]: INFO os_vif [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:51:9f,bridge_name='br-int',has_traffic_filtering=True,id=628385fc-dbf3-4ae6-87d8-fe1678966a73,network=Network(f8ba0a6b-e4fc-4236-9df3-90ffab8824fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap628385fc-db')
Aug 26 23:21:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] No VIF found with MAC fa:16:3e:c0:51:9f, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f56ba919411ad91408e2d93c58a1f340e4bd8b77.part /opt/stack/data/nova/instances/_base/f56ba919411ad91408e2d93c58a1f340e4bd8b77.converted" returned: 0 in 0.339s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f56ba919411ad91408e2d93c58a1f340e4bd8b77.converted --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG nova.network.neutron [req-62d3818e-7200-492d-bb37-c2bf75afad24 req-1628cb82-0406-4b34-96de-71d38dd12195 service nova] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Updated VIF entry in instance network info cache for port 628385fc-dbf3-4ae6-87d8-fe1678966a73. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:21:35 user nova-compute[73497]: DEBUG nova.network.neutron [req-62d3818e-7200-492d-bb37-c2bf75afad24 req-1628cb82-0406-4b34-96de-71d38dd12195 service nova] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Updating instance_info_cache with network_info: [{"id": "628385fc-dbf3-4ae6-87d8-fe1678966a73", "address": "fa:16:3e:c0:51:9f", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap628385fc-db", "ovs_interfaceid": "628385fc-dbf3-4ae6-87d8-fe1678966a73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-62d3818e-7200-492d-bb37-c2bf75afad24 req-1628cb82-0406-4b34-96de-71d38dd12195 service nova] Releasing lock "refresh_cache-c601f97e-9e52-40c6-9085-45f38e709721" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f56ba919411ad91408e2d93c58a1f340e4bd8b77.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "f56ba919411ad91408e2d93c58a1f340e4bd8b77" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.523s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f56ba919411ad91408e2d93c58a1f340e4bd8b77 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG nova.network.neutron [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Successfully updated port: efa7322e-6cca-40b1-9667-83d76383e165 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Acquiring lock "refresh_cache-244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Acquired lock "refresh_cache-244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG nova.network.neutron [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG nova.compute.manager [req-48e5ed0d-cfcb-46ea-b485-81c9df95a763 req-03d88c31-736e-4f2e-acc3-e82c400984f3 service nova] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Received event network-changed-efa7322e-6cca-40b1-9667-83d76383e165 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG nova.compute.manager [req-48e5ed0d-cfcb-46ea-b485-81c9df95a763 req-03d88c31-736e-4f2e-acc3-e82c400984f3 service nova] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Refreshing instance network info cache due to event network-changed-efa7322e-6cca-40b1-9667-83d76383e165. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-48e5ed0d-cfcb-46ea-b485-81c9df95a763 req-03d88c31-736e-4f2e-acc3-e82c400984f3 service nova] Acquiring lock "refresh_cache-244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f56ba919411ad91408e2d93c58a1f340e4bd8b77 --force-share --output=json" returned: 0 in 0.197s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Acquiring lock "f56ba919411ad91408e2d93c58a1f340e4bd8b77" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "f56ba919411ad91408e2d93c58a1f340e4bd8b77" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f56ba919411ad91408e2d93c58a1f340e4bd8b77 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG nova.network.neutron [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f56ba919411ad91408e2d93c58a1f340e4bd8b77 --force-share --output=json" returned: 0 in 0.188s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f56ba919411ad91408e2d93c58a1f340e4bd8b77,backing_fmt=raw /opt/stack/data/nova/instances/244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f56ba919411ad91408e2d93c58a1f340e4bd8b77,backing_fmt=raw /opt/stack/data/nova/instances/244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35/disk 1073741824" returned: 0 in 0.054s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "f56ba919411ad91408e2d93c58a1f340e4bd8b77" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f56ba919411ad91408e2d93c58a1f340e4bd8b77 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f56ba919411ad91408e2d93c58a1f340e4bd8b77 --force-share --output=json" returned: 0 in 0.176s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Ensure instance console log exists: /opt/stack/data/nova/instances/244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG nova.network.neutron [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Updating instance_info_cache with network_info: [{"id": "efa7322e-6cca-40b1-9667-83d76383e165", "address": "fa:16:3e:e4:78:43", "network": {"id": "e5209dd2-0f09-4bab-b0a6-b486792104a3", "bridge": "br-int", "label": "tempest-TestStampPattern-819945601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a539515b1f47d39d42e182bef80e63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa7322e-6c", "ovs_interfaceid": "efa7322e-6cca-40b1-9667-83d76383e165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Releasing lock "refresh_cache-244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG nova.compute.manager [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Instance network_info: |[{"id": "efa7322e-6cca-40b1-9667-83d76383e165", "address": "fa:16:3e:e4:78:43", "network": {"id": "e5209dd2-0f09-4bab-b0a6-b486792104a3", "bridge": "br-int", "label": "tempest-TestStampPattern-819945601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a539515b1f47d39d42e182bef80e63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa7322e-6c", "ovs_interfaceid": "efa7322e-6cca-40b1-9667-83d76383e165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-48e5ed0d-cfcb-46ea-b485-81c9df95a763 req-03d88c31-736e-4f2e-acc3-e82c400984f3 service nova] Acquired lock "refresh_cache-244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG nova.network.neutron [req-48e5ed0d-cfcb-46ea-b485-81c9df95a763 req-03d88c31-736e-4f2e-acc3-e82c400984f3 service nova] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Refreshing network info cache for port efa7322e-6cca-40b1-9667-83d76383e165 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Start _get_guest_xml network_info=[{"id": "efa7322e-6cca-40b1-9667-83d76383e165", "address": "fa:16:3e:e4:78:43", "network": {"id": "e5209dd2-0f09-4bab-b0a6-b486792104a3", "bridge": "br-int", "label": "tempest-TestStampPattern-819945601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a539515b1f47d39d42e182bef80e63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa7322e-6c", "ovs_interfaceid": "efa7322e-6cca-40b1-9667-83d76383e165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='101b883a58440ac2da1971ecc9e034ca',container_format='bare',created_at=2023-08-26T23:21:26Z,direct_url=<?>,disk_format='qcow2',id=d9778fd8-4597-4905-9763-d2396509a33e,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-972790044',owner='04a539515b1f47d39d42e182bef80e63',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T23:21:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': 'd9778fd8-4597-4905-9763-d2396509a33e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:21:36 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:21:36 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:21:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='101b883a58440ac2da1971ecc9e034ca',container_format='bare',created_at=2023-08-26T23:21:26Z,direct_url=<?>,disk_format='qcow2',id=d9778fd8-4597-4905-9763-d2396509a33e,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-972790044',owner='04a539515b1f47d39d42e182bef80e63',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T23:21:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:21:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-699584984',display_name='tempest-TestStampPattern-server-699584984',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-699584984',id=25,image_ref='d9778fd8-4597-4905-9763-d2396509a33e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSpNmqRMbMJd2f6kUSzLECN5mko6NqxFamfd/k4MFhK1XP2WLUCDpa9g6XZBlQKoHW+wuTTi/MsaMFncPcqVt3DKC1QEzKz7chFIzuhFpmCMAj7D379vAGPFvW3AZm1hg==',key_name='tempest-TestStampPattern-584336943',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04a539515b1f47d39d42e182bef80e63',ramdisk_id='',reservation_id='r-4iwbx061',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='4c68f140-4235-4dcb-b99d-1347bc949d15',image_min_disk='1',image_min_ram='0',image_owner_id='04a539515b1f47d39d42e182bef80e63',image_owner_project_name='tempest-TestStampPattern-2000771312',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2000771312-project-member',image_user_id='0e79225b05f24fb89cb3537ec6d983d9',network_allocated='True',owner_project_name='tempest-TestStampPattern-2000771312',owner_user_name='tempest-TestStampPattern-2000771312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:21:34Z,user_data=None,user_id='0e79225b05f24fb89cb3537ec6d983d9',uuid=244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efa7322e-6cca-40b1-9667-83d76383e165", "address": "fa:16:3e:e4:78:43", "network": {"id": "e5209dd2-0f09-4bab-b0a6-b486792104a3", "bridge": "br-int", "label": "tempest-TestStampPattern-819945601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a539515b1f47d39d42e182bef80e63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa7322e-6c", "ovs_interfaceid": "efa7322e-6cca-40b1-9667-83d76383e165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Converting VIF {"id": "efa7322e-6cca-40b1-9667-83d76383e165", "address": "fa:16:3e:e4:78:43", "network": {"id": "e5209dd2-0f09-4bab-b0a6-b486792104a3", "bridge": "br-int", "label": "tempest-TestStampPattern-819945601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a539515b1f47d39d42e182bef80e63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa7322e-6c", "ovs_interfaceid": "efa7322e-6cca-40b1-9667-83d76383e165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:78:43,bridge_name='br-int',has_traffic_filtering=True,id=efa7322e-6cca-40b1-9667-83d76383e165,network=Network(e5209dd2-0f09-4bab-b0a6-b486792104a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefa7322e-6c') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG nova.objects.instance [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lazy-loading 'pci_devices' on Instance uuid 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:21:36 user nova-compute[73497]:   <uuid>244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35</uuid>
Aug 26 23:21:36 user nova-compute[73497]:   <name>instance-00000019</name>
Aug 26 23:21:36 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:21:36 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:21:36 user nova-compute[73497]:   <metadata>
Aug 26 23:21:36 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:21:36 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:21:36 user nova-compute[73497]:       <nova:name>tempest-TestStampPattern-server-699584984</nova:name>
Aug 26 23:21:36 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:21:36</nova:creationTime>
Aug 26 23:21:36 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:21:36 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:21:36 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:21:36 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:21:36 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:21:36 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:21:36 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:21:36 user nova-compute[73497]:       <nova:owner>
Aug 26 23:21:36 user nova-compute[73497]:         <nova:user uuid="0e79225b05f24fb89cb3537ec6d983d9">tempest-TestStampPattern-2000771312-project-member</nova:user>
Aug 26 23:21:36 user nova-compute[73497]:         <nova:project uuid="04a539515b1f47d39d42e182bef80e63">tempest-TestStampPattern-2000771312</nova:project>
Aug 26 23:21:36 user nova-compute[73497]:       </nova:owner>
Aug 26 23:21:36 user nova-compute[73497]:       <nova:root type="image" uuid="d9778fd8-4597-4905-9763-d2396509a33e"/>
Aug 26 23:21:36 user nova-compute[73497]:       <nova:ports>
Aug 26 23:21:36 user nova-compute[73497]:         <nova:port uuid="efa7322e-6cca-40b1-9667-83d76383e165">
Aug 26 23:21:36 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 23:21:36 user nova-compute[73497]:         </nova:port>
Aug 26 23:21:36 user nova-compute[73497]:       </nova:ports>
Aug 26 23:21:36 user nova-compute[73497]:     </nova:instance>
Aug 26 23:21:36 user nova-compute[73497]:   </metadata>
Aug 26 23:21:36 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:21:36 user nova-compute[73497]:     <system>
Aug 26 23:21:36 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:21:36 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:21:36 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:21:36 user nova-compute[73497]:       <entry name="serial">244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35</entry>
Aug 26 23:21:36 user nova-compute[73497]:       <entry name="uuid">244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35</entry>
Aug 26 23:21:36 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:21:36 user nova-compute[73497]:     </system>
Aug 26 23:21:36 user nova-compute[73497]:   </sysinfo>
Aug 26 23:21:36 user nova-compute[73497]:   <os>
Aug 26 23:21:36 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:21:36 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:21:36 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:21:36 user nova-compute[73497]:   </os>
Aug 26 23:21:36 user nova-compute[73497]:   <features>
Aug 26 23:21:36 user nova-compute[73497]:     <acpi/>
Aug 26 23:21:36 user nova-compute[73497]:     <apic/>
Aug 26 23:21:36 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:21:36 user nova-compute[73497]:   </features>
Aug 26 23:21:36 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:21:36 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:21:36 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:21:36 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:21:36 user nova-compute[73497]:   </clock>
Aug 26 23:21:36 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:21:36 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:21:36 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:21:36 user nova-compute[73497]:   </cpu>
Aug 26 23:21:36 user nova-compute[73497]:   <devices>
Aug 26 23:21:36 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:21:36 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:21:36 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35/disk"/>
Aug 26 23:21:36 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:21:36 user nova-compute[73497]:     </disk>
Aug 26 23:21:36 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:21:36 user nova-compute[73497]:       <mac address="fa:16:3e:e4:78:43"/>
Aug 26 23:21:36 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:21:36 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:21:36 user nova-compute[73497]:       <target dev="tapefa7322e-6c"/>
Aug 26 23:21:36 user nova-compute[73497]:     </interface>
Aug 26 23:21:36 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:21:36 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35/console.log" append="off"/>
Aug 26 23:21:36 user nova-compute[73497]:     </serial>
Aug 26 23:21:36 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:21:36 user nova-compute[73497]:     <video>
Aug 26 23:21:36 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:21:36 user nova-compute[73497]:     </video>
Aug 26 23:21:36 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:21:36 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:21:36 user nova-compute[73497]:     </rng>
Aug 26 23:21:36 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:21:36 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:21:36 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:21:36 user nova-compute[73497]:     </memballoon>
Aug 26 23:21:36 user nova-compute[73497]:   </devices>
Aug 26 23:21:36 user nova-compute[73497]: </domain>
Aug 26 23:21:36 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:21:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-699584984',display_name='tempest-TestStampPattern-server-699584984',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-699584984',id=25,image_ref='d9778fd8-4597-4905-9763-d2396509a33e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSpNmqRMbMJd2f6kUSzLECN5mko6NqxFamfd/k4MFhK1XP2WLUCDpa9g6XZBlQKoHW+wuTTi/MsaMFncPcqVt3DKC1QEzKz7chFIzuhFpmCMAj7D379vAGPFvW3AZm1hg==',key_name='tempest-TestStampPattern-584336943',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04a539515b1f47d39d42e182bef80e63',ramdisk_id='',reservation_id='r-4iwbx061',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='4c68f140-4235-4dcb-b99d-1347bc949d15',image_min_disk='1',image_min_ram='0',image_owner_id='04a539515b1f47d39d42e182bef80e63',image_owner_project_name='tempest-TestStampPattern-2000771312',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2000771312-project-member',image_user_id='0e79225b05f24fb89cb3537ec6d983d9',network_allocated='True',owner_project_name='tempest-TestStampPattern-2000771312',owner_user_name='tempest-TestStampPattern-2000771312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:21:34Z,user_data=None,user_id='0e79225b05f24fb89cb3537ec6d983d9',uuid=244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efa7322e-6cca-40b1-9667-83d76383e165", "address": "fa:16:3e:e4:78:43", "network": {"id": "e5209dd2-0f09-4bab-b0a6-b486792104a3", "bridge": "br-int", "label": "tempest-TestStampPattern-819945601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a539515b1f47d39d42e182bef80e63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa7322e-6c", "ovs_interfaceid": "efa7322e-6cca-40b1-9667-83d76383e165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Converting VIF {"id": "efa7322e-6cca-40b1-9667-83d76383e165", "address": "fa:16:3e:e4:78:43", "network": {"id": "e5209dd2-0f09-4bab-b0a6-b486792104a3", "bridge": "br-int", "label": "tempest-TestStampPattern-819945601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a539515b1f47d39d42e182bef80e63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa7322e-6c", "ovs_interfaceid": "efa7322e-6cca-40b1-9667-83d76383e165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:78:43,bridge_name='br-int',has_traffic_filtering=True,id=efa7322e-6cca-40b1-9667-83d76383e165,network=Network(e5209dd2-0f09-4bab-b0a6-b486792104a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefa7322e-6c') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG os_vif [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:78:43,bridge_name='br-int',has_traffic_filtering=True,id=efa7322e-6cca-40b1-9667-83d76383e165,network=Network(e5209dd2-0f09-4bab-b0a6-b486792104a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefa7322e-6c') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapefa7322e-6c, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapefa7322e-6c, col_values=(('external_ids', {'iface-id': 'efa7322e-6cca-40b1-9667-83d76383e165', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:78:43', 'vm-uuid': '244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:36 user nova-compute[73497]: INFO os_vif [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:78:43,bridge_name='br-int',has_traffic_filtering=True,id=efa7322e-6cca-40b1-9667-83d76383e165,network=Network(e5209dd2-0f09-4bab-b0a6-b486792104a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefa7322e-6c')
Aug 26 23:21:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:21:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] No VIF found with MAC fa:16:3e:e4:78:43, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:21:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:37 user nova-compute[73497]: DEBUG nova.network.neutron [req-48e5ed0d-cfcb-46ea-b485-81c9df95a763 req-03d88c31-736e-4f2e-acc3-e82c400984f3 service nova] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Updated VIF entry in instance network info cache for port efa7322e-6cca-40b1-9667-83d76383e165. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:21:37 user nova-compute[73497]: DEBUG nova.network.neutron [req-48e5ed0d-cfcb-46ea-b485-81c9df95a763 req-03d88c31-736e-4f2e-acc3-e82c400984f3 service nova] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Updating instance_info_cache with network_info: [{"id": "efa7322e-6cca-40b1-9667-83d76383e165", "address": "fa:16:3e:e4:78:43", "network": {"id": "e5209dd2-0f09-4bab-b0a6-b486792104a3", "bridge": "br-int", "label": "tempest-TestStampPattern-819945601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a539515b1f47d39d42e182bef80e63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa7322e-6c", "ovs_interfaceid": "efa7322e-6cca-40b1-9667-83d76383e165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:21:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:37 user nova-compute[73497]: DEBUG nova.compute.manager [req-4ac3314b-1db0-414c-9711-4d3c7b043fb2 req-47ceb197-feb7-4143-ba88-378b82fb4da4 service nova] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Received event network-vif-plugged-628385fc-dbf3-4ae6-87d8-fe1678966a73 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:21:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4ac3314b-1db0-414c-9711-4d3c7b043fb2 req-47ceb197-feb7-4143-ba88-378b82fb4da4 service nova] Acquiring lock "c601f97e-9e52-40c6-9085-45f38e709721-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:21:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4ac3314b-1db0-414c-9711-4d3c7b043fb2 req-47ceb197-feb7-4143-ba88-378b82fb4da4 service nova] Lock "c601f97e-9e52-40c6-9085-45f38e709721-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:21:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4ac3314b-1db0-414c-9711-4d3c7b043fb2 req-47ceb197-feb7-4143-ba88-378b82fb4da4 service nova] Lock "c601f97e-9e52-40c6-9085-45f38e709721-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:21:37 user nova-compute[73497]: DEBUG nova.compute.manager [req-4ac3314b-1db0-414c-9711-4d3c7b043fb2 req-47ceb197-feb7-4143-ba88-378b82fb4da4 service nova] [instance: c601f97e-9e52-40c6-9085-45f38e709721] No waiting events found dispatching network-vif-plugged-628385fc-dbf3-4ae6-87d8-fe1678966a73 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:21:37 user nova-compute[73497]: WARNING nova.compute.manager [req-4ac3314b-1db0-414c-9711-4d3c7b043fb2 req-47ceb197-feb7-4143-ba88-378b82fb4da4 service nova] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Received unexpected event network-vif-plugged-628385fc-dbf3-4ae6-87d8-fe1678966a73 for instance with vm_state building and task_state spawning.
Aug 26 23:21:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-48e5ed0d-cfcb-46ea-b485-81c9df95a763 req-03d88c31-736e-4f2e-acc3-e82c400984f3 service nova] Releasing lock "refresh_cache-244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:21:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:39 user nova-compute[73497]: DEBUG nova.compute.manager [req-d1a03d00-a465-45a5-a547-f16fc72ca2f3 req-56d75fab-8ced-4001-bd8d-4c09279273c5 service nova] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Received event network-vif-plugged-628385fc-dbf3-4ae6-87d8-fe1678966a73 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:21:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d1a03d00-a465-45a5-a547-f16fc72ca2f3 req-56d75fab-8ced-4001-bd8d-4c09279273c5 service nova] Acquiring lock "c601f97e-9e52-40c6-9085-45f38e709721-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:21:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d1a03d00-a465-45a5-a547-f16fc72ca2f3 req-56d75fab-8ced-4001-bd8d-4c09279273c5 service nova] Lock "c601f97e-9e52-40c6-9085-45f38e709721-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:21:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d1a03d00-a465-45a5-a547-f16fc72ca2f3 req-56d75fab-8ced-4001-bd8d-4c09279273c5 service nova] Lock "c601f97e-9e52-40c6-9085-45f38e709721-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:21:39 user nova-compute[73497]: DEBUG nova.compute.manager [req-d1a03d00-a465-45a5-a547-f16fc72ca2f3 req-56d75fab-8ced-4001-bd8d-4c09279273c5 service nova] [instance: c601f97e-9e52-40c6-9085-45f38e709721] No waiting events found dispatching network-vif-plugged-628385fc-dbf3-4ae6-87d8-fe1678966a73 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:21:39 user nova-compute[73497]: WARNING nova.compute.manager [req-d1a03d00-a465-45a5-a547-f16fc72ca2f3 req-56d75fab-8ced-4001-bd8d-4c09279273c5 service nova] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Received unexpected event network-vif-plugged-628385fc-dbf3-4ae6-87d8-fe1678966a73 for instance with vm_state building and task_state spawning.
Aug 26 23:21:39 user nova-compute[73497]: DEBUG nova.compute.manager [req-d1a03d00-a465-45a5-a547-f16fc72ca2f3 req-56d75fab-8ced-4001-bd8d-4c09279273c5 service nova] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Received event network-vif-plugged-efa7322e-6cca-40b1-9667-83d76383e165 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:21:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d1a03d00-a465-45a5-a547-f16fc72ca2f3 req-56d75fab-8ced-4001-bd8d-4c09279273c5 service nova] Acquiring lock "244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:21:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d1a03d00-a465-45a5-a547-f16fc72ca2f3 req-56d75fab-8ced-4001-bd8d-4c09279273c5 service nova] Lock "244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:21:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d1a03d00-a465-45a5-a547-f16fc72ca2f3 req-56d75fab-8ced-4001-bd8d-4c09279273c5 service nova] Lock "244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:21:39 user nova-compute[73497]: DEBUG nova.compute.manager [req-d1a03d00-a465-45a5-a547-f16fc72ca2f3 req-56d75fab-8ced-4001-bd8d-4c09279273c5 service nova] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] No waiting events found dispatching network-vif-plugged-efa7322e-6cca-40b1-9667-83d76383e165 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:21:39 user nova-compute[73497]: WARNING nova.compute.manager [req-d1a03d00-a465-45a5-a547-f16fc72ca2f3 req-56d75fab-8ced-4001-bd8d-4c09279273c5 service nova] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Received unexpected event network-vif-plugged-efa7322e-6cca-40b1-9667-83d76383e165 for instance with vm_state building and task_state spawning.
Aug 26 23:21:39 user nova-compute[73497]: DEBUG nova.compute.manager [req-d1a03d00-a465-45a5-a547-f16fc72ca2f3 req-56d75fab-8ced-4001-bd8d-4c09279273c5 service nova] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Received event network-vif-plugged-efa7322e-6cca-40b1-9667-83d76383e165 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:21:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d1a03d00-a465-45a5-a547-f16fc72ca2f3 req-56d75fab-8ced-4001-bd8d-4c09279273c5 service nova] Acquiring lock "244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:21:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d1a03d00-a465-45a5-a547-f16fc72ca2f3 req-56d75fab-8ced-4001-bd8d-4c09279273c5 service nova] Lock "244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:21:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d1a03d00-a465-45a5-a547-f16fc72ca2f3 req-56d75fab-8ced-4001-bd8d-4c09279273c5 service nova] Lock "244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:21:39 user nova-compute[73497]: DEBUG nova.compute.manager [req-d1a03d00-a465-45a5-a547-f16fc72ca2f3 req-56d75fab-8ced-4001-bd8d-4c09279273c5 service nova] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] No waiting events found dispatching network-vif-plugged-efa7322e-6cca-40b1-9667-83d76383e165 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:21:39 user nova-compute[73497]: WARNING nova.compute.manager [req-d1a03d00-a465-45a5-a547-f16fc72ca2f3 req-56d75fab-8ced-4001-bd8d-4c09279273c5 service nova] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Received unexpected event network-vif-plugged-efa7322e-6cca-40b1-9667-83d76383e165 for instance with vm_state building and task_state spawning.
Aug 26 23:21:40 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092100.568745, c601f97e-9e52-40c6-9085-45f38e709721 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:21:40 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c601f97e-9e52-40c6-9085-45f38e709721] VM Resumed (Lifecycle Event)
Aug 26 23:21:40 user nova-compute[73497]: DEBUG nova.compute.manager [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:21:40 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:21:40 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Instance spawned successfully.
Aug 26 23:21:40 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:21:40 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:21:40 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:21:40 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:21:40 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:21:40 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:21:40 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:21:40 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:21:40 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:21:40 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c601f97e-9e52-40c6-9085-45f38e709721] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:21:40 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092100.572221, c601f97e-9e52-40c6-9085-45f38e709721 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:21:40 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c601f97e-9e52-40c6-9085-45f38e709721] VM Started (Lifecycle Event)
Aug 26 23:21:40 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:21:40 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:21:40 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c601f97e-9e52-40c6-9085-45f38e709721] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:21:40 user nova-compute[73497]: INFO nova.compute.manager [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Took 7.96 seconds to spawn the instance on the hypervisor.
Aug 26 23:21:40 user nova-compute[73497]: DEBUG nova.compute.manager [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:21:40 user nova-compute[73497]: INFO nova.compute.manager [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Took 8.96 seconds to build instance.
Aug 26 23:21:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0333e927-0b81-4781-980a-53c46f02f936 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "c601f97e-9e52-40c6-9085-45f38e709721" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.067s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:21:41 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092101.1550272, 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:21:41 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] VM Resumed (Lifecycle Event)
Aug 26 23:21:41 user nova-compute[73497]: DEBUG nova.compute.manager [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:21:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:21:41 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Instance spawned successfully.
Aug 26 23:21:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:21:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:21:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:21:41 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:21:41 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:21:41 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:21:41 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092101.1589475, 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:21:41 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] VM Started (Lifecycle Event)
Aug 26 23:21:41 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:21:41 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:21:41 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:21:41 user nova-compute[73497]: INFO nova.compute.manager [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Took 6.79 seconds to spawn the instance on the hypervisor.
Aug 26 23:21:41 user nova-compute[73497]: DEBUG nova.compute.manager [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:21:41 user nova-compute[73497]: INFO nova.compute.manager [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Took 8.00 seconds to build instance.
Aug 26 23:21:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-03c0b73e-38ed-4be8-b9ff-14b24a05da5d tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.142s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:21:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:43 user nova-compute[73497]: INFO nova.virt.block_device [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Booting with volume ae929108-9690-475d-a816-c0fad8ee791d at /dev/vdc
Aug 26 23:21:43 user nova-compute[73497]: DEBUG os_brick.utils [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:21:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca803f87-514b-4409-9673-07110db6ab16]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[29603a8a-fc83-49fc-b99d-ff58c60af41e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2c4594-e774-48bc-bc2f-a00311fbbd9d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dfbc0c-c9ed-4b3a-a9dd-8134ae472864]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:21:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:21:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:21:43 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:21:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[082d34ce-ac03-42d2-9241-4d88284e52d8]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:21:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:21:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:21:43 user nova-compute[73497]: DEBUG os_brick.utils [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:21:43 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Updating existing volume attachment record: cf095eba-a4fd-4382-a573-5eab5d8ac992 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:21:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:21:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:21:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:21:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:21:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:21:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:51 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:21:51 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:21:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:21:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:21:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:21:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:21:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c1278dd8-dada-4d8b-8cac-835819da20f8 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "b68b6975-a24a-4861-a583-406b02446ea0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:21:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c1278dd8-dada-4d8b-8cac-835819da20f8 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "b68b6975-a24a-4861-a583-406b02446ea0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:21:52 user nova-compute[73497]: INFO nova.compute.manager [None req-c1278dd8-dada-4d8b-8cac-835819da20f8 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Detaching volume 366d637e-5a2e-4301-b2a1-0b5bcb485c10
Aug 26 23:21:52 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:21:52 user nova-compute[73497]: INFO nova.virt.block_device [None req-c1278dd8-dada-4d8b-8cac-835819da20f8 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Attempting to driver detach volume 366d637e-5a2e-4301-b2a1-0b5bcb485c10 from mountpoint /dev/vdb
Aug 26 23:21:52 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c1278dd8-dada-4d8b-8cac-835819da20f8 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Attempting to detach device vdb from instance b68b6975-a24a-4861-a583-406b02446ea0 from the persistent domain config. {{(pid=73497) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 23:21:52 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-c1278dd8-dada-4d8b-8cac-835819da20f8 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:21:52 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:21:52 user nova-compute[73497]:   <source dev="/dev/sdb"/>
Aug 26 23:21:52 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:21:52 user nova-compute[73497]:   <serial>366d637e-5a2e-4301-b2a1-0b5bcb485c10</serial>
Aug 26 23:21:52 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 23:21:52 user nova-compute[73497]: </disk>
Aug 26 23:21:52 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:21:52 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-c1278dd8-dada-4d8b-8cac-835819da20f8 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Successfully detached device vdb from instance b68b6975-a24a-4861-a583-406b02446ea0 from the persistent domain config.
Aug 26 23:21:52 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c1278dd8-dada-4d8b-8cac-835819da20f8 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b68b6975-a24a-4861-a583-406b02446ea0 from the live domain config. {{(pid=73497) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 23:21:52 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-c1278dd8-dada-4d8b-8cac-835819da20f8 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:21:52 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:21:52 user nova-compute[73497]:   <source dev="/dev/sdb"/>
Aug 26 23:21:52 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:21:52 user nova-compute[73497]:   <serial>366d637e-5a2e-4301-b2a1-0b5bcb485c10</serial>
Aug 26 23:21:52 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 23:21:52 user nova-compute[73497]: </disk>
Aug 26 23:21:52 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:21:52 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Received event <DeviceRemovedEvent: 1693092112.8424983, b68b6975-a24a-4861-a583-406b02446ea0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73497) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 23:21:52 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c1278dd8-dada-4d8b-8cac-835819da20f8 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b68b6975-a24a-4861-a583-406b02446ea0 {{(pid=73497) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 23:21:52 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-c1278dd8-dada-4d8b-8cac-835819da20f8 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Successfully detached device vdb from instance b68b6975-a24a-4861-a583-406b02446ea0 from the live domain config.
Aug 26 23:21:52 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1278dd8-dada-4d8b-8cac-835819da20f8 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:21:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1278dd8-dada-4d8b-8cac-835819da20f8 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'svqUICKd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:21:52 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-c1278dd8-dada-4d8b-8cac-835819da20f8 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:21:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-c1278dd8-dada-4d8b-8cac-835819da20f8 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:21:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-c1278dd8-dada-4d8b-8cac-835819da20f8 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:21:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1278dd8-dada-4d8b-8cac-835819da20f8 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:21:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.051s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:52 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef4a888-b974-416f-ba28-eec2c685d813]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:52 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcfb333-fd63-4a63-a563-8194885e970a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1278dd8-dada-4d8b-8cac-835819da20f8 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:21:52 user nova-compute[73497]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:21:52 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:21:52 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:21:52 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:21:52 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:21:52 user nova-compute[73497]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:21:52 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:21:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1278dd8-dada-4d8b-8cac-835819da20f8 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:21:52 user nova-compute[73497]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 (non-flash)
Aug 26 23:21:52 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:21:52 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:21:52 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:21:52 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:21:52 user nova-compute[73497]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:21:52 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:21:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1278dd8-dada-4d8b-8cac-835819da20f8 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282c0e1d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10'): ({'sdb'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:21:52 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-c1278dd8-dada-4d8b-8cac-835819da20f8 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Removing single pathed devices sdb {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:21:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:52 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a164587b-d5b4-4cfe-b1e9-7fdd8a2d3dec]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7955383-7418-4835-95f0-89a62aff76e1]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-c1278dd8-dada-4d8b-8cac-835819da20f8 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Flushing IO for device /dev/sdb {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[881d15d6-dcde-4698-8b9a-997295d92b6f]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-c1278dd8-dada-4d8b-8cac-835819da20f8 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4411c76-143c-48f7-98b5-6c88eec0cb31]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-c1278dd8-dada-4d8b-8cac-835819da20f8 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-c1278dd8-dada-4d8b-8cac-835819da20f8 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1278dd8-dada-4d8b-8cac-835819da20f8 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90909ab-8003-456c-8ad5-a0e55452d3d8]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1278dd8-dada-4d8b-8cac-835819da20f8 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7422b3bf-a3b0-4e23-8955-3c825877dd6f]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1278dd8-dada-4d8b-8cac-835819da20f8 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10, portal: 172.16.0.220,3260]
Aug 26 23:21:53 user nova-compute[73497]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10, portal: 172.16.0.220,3260] successful.
Aug 26 23:21:53 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366d637e-5a2e-4301-b2a1-0b5bcb485c10 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e98d138-6ea3-4a72-b527-55637b2314b9]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1278dd8-dada-4d8b-8cac-835819da20f8 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-c1278dd8-dada-4d8b-8cac-835819da20f8 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1278dd8-dada-4d8b-8cac-835819da20f8 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] <== disconnect_volume: return (399ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1278dd8-dada-4d8b-8cac-835819da20f8 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:54 user nova-compute[73497]: DEBUG nova.objects.instance [None req-c1278dd8-dada-4d8b-8cac-835819da20f8 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lazy-loading 'flavor' on Instance uuid b68b6975-a24a-4861-a583-406b02446ea0 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:21:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c1278dd8-dada-4d8b-8cac-835819da20f8 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "b68b6975-a24a-4861-a583-406b02446ea0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.169s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:21:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:21:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:21:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:21:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:21:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bde0a05a-a075-4298-907e-cb00798c90af/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bde0a05a-a075-4298-907e-cb00798c90af/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bde0a05a-a075-4298-907e-cb00798c90af/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bde0a05a-a075-4298-907e-cb00798c90af/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:21:56 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Creating image(s)
Aug 26 23:21:56 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Did not create local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Ensure instance console log exists: /opt/stack/data/nova/instances/a6c7669c-f338-4e2b-9ba7-96d8e66d10ed/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Start _get_guest_xml network_info=[{"id": "d114632c-d651-4419-9f82-ecaa90cd381b", "address": "fa:16:3e:7a:e8:f3", "network": {"id": "d6df8ba3-c833-4cf3-8865-2e449087bead", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-54509536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd114632c-d6", "ovs_interfaceid": "d114632c-d651-4419-9f82-ecaa90cd381b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c268fbf7-6a36-44b5-8361-42160a69b1d4", "address": "fa:16:3e:e6:16:95", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc268fbf7-6a", "ovs_interfaceid": "c268fbf7-6a36-44b5-8361-42160a69b1d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "372fa1fa-b52b-479a-b228-91eebb1d3e3f", "address": "fa:16:3e:b0:c0:5e", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372fa1fa-b5", "ovs_interfaceid": "372fa1fa-b52b-479a-b228-91eebb1d3e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7c81f6a7-92b5-496b-867f-c10965da8e40", "address": "fa:16:3e:8e:33:9e", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c81f6a7-92", "ovs_interfaceid": "7c81f6a7-92b5-496b-867f-c10965da8e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "792a72cb-3624-45eb-a8f7-01cf52196f2d", "address": "fa:16:3e:73:4e:ac", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap792a72cb-36", "ovs_interfaceid": "792a72cb-3624-45eb-a8f7-01cf52196f2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "35958938-f4c5-4745-99ca-0f0761fd801c", "address": "fa:16:3e:d2:d0:65", "network": {"id": "15044bd5-0863-41a2-ad57-abbdad59baa3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1012445693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35958938-f4", "ovs_interfaceid": "35958938-f4c5-4745-99ca-0f0761fd801c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6361122d-0a82-4b1d-8ea5-dedb8984f15f", "address": "fa:16:3e:e1:fa:e3", "network": {"id": "15044bd5-0863-41a2-ad57-abbdad59baa3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1012445693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6361122d-0a", "ovs_interfaceid": "6361122d-0a82-4b1d-8ea5-dedb8984f15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '337d578a-1769-4077-ab2e-1bc651e9a276', 'guest_format': None, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OUhoGXVR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a6c7669c-f338-4e2b-9ba7-96d8e66d10ed', 'attached_at': '', 'detached_at': '', 'volume_id': '5a291925-0e24-48cd-bb57-40dc15ac7912', 'serial': '5a291925-0e24-48cd-bb57-40dc15ac7912'}, 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}, {'attachment_id': 'b32e2a1f-6342-437c-bdb3-3a941b1f98d9', 'guest_format': None, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pBxNojUM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a6c7669c-f338-4e2b-9ba7-96d8e66d10ed', 'attached_at': '', 'detached_at': '', 'volume_id': '6da56445-077b-42eb-90ee-12eba93589a3', 'serial': '6da56445-077b-42eb-90ee-12eba93589a3'}, 'boot_index': 1, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}, {'attachment_id': 'cf095eba-a4fd-4382-a573-5eab5d8ac992', 'guest_format': None, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IJqErCFS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a6c7669c-f338-4e2b-9ba7-96d8e66d10ed', 'attached_at': '', 'detached_at': '', 'volume_id': 'ae929108-9690-475d-a816-c0fad8ee791d', 'serial': 'ae929108-9690-475d-a816-c0fad8ee791d'}, 'boot_index': 2, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:21:56 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:21:56 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:21:56 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OUhoGXVR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:21:56 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:21:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:21:56 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:21:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:21:56 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba291ac1-b505-4cd9-b8b2-fcbf5cb0a914]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:21:56 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[914ac521-367a-450a-8d10-dd6e52056d10]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912] added
Aug 26 23:21:56 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e113f7-ee5c-44c3-a675-b1120619b2f8]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[801753be-b646-46da-b03b-47704adc1fd1]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OUhoGXVR {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OUhoGXVR" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[96536ddd-d9aa-4e50-8fc5-8b6f82074c89]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OUhoGXVR'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a064eb4-dfaa-43db-b618-0d36969e1a7e]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Acquiring lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d969571-623d-4e86-9220-860e45691c37]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:21:56 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:21:56 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:21:56 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:21:56 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:21:56 user nova-compute[73497]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:21:56 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:21:56 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:21:56 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:21:56 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:21:56 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:21:56 user nova-compute[73497]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:21:56 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG nova.objects.instance [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lazy-loading 'flavor' on Instance uuid 7c124dd9-4dce-4c6f-925c-6eda8e187d84 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c316b50-0c83-46c1-ad7d-ef7c66a3ab67]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912, portal: 172.16.0.220,3260]
Aug 26 23:21:56 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912, portal: 172.16.0.220,3260] successful.
Aug 26 23:21:56 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1537bc4-b0f0-457f-a37e-bf549bdd21d7]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:21:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ddd37d-e6b6-4dd0-91c6-439d0dbbf31c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:21:57 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:21:57 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:21:57 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:21:57 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:21:57 user nova-compute[73497]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:21:57 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:21:57 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:21:57 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:21:57 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:21:57 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:21:57 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:21:57 user nova-compute[73497]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:21:57 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:21:57 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.395s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[443aba94-1bda-436d-88b0-760d6710b0f7]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OUhoGXVR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Acquiring lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:21:57 user nova-compute[73497]: INFO nova.compute.manager [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Attaching volume 00fbc86c-3cce-40a9-83b5-dbbf5bf49662 to /dev/vdb
Aug 26 23:21:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG os_brick.utils [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53a860a-ea88-4e5d-9121-07d2fe046c51]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa6392c-f1c8-40d7-807a-dc0056756260]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a019a0e0-3795-40a1-b57a-71786ac8c0a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebffa878-b744-4918-9865-59adb354e954]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:21:57 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:21:57 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f0a2f0-8310-4347-bacf-401ddce6c7b0]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG os_brick.utils [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Updating existing volume attachment record: 44aca921-bfe1-447d-877f-b8a658dde9b8 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.440s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] <== connect_volume: return (1444ms) {'type': 'block', 'scsi_wwn': '23036313732306535', 'path': '/dev/sdb'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036313732306535', 'path': '/dev/sdb'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pBxNojUM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:21:58 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:21:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:21:58 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:21:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:21:58 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3890a2b-c178-4e87-b050-934e6d98e174]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:21:58 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1920e680-a502-4816-8617-eca5ab84e31e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3] added
Aug 26 23:21:58 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05ec4a0-2026-4f28-9b89-3715e22d8231]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c74e327-9a4f-4289-94b5-18d7daf34650]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pBxNojUM {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pBxNojUM" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7927da6-2cb4-4e1b-acfa-c3e209e7475c]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pBxNojUM'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[083f7a4e-3d78-43b9-93e5-2663c55f9b6d]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3eeb1b-6881-4b39-b921-1157d90e1cfa]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:21:58 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:21:58 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:21:58 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:21:58 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:21:58 user nova-compute[73497]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:21:58 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:21:58 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:21:58 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:21:58 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:21:58 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:21:58 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:21:58 user nova-compute[73497]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:21:58 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:21:58 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec75aea-26c7-480d-891d-ec3f32b3f83e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3, portal: 172.16.0.220,3260]
Aug 26 23:21:58 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3, portal: 172.16.0.220,3260] successful.
Aug 26 23:21:58 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e349a20-8e2e-4668-a968-df60d3dd2ef2]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3337616-897b-498c-824a-f9608f33be85]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:21:58 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:21:58 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:21:58 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:21:58 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:21:58 user nova-compute[73497]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:21:58 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:21:58 user nova-compute[73497]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)
Aug 26 23:21:58 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:21:58 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:21:58 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:21:58 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:21:58 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:21:58 user nova-compute[73497]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:21:58 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:21:58 user nova-compute[73497]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)
Aug 26 23:21:58 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.425s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] HCTL ('40', '-', '-', 0) found on session 24 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[37074878-87d1-4de5-b478-e3ccd22276e6]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Searching for a device in session 24 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pBxNojUM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:21:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.652s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:21:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] <== connect_volume: return (1654ms) {'type': 'block', 'scsi_wwn': '26334643065613865', 'path': '/dev/sdi'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:21:59 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334643065613865', 'path': '/dev/sdi'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:21:59 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:21:59 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:21:59 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=6685MB free_disk=25.024986267089844GB free_vcpus=-3 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:21:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:21:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:21:59 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:21:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IJqErCFS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:21:59 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:21:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:21:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:21:59 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:21:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:21:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:21:59 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:21:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:59 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2e71e1-5eb7-4d53-b3a2-0d6c301a191c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:21:59 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:21:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:59 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[278a23ca-4443-4fb8-a01e-11883108e5e4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d] added
Aug 26 23:21:59 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:21:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:59 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa433b5-8b61-4671-a7ae-9a9754a25dfa]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:21:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:59 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ab654e-6206-45f9-a5b4-e07f35fd412c]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:21:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IJqErCFS {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IJqErCFS" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:59 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6abcad-62c6-4b1d-96ab-ac5cfda09b4e]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IJqErCFS'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:21:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:21:59 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Applying migration context for instance ee6283d5-40de-432d-997c-0be52ff673ca as it has an incoming, in-progress migration 14136b35-f57f-4887-b829-d288d7ca3655. Migration status is finished {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 23:21:59 user nova-compute[73497]: INFO nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Updating resource usage from migration 14136b35-f57f-4887-b829-d288d7ca3655
Aug 26 23:21:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:21:59 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[609b8eee-f4b2-4326-b6a1-1e363b596049]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:21:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:21:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 926f8e5c-8d8a-4f07-bf08-e60700ce4698 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 994093f0-e6b2-4c96-b259-c559ef2b1fbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 171985a3-358d-4b26-a66c-372b9b99b386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance aebaeda6-23d1-43a1-afc8-bdc8992067e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance b68b6975-a24a-4861-a583-406b02446ea0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance ff1085db-4bfc-4c77-a9e4-39f47ffb6d43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 7c124dd9-4dce-4c6f-925c-6eda8e187d84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 4c68f140-4235-4dcb-b99d-1347bc949d15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 043294e5-0618-4a31-bb19-1227ef1f5d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance e9e5c83f-0678-48d4-a81f-1a3f959aabcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 2f46a6a8-a043-455a-98f8-dae359594f56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Migration 14136b35-f57f-4887-b829-d288d7ca3655 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance ee6283d5-40de-432d-997c-0be52ff673ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance bde0a05a-a075-4298-907e-cb00798c90af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance a6c7669c-f338-4e2b-9ba7-96d8e66d10ed actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance c601f97e-9e52-40c6-9085-45f38e709721 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 17 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=10752MB phys_disk=40GB used_disk=33GB total_vcpus=12 used_vcpus=17 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e438dc6-6bdc-479a-b885-e08eb0a54c31]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:22:00 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:22:00 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:22:00 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:22:00 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:22:00 user nova-compute[73497]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:22:00 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:22:00 user nova-compute[73497]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)
Aug 26 23:22:00 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:22:00 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:22:00 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:22:00 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:22:00 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:22:00 user nova-compute[73497]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:22:00 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:22:00 user nova-compute[73497]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)
Aug 26 23:22:00 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[757ad2bf-314b-4df3-90e7-a19b141de314]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d, portal: 172.16.0.220,3260]
Aug 26 23:22:00 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d, portal: 172.16.0.220,3260] successful.
Aug 26 23:22:00 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c4c3a1-fb10-44c9-9791-8410bf477353]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f525b9-d791-42d0-9bc0-2cf012b46276]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:22:00 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:22:00 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:22:00 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:22:00 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:22:00 user nova-compute[73497]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:22:00 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:22:00 user nova-compute[73497]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)
Aug 26 23:22:00 user nova-compute[73497]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)
Aug 26 23:22:00 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:22:00 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:22:00 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:22:00 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:22:00 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:22:00 user nova-compute[73497]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:22:00 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:22:00 user nova-compute[73497]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)
Aug 26 23:22:00 user nova-compute[73497]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)
Aug 26 23:22:00 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] HCTL ('41', '-', '-', 0) found on session 25 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3487f337-c282-41bb-92de-ef47adb66a71]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Searching for a device in session 25 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IJqErCFS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:22:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.767s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.426s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] <== connect_volume: return (1427ms) {'type': 'block', 'scsi_wwn': '23533383836393031', 'path': '/dev/sdj'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533383836393031', 'path': '/dev/sdj'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-205430132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-205430132',id=23,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZTGKDD5+6wKJv+qSBFC2QIq1zbuNCSkVKeLhNBhJmlu5Tah1mZHQVv045hmJBRsSlpvrVR8wYUYQpC1V8NdW/9+lYWvh37hJtGt3UxBAVXoF3/oiPeqjEaPUP5fVxK9g==',key_name='tempest-keypair-1216137119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aff3ec8f2aad4d71b65787eabb90dd6c',ramdisk_id='',reservation_id='r-x06xli4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-661216102',owner_user_name='tempest-TaggedBootDevicesTest_v242-661216102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:21:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30c55eba7b184a4cbf56d776ae544721',uuid=a6c7669c-f338-4e2b-9ba7-96d8e66d10ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d114632c-d651-4419-9f82-ecaa90cd381b", "address": "fa:16:3e:7a:e8:f3", "network": {"id": "d6df8ba3-c833-4cf3-8865-2e449087bead", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-54509536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd114632c-d6", "ovs_interfaceid": "d114632c-d651-4419-9f82-ecaa90cd381b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converting VIF {"id": "d114632c-d651-4419-9f82-ecaa90cd381b", "address": "fa:16:3e:7a:e8:f3", "network": {"id": "d6df8ba3-c833-4cf3-8865-2e449087bead", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-54509536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd114632c-d6", "ovs_interfaceid": "d114632c-d651-4419-9f82-ecaa90cd381b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:e8:f3,bridge_name='br-int',has_traffic_filtering=True,id=d114632c-d651-4419-9f82-ecaa90cd381b,network=Network(d6df8ba3-c833-4cf3-8865-2e449087bead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd114632c-d6') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-205430132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-205430132',id=23,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZTGKDD5+6wKJv+qSBFC2QIq1zbuNCSkVKeLhNBhJmlu5Tah1mZHQVv045hmJBRsSlpvrVR8wYUYQpC1V8NdW/9+lYWvh37hJtGt3UxBAVXoF3/oiPeqjEaPUP5fVxK9g==',key_name='tempest-keypair-1216137119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aff3ec8f2aad4d71b65787eabb90dd6c',ramdisk_id='',reservation_id='r-x06xli4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-661216102',owner_user_name='tempest-TaggedBootDevicesTest_v242-661216102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:21:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30c55eba7b184a4cbf56d776ae544721',uuid=a6c7669c-f338-4e2b-9ba7-96d8e66d10ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c268fbf7-6a36-44b5-8361-42160a69b1d4", "address": "fa:16:3e:e6:16:95", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc268fbf7-6a", "ovs_interfaceid": "c268fbf7-6a36-44b5-8361-42160a69b1d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converting VIF {"id": "c268fbf7-6a36-44b5-8361-42160a69b1d4", "address": "fa:16:3e:e6:16:95", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc268fbf7-6a", "ovs_interfaceid": "c268fbf7-6a36-44b5-8361-42160a69b1d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:16:95,bridge_name='br-int',has_traffic_filtering=True,id=c268fbf7-6a36-44b5-8361-42160a69b1d4,network=Network(1f830eee-2d57-4294-89d6-010b5322c6ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc268fbf7-6a') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-205430132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-205430132',id=23,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZTGKDD5+6wKJv+qSBFC2QIq1zbuNCSkVKeLhNBhJmlu5Tah1mZHQVv045hmJBRsSlpvrVR8wYUYQpC1V8NdW/9+lYWvh37hJtGt3UxBAVXoF3/oiPeqjEaPUP5fVxK9g==',key_name='tempest-keypair-1216137119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aff3ec8f2aad4d71b65787eabb90dd6c',ramdisk_id='',reservation_id='r-x06xli4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-661216102',owner_user_name='tempest-TaggedBootDevicesTest_v242-661216102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:21:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30c55eba7b184a4cbf56d776ae544721',uuid=a6c7669c-f338-4e2b-9ba7-96d8e66d10ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "372fa1fa-b52b-479a-b228-91eebb1d3e3f", "address": "fa:16:3e:b0:c0:5e", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372fa1fa-b5", "ovs_interfaceid": "372fa1fa-b52b-479a-b228-91eebb1d3e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converting VIF {"id": "372fa1fa-b52b-479a-b228-91eebb1d3e3f", "address": "fa:16:3e:b0:c0:5e", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372fa1fa-b5", "ovs_interfaceid": "372fa1fa-b52b-479a-b228-91eebb1d3e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:c0:5e,bridge_name='br-int',has_traffic_filtering=True,id=372fa1fa-b52b-479a-b228-91eebb1d3e3f,network=Network(1f830eee-2d57-4294-89d6-010b5322c6ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap372fa1fa-b5') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-205430132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-205430132',id=23,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZTGKDD5+6wKJv+qSBFC2QIq1zbuNCSkVKeLhNBhJmlu5Tah1mZHQVv045hmJBRsSlpvrVR8wYUYQpC1V8NdW/9+lYWvh37hJtGt3UxBAVXoF3/oiPeqjEaPUP5fVxK9g==',key_name='tempest-keypair-1216137119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aff3ec8f2aad4d71b65787eabb90dd6c',ramdisk_id='',reservation_id='r-x06xli4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-661216102',owner_user_name='tempest-TaggedBootDevicesTest_v242-661216102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:21:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30c55eba7b184a4cbf56d776ae544721',uuid=a6c7669c-f338-4e2b-9ba7-96d8e66d10ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c81f6a7-92b5-496b-867f-c10965da8e40", "address": "fa:16:3e:8e:33:9e", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c81f6a7-92", "ovs_interfaceid": "7c81f6a7-92b5-496b-867f-c10965da8e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converting VIF {"id": "7c81f6a7-92b5-496b-867f-c10965da8e40", "address": "fa:16:3e:8e:33:9e", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c81f6a7-92", "ovs_interfaceid": "7c81f6a7-92b5-496b-867f-c10965da8e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:33:9e,bridge_name='br-int',has_traffic_filtering=True,id=7c81f6a7-92b5-496b-867f-c10965da8e40,network=Network(1f830eee-2d57-4294-89d6-010b5322c6ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c81f6a7-92') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-205430132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-205430132',id=23,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZTGKDD5+6wKJv+qSBFC2QIq1zbuNCSkVKeLhNBhJmlu5Tah1mZHQVv045hmJBRsSlpvrVR8wYUYQpC1V8NdW/9+lYWvh37hJtGt3UxBAVXoF3/oiPeqjEaPUP5fVxK9g==',key_name='tempest-keypair-1216137119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aff3ec8f2aad4d71b65787eabb90dd6c',ramdisk_id='',reservation_id='r-x06xli4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-661216102',owner_user_name='tempest-TaggedBootDevicesTest_v242-661216102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:21:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30c55eba7b184a4cbf56d776ae544721',uuid=a6c7669c-f338-4e2b-9ba7-96d8e66d10ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "792a72cb-3624-45eb-a8f7-01cf52196f2d", "address": "fa:16:3e:73:4e:ac", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap792a72cb-36", "ovs_interfaceid": "792a72cb-3624-45eb-a8f7-01cf52196f2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converting VIF {"id": "792a72cb-3624-45eb-a8f7-01cf52196f2d", "address": "fa:16:3e:73:4e:ac", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap792a72cb-36", "ovs_interfaceid": "792a72cb-3624-45eb-a8f7-01cf52196f2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:4e:ac,bridge_name='br-int',has_traffic_filtering=True,id=792a72cb-3624-45eb-a8f7-01cf52196f2d,network=Network(1f830eee-2d57-4294-89d6-010b5322c6ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap792a72cb-36') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-205430132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-205430132',id=23,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZTGKDD5+6wKJv+qSBFC2QIq1zbuNCSkVKeLhNBhJmlu5Tah1mZHQVv045hmJBRsSlpvrVR8wYUYQpC1V8NdW/9+lYWvh37hJtGt3UxBAVXoF3/oiPeqjEaPUP5fVxK9g==',key_name='tempest-keypair-1216137119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aff3ec8f2aad4d71b65787eabb90dd6c',ramdisk_id='',reservation_id='r-x06xli4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-661216102',owner_user_name='tempest-TaggedBootDevicesTest_v242-661216102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:21:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30c55eba7b184a4cbf56d776ae544721',uuid=a6c7669c-f338-4e2b-9ba7-96d8e66d10ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35958938-f4c5-4745-99ca-0f0761fd801c", "address": "fa:16:3e:d2:d0:65", "network": {"id": "15044bd5-0863-41a2-ad57-abbdad59baa3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1012445693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35958938-f4", "ovs_interfaceid": "35958938-f4c5-4745-99ca-0f0761fd801c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converting VIF {"id": "35958938-f4c5-4745-99ca-0f0761fd801c", "address": "fa:16:3e:d2:d0:65", "network": {"id": "15044bd5-0863-41a2-ad57-abbdad59baa3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1012445693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35958938-f4", "ovs_interfaceid": "35958938-f4c5-4745-99ca-0f0761fd801c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:d0:65,bridge_name='br-int',has_traffic_filtering=True,id=35958938-f4c5-4745-99ca-0f0761fd801c,network=Network(15044bd5-0863-41a2-ad57-abbdad59baa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35958938-f4') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-205430132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-205430132',id=23,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZTGKDD5+6wKJv+qSBFC2QIq1zbuNCSkVKeLhNBhJmlu5Tah1mZHQVv045hmJBRsSlpvrVR8wYUYQpC1V8NdW/9+lYWvh37hJtGt3UxBAVXoF3/oiPeqjEaPUP5fVxK9g==',key_name='tempest-keypair-1216137119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aff3ec8f2aad4d71b65787eabb90dd6c',ramdisk_id='',reservation_id='r-x06xli4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-661216102',owner_user_name='tempest-TaggedBootDevicesTest_v242-661216102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:21:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30c55eba7b184a4cbf56d776ae544721',uuid=a6c7669c-f338-4e2b-9ba7-96d8e66d10ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6361122d-0a82-4b1d-8ea5-dedb8984f15f", "address": "fa:16:3e:e1:fa:e3", "network": {"id": "15044bd5-0863-41a2-ad57-abbdad59baa3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1012445693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6361122d-0a", "ovs_interfaceid": "6361122d-0a82-4b1d-8ea5-dedb8984f15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converting VIF {"id": "6361122d-0a82-4b1d-8ea5-dedb8984f15f", "address": "fa:16:3e:e1:fa:e3", "network": {"id": "15044bd5-0863-41a2-ad57-abbdad59baa3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1012445693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6361122d-0a", "ovs_interfaceid": "6361122d-0a82-4b1d-8ea5-dedb8984f15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:fa:e3,bridge_name='br-int',has_traffic_filtering=True,id=6361122d-0a82-4b1d-8ea5-dedb8984f15f,network=Network(15044bd5-0863-41a2-ad57-abbdad59baa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6361122d-0a') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.objects.instance [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Lazy-loading 'pci_devices' on Instance uuid a6c7669c-f338-4e2b-9ba7-96d8e66d10ed {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:22:01 user nova-compute[73497]:   <uuid>a6c7669c-f338-4e2b-9ba7-96d8e66d10ed</uuid>
Aug 26 23:22:01 user nova-compute[73497]:   <name>instance-00000017</name>
Aug 26 23:22:01 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:22:01 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:22:01 user nova-compute[73497]:   <metadata>
Aug 26 23:22:01 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:22:01 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:22:01 user nova-compute[73497]:       <nova:name>tempest-device-tagging-server-205430132</nova:name>
Aug 26 23:22:01 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:21:56</nova:creationTime>
Aug 26 23:22:01 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:22:01 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:22:01 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:22:01 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:22:01 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:22:01 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:22:01 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:22:01 user nova-compute[73497]:       <nova:owner>
Aug 26 23:22:01 user nova-compute[73497]:         <nova:user uuid="30c55eba7b184a4cbf56d776ae544721">tempest-TaggedBootDevicesTest_v242-661216102-project-member</nova:user>
Aug 26 23:22:01 user nova-compute[73497]:         <nova:project uuid="aff3ec8f2aad4d71b65787eabb90dd6c">tempest-TaggedBootDevicesTest_v242-661216102</nova:project>
Aug 26 23:22:01 user nova-compute[73497]:       </nova:owner>
Aug 26 23:22:01 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:22:01 user nova-compute[73497]:       <nova:ports>
Aug 26 23:22:01 user nova-compute[73497]:         <nova:port uuid="d114632c-d651-4419-9f82-ecaa90cd381b">
Aug 26 23:22:01 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 23:22:01 user nova-compute[73497]:         </nova:port>
Aug 26 23:22:01 user nova-compute[73497]:         <nova:port uuid="c268fbf7-6a36-44b5-8361-42160a69b1d4">
Aug 26 23:22:01 user nova-compute[73497]:           <nova:ip type="fixed" address="10.1.1.14" ipVersion="4"/>
Aug 26 23:22:01 user nova-compute[73497]:         </nova:port>
Aug 26 23:22:01 user nova-compute[73497]:         <nova:port uuid="372fa1fa-b52b-479a-b228-91eebb1d3e3f">
Aug 26 23:22:01 user nova-compute[73497]:           <nova:ip type="fixed" address="10.1.1.92" ipVersion="4"/>
Aug 26 23:22:01 user nova-compute[73497]:         </nova:port>
Aug 26 23:22:01 user nova-compute[73497]:         <nova:port uuid="7c81f6a7-92b5-496b-867f-c10965da8e40">
Aug 26 23:22:01 user nova-compute[73497]:           <nova:ip type="fixed" address="10.1.1.235" ipVersion="4"/>
Aug 26 23:22:01 user nova-compute[73497]:         </nova:port>
Aug 26 23:22:01 user nova-compute[73497]:         <nova:port uuid="792a72cb-3624-45eb-a8f7-01cf52196f2d">
Aug 26 23:22:01 user nova-compute[73497]:           <nova:ip type="fixed" address="10.1.1.36" ipVersion="4"/>
Aug 26 23:22:01 user nova-compute[73497]:         </nova:port>
Aug 26 23:22:01 user nova-compute[73497]:         <nova:port uuid="35958938-f4c5-4745-99ca-0f0761fd801c">
Aug 26 23:22:01 user nova-compute[73497]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 26 23:22:01 user nova-compute[73497]:         </nova:port>
Aug 26 23:22:01 user nova-compute[73497]:         <nova:port uuid="6361122d-0a82-4b1d-8ea5-dedb8984f15f">
Aug 26 23:22:01 user nova-compute[73497]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 26 23:22:01 user nova-compute[73497]:         </nova:port>
Aug 26 23:22:01 user nova-compute[73497]:       </nova:ports>
Aug 26 23:22:01 user nova-compute[73497]:     </nova:instance>
Aug 26 23:22:01 user nova-compute[73497]:   </metadata>
Aug 26 23:22:01 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:22:01 user nova-compute[73497]:     <system>
Aug 26 23:22:01 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:22:01 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:22:01 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:22:01 user nova-compute[73497]:       <entry name="serial">a6c7669c-f338-4e2b-9ba7-96d8e66d10ed</entry>
Aug 26 23:22:01 user nova-compute[73497]:       <entry name="uuid">a6c7669c-f338-4e2b-9ba7-96d8e66d10ed</entry>
Aug 26 23:22:01 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:22:01 user nova-compute[73497]:     </system>
Aug 26 23:22:01 user nova-compute[73497]:   </sysinfo>
Aug 26 23:22:01 user nova-compute[73497]:   <os>
Aug 26 23:22:01 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:22:01 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:22:01 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:22:01 user nova-compute[73497]:   </os>
Aug 26 23:22:01 user nova-compute[73497]:   <features>
Aug 26 23:22:01 user nova-compute[73497]:     <acpi/>
Aug 26 23:22:01 user nova-compute[73497]:     <apic/>
Aug 26 23:22:01 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:22:01 user nova-compute[73497]:   </features>
Aug 26 23:22:01 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:22:01 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:22:01 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:22:01 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:22:01 user nova-compute[73497]:   </clock>
Aug 26 23:22:01 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:22:01 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:22:01 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:22:01 user nova-compute[73497]:   </cpu>
Aug 26 23:22:01 user nova-compute[73497]:   <devices>
Aug 26 23:22:01 user nova-compute[73497]:     <disk type="file" device="cdrom">
Aug 26 23:22:01 user nova-compute[73497]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 23:22:01 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/a6c7669c-f338-4e2b-9ba7-96d8e66d10ed/disk.config"/>
Aug 26 23:22:01 user nova-compute[73497]:       <target dev="hda" bus="ide"/>
Aug 26 23:22:01 user nova-compute[73497]:     </disk>
Aug 26 23:22:01 user nova-compute[73497]:     <disk type="block" device="disk">
Aug 26 23:22:01 user nova-compute[73497]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:22:01 user nova-compute[73497]:       <source dev="/dev/sdb"/>
Aug 26 23:22:01 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:22:01 user nova-compute[73497]:       <serial>5a291925-0e24-48cd-bb57-40dc15ac7912</serial>
Aug 26 23:22:01 user nova-compute[73497]:     </disk>
Aug 26 23:22:01 user nova-compute[73497]:     <disk type="block" device="disk">
Aug 26 23:22:01 user nova-compute[73497]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:22:01 user nova-compute[73497]:       <source dev="/dev/sdi"/>
Aug 26 23:22:01 user nova-compute[73497]:       <target dev="vdb" bus="virtio"/>
Aug 26 23:22:01 user nova-compute[73497]:       <serial>6da56445-077b-42eb-90ee-12eba93589a3</serial>
Aug 26 23:22:01 user nova-compute[73497]:     </disk>
Aug 26 23:22:01 user nova-compute[73497]:     <disk type="block" device="disk">
Aug 26 23:22:01 user nova-compute[73497]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:22:01 user nova-compute[73497]:       <source dev="/dev/sdj"/>
Aug 26 23:22:01 user nova-compute[73497]:       <target dev="vdc" bus="virtio"/>
Aug 26 23:22:01 user nova-compute[73497]:       <serial>ae929108-9690-475d-a816-c0fad8ee791d</serial>
Aug 26 23:22:01 user nova-compute[73497]:     </disk>
Aug 26 23:22:01 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:22:01 user nova-compute[73497]:       <mac address="fa:16:3e:7a:e8:f3"/>
Aug 26 23:22:01 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:22:01 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:22:01 user nova-compute[73497]:       <target dev="tapd114632c-d6"/>
Aug 26 23:22:01 user nova-compute[73497]:     </interface>
Aug 26 23:22:01 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:22:01 user nova-compute[73497]:       <mac address="fa:16:3e:e6:16:95"/>
Aug 26 23:22:01 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:22:01 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:22:01 user nova-compute[73497]:       <target dev="tapc268fbf7-6a"/>
Aug 26 23:22:01 user nova-compute[73497]:     </interface>
Aug 26 23:22:01 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:22:01 user nova-compute[73497]:       <mac address="fa:16:3e:b0:c0:5e"/>
Aug 26 23:22:01 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:22:01 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:22:01 user nova-compute[73497]:       <target dev="tap372fa1fa-b5"/>
Aug 26 23:22:01 user nova-compute[73497]:     </interface>
Aug 26 23:22:01 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:22:01 user nova-compute[73497]:       <mac address="fa:16:3e:8e:33:9e"/>
Aug 26 23:22:01 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:22:01 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:22:01 user nova-compute[73497]:       <target dev="tap7c81f6a7-92"/>
Aug 26 23:22:01 user nova-compute[73497]:     </interface>
Aug 26 23:22:01 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:22:01 user nova-compute[73497]:       <mac address="fa:16:3e:73:4e:ac"/>
Aug 26 23:22:01 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:22:01 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:22:01 user nova-compute[73497]:       <target dev="tap792a72cb-36"/>
Aug 26 23:22:01 user nova-compute[73497]:     </interface>
Aug 26 23:22:01 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:22:01 user nova-compute[73497]:       <mac address="fa:16:3e:d2:d0:65"/>
Aug 26 23:22:01 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:22:01 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:22:01 user nova-compute[73497]:       <target dev="tap35958938-f4"/>
Aug 26 23:22:01 user nova-compute[73497]:     </interface>
Aug 26 23:22:01 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:22:01 user nova-compute[73497]:       <mac address="fa:16:3e:e1:fa:e3"/>
Aug 26 23:22:01 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:22:01 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:22:01 user nova-compute[73497]:       <target dev="tap6361122d-0a"/>
Aug 26 23:22:01 user nova-compute[73497]:     </interface>
Aug 26 23:22:01 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:22:01 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/a6c7669c-f338-4e2b-9ba7-96d8e66d10ed/console.log" append="off"/>
Aug 26 23:22:01 user nova-compute[73497]:     </serial>
Aug 26 23:22:01 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:22:01 user nova-compute[73497]:     <video>
Aug 26 23:22:01 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:22:01 user nova-compute[73497]:     </video>
Aug 26 23:22:01 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:22:01 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:22:01 user nova-compute[73497]:     </rng>
Aug 26 23:22:01 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:22:01 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:22:01 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:22:01 user nova-compute[73497]:     </memballoon>
Aug 26 23:22:01 user nova-compute[73497]:   </devices>
Aug 26 23:22:01 user nova-compute[73497]: </domain>
Aug 26 23:22:01 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-205430132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-205430132',id=23,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZTGKDD5+6wKJv+qSBFC2QIq1zbuNCSkVKeLhNBhJmlu5Tah1mZHQVv045hmJBRsSlpvrVR8wYUYQpC1V8NdW/9+lYWvh37hJtGt3UxBAVXoF3/oiPeqjEaPUP5fVxK9g==',key_name='tempest-keypair-1216137119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aff3ec8f2aad4d71b65787eabb90dd6c',ramdisk_id='',reservation_id='r-x06xli4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-661216102',owner_user_name='tempest-TaggedBootDevicesTest_v242-661216102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:21:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30c55eba7b184a4cbf56d776ae544721',uuid=a6c7669c-f338-4e2b-9ba7-96d8e66d10ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d114632c-d651-4419-9f82-ecaa90cd381b", "address": "fa:16:3e:7a:e8:f3", "network": {"id": "d6df8ba3-c833-4cf3-8865-2e449087bead", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-54509536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd114632c-d6", "ovs_interfaceid": "d114632c-d651-4419-9f82-ecaa90cd381b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converting VIF {"id": "d114632c-d651-4419-9f82-ecaa90cd381b", "address": "fa:16:3e:7a:e8:f3", "network": {"id": "d6df8ba3-c833-4cf3-8865-2e449087bead", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-54509536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd114632c-d6", "ovs_interfaceid": "d114632c-d651-4419-9f82-ecaa90cd381b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:e8:f3,bridge_name='br-int',has_traffic_filtering=True,id=d114632c-d651-4419-9f82-ecaa90cd381b,network=Network(d6df8ba3-c833-4cf3-8865-2e449087bead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd114632c-d6') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG os_vif [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:e8:f3,bridge_name='br-int',has_traffic_filtering=True,id=d114632c-d651-4419-9f82-ecaa90cd381b,network=Network(d6df8ba3-c833-4cf3-8865-2e449087bead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd114632c-d6') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd114632c-d6, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd114632c-d6, col_values=(('external_ids', {'iface-id': 'd114632c-d651-4419-9f82-ecaa90cd381b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:e8:f3', 'vm-uuid': 'a6c7669c-f338-4e2b-9ba7-96d8e66d10ed'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:01 user nova-compute[73497]: INFO os_vif [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:e8:f3,bridge_name='br-int',has_traffic_filtering=True,id=d114632c-d651-4419-9f82-ecaa90cd381b,network=Network(d6df8ba3-c833-4cf3-8865-2e449087bead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd114632c-d6')
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-205430132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-205430132',id=23,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZTGKDD5+6wKJv+qSBFC2QIq1zbuNCSkVKeLhNBhJmlu5Tah1mZHQVv045hmJBRsSlpvrVR8wYUYQpC1V8NdW/9+lYWvh37hJtGt3UxBAVXoF3/oiPeqjEaPUP5fVxK9g==',key_name='tempest-keypair-1216137119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aff3ec8f2aad4d71b65787eabb90dd6c',ramdisk_id='',reservation_id='r-x06xli4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-661216102',owner_user_name='tempest-TaggedBootDevicesTest_v242-661216102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:21:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30c55eba7b184a4cbf56d776ae544721',uuid=a6c7669c-f338-4e2b-9ba7-96d8e66d10ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c268fbf7-6a36-44b5-8361-42160a69b1d4", "address": "fa:16:3e:e6:16:95", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc268fbf7-6a", "ovs_interfaceid": "c268fbf7-6a36-44b5-8361-42160a69b1d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converting VIF {"id": "c268fbf7-6a36-44b5-8361-42160a69b1d4", "address": "fa:16:3e:e6:16:95", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc268fbf7-6a", "ovs_interfaceid": "c268fbf7-6a36-44b5-8361-42160a69b1d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:16:95,bridge_name='br-int',has_traffic_filtering=True,id=c268fbf7-6a36-44b5-8361-42160a69b1d4,network=Network(1f830eee-2d57-4294-89d6-010b5322c6ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc268fbf7-6a') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG os_vif [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:16:95,bridge_name='br-int',has_traffic_filtering=True,id=c268fbf7-6a36-44b5-8361-42160a69b1d4,network=Network(1f830eee-2d57-4294-89d6-010b5322c6ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc268fbf7-6a') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc268fbf7-6a, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc268fbf7-6a, col_values=(('external_ids', {'iface-id': 'c268fbf7-6a36-44b5-8361-42160a69b1d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:16:95', 'vm-uuid': 'a6c7669c-f338-4e2b-9ba7-96d8e66d10ed'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:01 user nova-compute[73497]: INFO os_vif [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:16:95,bridge_name='br-int',has_traffic_filtering=True,id=c268fbf7-6a36-44b5-8361-42160a69b1d4,network=Network(1f830eee-2d57-4294-89d6-010b5322c6ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc268fbf7-6a')
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-205430132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-205430132',id=23,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZTGKDD5+6wKJv+qSBFC2QIq1zbuNCSkVKeLhNBhJmlu5Tah1mZHQVv045hmJBRsSlpvrVR8wYUYQpC1V8NdW/9+lYWvh37hJtGt3UxBAVXoF3/oiPeqjEaPUP5fVxK9g==',key_name='tempest-keypair-1216137119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aff3ec8f2aad4d71b65787eabb90dd6c',ramdisk_id='',reservation_id='r-x06xli4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-661216102',owner_user_name='tempest-TaggedBootDevicesTest_v242-661216102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:21:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30c55eba7b184a4cbf56d776ae544721',uuid=a6c7669c-f338-4e2b-9ba7-96d8e66d10ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "372fa1fa-b52b-479a-b228-91eebb1d3e3f", "address": "fa:16:3e:b0:c0:5e", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372fa1fa-b5", "ovs_interfaceid": "372fa1fa-b52b-479a-b228-91eebb1d3e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converting VIF {"id": "372fa1fa-b52b-479a-b228-91eebb1d3e3f", "address": "fa:16:3e:b0:c0:5e", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372fa1fa-b5", "ovs_interfaceid": "372fa1fa-b52b-479a-b228-91eebb1d3e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:c0:5e,bridge_name='br-int',has_traffic_filtering=True,id=372fa1fa-b52b-479a-b228-91eebb1d3e3f,network=Network(1f830eee-2d57-4294-89d6-010b5322c6ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap372fa1fa-b5') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG os_vif [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:c0:5e,bridge_name='br-int',has_traffic_filtering=True,id=372fa1fa-b52b-479a-b228-91eebb1d3e3f,network=Network(1f830eee-2d57-4294-89d6-010b5322c6ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap372fa1fa-b5') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap372fa1fa-b5, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap372fa1fa-b5, col_values=(('external_ids', {'iface-id': '372fa1fa-b52b-479a-b228-91eebb1d3e3f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:c0:5e', 'vm-uuid': 'a6c7669c-f338-4e2b-9ba7-96d8e66d10ed'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:01 user nova-compute[73497]: INFO os_vif [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:c0:5e,bridge_name='br-int',has_traffic_filtering=True,id=372fa1fa-b52b-479a-b228-91eebb1d3e3f,network=Network(1f830eee-2d57-4294-89d6-010b5322c6ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap372fa1fa-b5')
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-205430132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-205430132',id=23,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZTGKDD5+6wKJv+qSBFC2QIq1zbuNCSkVKeLhNBhJmlu5Tah1mZHQVv045hmJBRsSlpvrVR8wYUYQpC1V8NdW/9+lYWvh37hJtGt3UxBAVXoF3/oiPeqjEaPUP5fVxK9g==',key_name='tempest-keypair-1216137119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aff3ec8f2aad4d71b65787eabb90dd6c',ramdisk_id='',reservation_id='r-x06xli4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-661216102',owner_user_name='tempest-TaggedBootDevicesTest_v242-661216102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:21:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30c55eba7b184a4cbf56d776ae544721',uuid=a6c7669c-f338-4e2b-9ba7-96d8e66d10ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c81f6a7-92b5-496b-867f-c10965da8e40", "address": "fa:16:3e:8e:33:9e", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c81f6a7-92", "ovs_interfaceid": "7c81f6a7-92b5-496b-867f-c10965da8e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converting VIF {"id": "7c81f6a7-92b5-496b-867f-c10965da8e40", "address": "fa:16:3e:8e:33:9e", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c81f6a7-92", "ovs_interfaceid": "7c81f6a7-92b5-496b-867f-c10965da8e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:33:9e,bridge_name='br-int',has_traffic_filtering=True,id=7c81f6a7-92b5-496b-867f-c10965da8e40,network=Network(1f830eee-2d57-4294-89d6-010b5322c6ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c81f6a7-92') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG os_vif [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:33:9e,bridge_name='br-int',has_traffic_filtering=True,id=7c81f6a7-92b5-496b-867f-c10965da8e40,network=Network(1f830eee-2d57-4294-89d6-010b5322c6ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c81f6a7-92') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c81f6a7-92, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7c81f6a7-92, col_values=(('external_ids', {'iface-id': '7c81f6a7-92b5-496b-867f-c10965da8e40', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:33:9e', 'vm-uuid': 'a6c7669c-f338-4e2b-9ba7-96d8e66d10ed'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:01 user nova-compute[73497]: INFO os_vif [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:33:9e,bridge_name='br-int',has_traffic_filtering=True,id=7c81f6a7-92b5-496b-867f-c10965da8e40,network=Network(1f830eee-2d57-4294-89d6-010b5322c6ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c81f6a7-92')
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-205430132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-205430132',id=23,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZTGKDD5+6wKJv+qSBFC2QIq1zbuNCSkVKeLhNBhJmlu5Tah1mZHQVv045hmJBRsSlpvrVR8wYUYQpC1V8NdW/9+lYWvh37hJtGt3UxBAVXoF3/oiPeqjEaPUP5fVxK9g==',key_name='tempest-keypair-1216137119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aff3ec8f2aad4d71b65787eabb90dd6c',ramdisk_id='',reservation_id='r-x06xli4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-661216102',owner_user_name='tempest-TaggedBootDevicesTest_v242-661216102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:21:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30c55eba7b184a4cbf56d776ae544721',uuid=a6c7669c-f338-4e2b-9ba7-96d8e66d10ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "792a72cb-3624-45eb-a8f7-01cf52196f2d", "address": "fa:16:3e:73:4e:ac", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap792a72cb-36", "ovs_interfaceid": "792a72cb-3624-45eb-a8f7-01cf52196f2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converting VIF {"id": "792a72cb-3624-45eb-a8f7-01cf52196f2d", "address": "fa:16:3e:73:4e:ac", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap792a72cb-36", "ovs_interfaceid": "792a72cb-3624-45eb-a8f7-01cf52196f2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:4e:ac,bridge_name='br-int',has_traffic_filtering=True,id=792a72cb-3624-45eb-a8f7-01cf52196f2d,network=Network(1f830eee-2d57-4294-89d6-010b5322c6ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap792a72cb-36') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG os_vif [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:4e:ac,bridge_name='br-int',has_traffic_filtering=True,id=792a72cb-3624-45eb-a8f7-01cf52196f2d,network=Network(1f830eee-2d57-4294-89d6-010b5322c6ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap792a72cb-36') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap792a72cb-36, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap792a72cb-36, col_values=(('external_ids', {'iface-id': '792a72cb-3624-45eb-a8f7-01cf52196f2d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:4e:ac', 'vm-uuid': 'a6c7669c-f338-4e2b-9ba7-96d8e66d10ed'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:01 user nova-compute[73497]: INFO os_vif [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:4e:ac,bridge_name='br-int',has_traffic_filtering=True,id=792a72cb-3624-45eb-a8f7-01cf52196f2d,network=Network(1f830eee-2d57-4294-89d6-010b5322c6ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap792a72cb-36')
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-205430132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-205430132',id=23,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZTGKDD5+6wKJv+qSBFC2QIq1zbuNCSkVKeLhNBhJmlu5Tah1mZHQVv045hmJBRsSlpvrVR8wYUYQpC1V8NdW/9+lYWvh37hJtGt3UxBAVXoF3/oiPeqjEaPUP5fVxK9g==',key_name='tempest-keypair-1216137119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aff3ec8f2aad4d71b65787eabb90dd6c',ramdisk_id='',reservation_id='r-x06xli4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-661216102',owner_user_name='tempest-TaggedBootDevicesTest_v242-661216102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:21:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30c55eba7b184a4cbf56d776ae544721',uuid=a6c7669c-f338-4e2b-9ba7-96d8e66d10ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35958938-f4c5-4745-99ca-0f0761fd801c", "address": "fa:16:3e:d2:d0:65", "network": {"id": "15044bd5-0863-41a2-ad57-abbdad59baa3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1012445693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35958938-f4", "ovs_interfaceid": "35958938-f4c5-4745-99ca-0f0761fd801c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converting VIF {"id": "35958938-f4c5-4745-99ca-0f0761fd801c", "address": "fa:16:3e:d2:d0:65", "network": {"id": "15044bd5-0863-41a2-ad57-abbdad59baa3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1012445693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35958938-f4", "ovs_interfaceid": "35958938-f4c5-4745-99ca-0f0761fd801c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:d0:65,bridge_name='br-int',has_traffic_filtering=True,id=35958938-f4c5-4745-99ca-0f0761fd801c,network=Network(15044bd5-0863-41a2-ad57-abbdad59baa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35958938-f4') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG os_vif [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:d0:65,bridge_name='br-int',has_traffic_filtering=True,id=35958938-f4c5-4745-99ca-0f0761fd801c,network=Network(15044bd5-0863-41a2-ad57-abbdad59baa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35958938-f4') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35958938-f4, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap35958938-f4, col_values=(('external_ids', {'iface-id': '35958938-f4c5-4745-99ca-0f0761fd801c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:d0:65', 'vm-uuid': 'a6c7669c-f338-4e2b-9ba7-96d8e66d10ed'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:01 user nova-compute[73497]: INFO os_vif [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:d0:65,bridge_name='br-int',has_traffic_filtering=True,id=35958938-f4c5-4745-99ca-0f0761fd801c,network=Network(15044bd5-0863-41a2-ad57-abbdad59baa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35958938-f4')
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-205430132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-205430132',id=23,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZTGKDD5+6wKJv+qSBFC2QIq1zbuNCSkVKeLhNBhJmlu5Tah1mZHQVv045hmJBRsSlpvrVR8wYUYQpC1V8NdW/9+lYWvh37hJtGt3UxBAVXoF3/oiPeqjEaPUP5fVxK9g==',key_name='tempest-keypair-1216137119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aff3ec8f2aad4d71b65787eabb90dd6c',ramdisk_id='',reservation_id='r-x06xli4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-661216102',owner_user_name='tempest-TaggedBootDevicesTest_v242-661216102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:21:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30c55eba7b184a4cbf56d776ae544721',uuid=a6c7669c-f338-4e2b-9ba7-96d8e66d10ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6361122d-0a82-4b1d-8ea5-dedb8984f15f", "address": "fa:16:3e:e1:fa:e3", "network": {"id": "15044bd5-0863-41a2-ad57-abbdad59baa3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1012445693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6361122d-0a", "ovs_interfaceid": "6361122d-0a82-4b1d-8ea5-dedb8984f15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converting VIF {"id": "6361122d-0a82-4b1d-8ea5-dedb8984f15f", "address": "fa:16:3e:e1:fa:e3", "network": {"id": "15044bd5-0863-41a2-ad57-abbdad59baa3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1012445693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6361122d-0a", "ovs_interfaceid": "6361122d-0a82-4b1d-8ea5-dedb8984f15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:fa:e3,bridge_name='br-int',has_traffic_filtering=True,id=6361122d-0a82-4b1d-8ea5-dedb8984f15f,network=Network(15044bd5-0863-41a2-ad57-abbdad59baa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6361122d-0a') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG os_vif [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:fa:e3,bridge_name='br-int',has_traffic_filtering=True,id=6361122d-0a82-4b1d-8ea5-dedb8984f15f,network=Network(15044bd5-0863-41a2-ad57-abbdad59baa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6361122d-0a') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6361122d-0a, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6361122d-0a, col_values=(('external_ids', {'iface-id': '6361122d-0a82-4b1d-8ea5-dedb8984f15f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:fa:e3', 'vm-uuid': 'a6c7669c-f338-4e2b-9ba7-96d8e66d10ed'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:01 user nova-compute[73497]: INFO os_vif [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:fa:e3,bridge_name='br-int',has_traffic_filtering=True,id=6361122d-0a82-4b1d-8ea5-dedb8984f15f,network=Network(15044bd5-0863-41a2-ad57-abbdad59baa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6361122d-0a')
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] No BDM found with device name hda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] No VIF found with MAC fa:16:3e:7a:e8:f3, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:22:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] No VIF found with MAC fa:16:3e:73:4e:ac, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:22:01 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Using config drive
Aug 26 23:22:01 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Creating config drive at /opt/stack/data/nova/instances/a6c7669c-f338-4e2b-9ba7-96d8e66d10ed/disk.config
Aug 26 23:22:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a6c7669c-f338-4e2b-9ba7-96d8e66d10ed/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpty59cve4 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a6c7669c-f338-4e2b-9ba7-96d8e66d10ed/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpty59cve4" returned: 0 in 0.055s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-87c6a71a-9686-4882-81d4-667f7356c426 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Acquiring lock "926f8e5c-8d8a-4f07-bf08-e60700ce4698" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-87c6a71a-9686-4882-81d4-667f7356c426 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Lock "926f8e5c-8d8a-4f07-bf08-e60700ce4698" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-87c6a71a-9686-4882-81d4-667f7356c426 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Acquiring lock "926f8e5c-8d8a-4f07-bf08-e60700ce4698-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-87c6a71a-9686-4882-81d4-667f7356c426 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Lock "926f8e5c-8d8a-4f07-bf08-e60700ce4698-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-87c6a71a-9686-4882-81d4-667f7356c426 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Lock "926f8e5c-8d8a-4f07-bf08-e60700ce4698-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:03 user nova-compute[73497]: INFO nova.compute.manager [None req-87c6a71a-9686-4882-81d4-667f7356c426 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Terminating instance
Aug 26 23:22:03 user nova-compute[73497]: DEBUG nova.compute.manager [None req-87c6a71a-9686-4882-81d4-667f7356c426 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:22:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-840da727-444f-4bde-ae4f-33cd0e0b18fa req-4bf4d187-454a-4040-ba09-62f4b43207e6 service nova] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Received event network-vif-unplugged-400e10af-326e-4457-bf67-f7e350fd821e {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-840da727-444f-4bde-ae4f-33cd0e0b18fa req-4bf4d187-454a-4040-ba09-62f4b43207e6 service nova] Acquiring lock "926f8e5c-8d8a-4f07-bf08-e60700ce4698-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-840da727-444f-4bde-ae4f-33cd0e0b18fa req-4bf4d187-454a-4040-ba09-62f4b43207e6 service nova] Lock "926f8e5c-8d8a-4f07-bf08-e60700ce4698-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-840da727-444f-4bde-ae4f-33cd0e0b18fa req-4bf4d187-454a-4040-ba09-62f4b43207e6 service nova] Lock "926f8e5c-8d8a-4f07-bf08-e60700ce4698-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-840da727-444f-4bde-ae4f-33cd0e0b18fa req-4bf4d187-454a-4040-ba09-62f4b43207e6 service nova] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] No waiting events found dispatching network-vif-unplugged-400e10af-326e-4457-bf67-f7e350fd821e {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-840da727-444f-4bde-ae4f-33cd0e0b18fa req-4bf4d187-454a-4040-ba09-62f4b43207e6 service nova] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Received event network-vif-unplugged-400e10af-326e-4457-bf67-f7e350fd821e for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:22:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:04 user nova-compute[73497]: DEBUG nova.compute.manager [req-7379a41e-82aa-4218-a725-ffd38a11cb60 req-ad2830a5-c0cd-4c76-8d9e-2c5fc6b10cd6 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-plugged-d114632c-d651-4419-9f82-ecaa90cd381b {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7379a41e-82aa-4218-a725-ffd38a11cb60 req-ad2830a5-c0cd-4c76-8d9e-2c5fc6b10cd6 service nova] Acquiring lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7379a41e-82aa-4218-a725-ffd38a11cb60 req-ad2830a5-c0cd-4c76-8d9e-2c5fc6b10cd6 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7379a41e-82aa-4218-a725-ffd38a11cb60 req-ad2830a5-c0cd-4c76-8d9e-2c5fc6b10cd6 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:04 user nova-compute[73497]: DEBUG nova.compute.manager [req-7379a41e-82aa-4218-a725-ffd38a11cb60 req-ad2830a5-c0cd-4c76-8d9e-2c5fc6b10cd6 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] No waiting events found dispatching network-vif-plugged-d114632c-d651-4419-9f82-ecaa90cd381b {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:04 user nova-compute[73497]: WARNING nova.compute.manager [req-7379a41e-82aa-4218-a725-ffd38a11cb60 req-ad2830a5-c0cd-4c76-8d9e-2c5fc6b10cd6 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received unexpected event network-vif-plugged-d114632c-d651-4419-9f82-ecaa90cd381b for instance with vm_state building and task_state spawning.
Aug 26 23:22:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:04 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Instance destroyed successfully.
Aug 26 23:22:04 user nova-compute[73497]: DEBUG nova.objects.instance [None req-87c6a71a-9686-4882-81d4-667f7356c426 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Lazy-loading 'resources' on Instance uuid 926f8e5c-8d8a-4f07-bf08-e60700ce4698 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:22:04 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-87c6a71a-9686-4882-81d4-667f7356c426 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:12:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-305424541',display_name='tempest-ServersNegativeTestJSON-server-305424541',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-305424541',id=2,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:13:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7402b17f71d6489c9a419ac0d73abefb',ramdisk_id='',reservation_id='r-xzn513eh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1339597493',owner_user_name='tempest-ServersNegativeTestJSON-1339597493-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:13:13Z,user_data=None,user_id='8c36bef36a3e4edf97f3715472689420',uuid=926f8e5c-8d8a-4f07-bf08-e60700ce4698,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "400e10af-326e-4457-bf67-f7e350fd821e", "address": "fa:16:3e:25:9f:76", "network": {"id": "823997b4-f108-4e9f-807b-2aa2c95f2b09", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-593185584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7402b17f71d6489c9a419ac0d73abefb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400e10af-32", "ovs_interfaceid": "400e10af-326e-4457-bf67-f7e350fd821e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:22:04 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-87c6a71a-9686-4882-81d4-667f7356c426 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Converting VIF {"id": "400e10af-326e-4457-bf67-f7e350fd821e", "address": "fa:16:3e:25:9f:76", "network": {"id": "823997b4-f108-4e9f-807b-2aa2c95f2b09", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-593185584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7402b17f71d6489c9a419ac0d73abefb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400e10af-32", "ovs_interfaceid": "400e10af-326e-4457-bf67-f7e350fd821e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:22:04 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-87c6a71a-9686-4882-81d4-667f7356c426 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:9f:76,bridge_name='br-int',has_traffic_filtering=True,id=400e10af-326e-4457-bf67-f7e350fd821e,network=Network(823997b4-f108-4e9f-807b-2aa2c95f2b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap400e10af-32') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:22:04 user nova-compute[73497]: DEBUG os_vif [None req-87c6a71a-9686-4882-81d4-667f7356c426 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:9f:76,bridge_name='br-int',has_traffic_filtering=True,id=400e10af-326e-4457-bf67-f7e350fd821e,network=Network(823997b4-f108-4e9f-807b-2aa2c95f2b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap400e10af-32') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:22:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap400e10af-32, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:22:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:22:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:04 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:22:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:04 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:22:04 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:22:04 user nova-compute[73497]: INFO os_vif [None req-87c6a71a-9686-4882-81d4-667f7356c426 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:9f:76,bridge_name='br-int',has_traffic_filtering=True,id=400e10af-326e-4457-bf67-f7e350fd821e,network=Network(823997b4-f108-4e9f-807b-2aa2c95f2b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap400e10af-32')
Aug 26 23:22:04 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-87c6a71a-9686-4882-81d4-667f7356c426 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Deleting instance files /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698_del
Aug 26 23:22:04 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-87c6a71a-9686-4882-81d4-667f7356c426 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Deletion of /opt/stack/data/nova/instances/926f8e5c-8d8a-4f07-bf08-e60700ce4698_del complete
Aug 26 23:22:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:04 user nova-compute[73497]: INFO nova.compute.manager [None req-87c6a71a-9686-4882-81d4-667f7356c426 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Took 1.52 seconds to destroy the instance on the hypervisor.
Aug 26 23:22:04 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-87c6a71a-9686-4882-81d4-667f7356c426 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:22:04 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:22:04 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:22:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-171985a3-358d-4b26-a66c-372b9b99b386" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:22:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-171985a3-358d-4b26-a66c-372b9b99b386" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:22:04 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:22:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:05 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Updating instance_info_cache with network_info: [{"id": "1772e978-02b5-4c0b-a99c-67f6c6f91d58", "address": "fa:16:3e:a7:28:86", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1772e978-02", "ovs_interfaceid": "1772e978-02b5-4c0b-a99c-67f6c6f91d58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:22:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-171985a3-358d-4b26-a66c-372b9b99b386" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:22:05 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:22:05 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:22:05 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:22:05 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:22:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:06 user nova-compute[73497]: DEBUG nova.compute.manager [req-0058c5c1-86d8-490e-8177-e8b95c56d627 req-8fd4fc17-1a39-4798-abe1-05743befdf9d service nova] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Received event network-vif-plugged-400e10af-326e-4457-bf67-f7e350fd821e {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0058c5c1-86d8-490e-8177-e8b95c56d627 req-8fd4fc17-1a39-4798-abe1-05743befdf9d service nova] Acquiring lock "926f8e5c-8d8a-4f07-bf08-e60700ce4698-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0058c5c1-86d8-490e-8177-e8b95c56d627 req-8fd4fc17-1a39-4798-abe1-05743befdf9d service nova] Lock "926f8e5c-8d8a-4f07-bf08-e60700ce4698-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0058c5c1-86d8-490e-8177-e8b95c56d627 req-8fd4fc17-1a39-4798-abe1-05743befdf9d service nova] Lock "926f8e5c-8d8a-4f07-bf08-e60700ce4698-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:06 user nova-compute[73497]: DEBUG nova.compute.manager [req-0058c5c1-86d8-490e-8177-e8b95c56d627 req-8fd4fc17-1a39-4798-abe1-05743befdf9d service nova] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] No waiting events found dispatching network-vif-plugged-400e10af-326e-4457-bf67-f7e350fd821e {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:06 user nova-compute[73497]: WARNING nova.compute.manager [req-0058c5c1-86d8-490e-8177-e8b95c56d627 req-8fd4fc17-1a39-4798-abe1-05743befdf9d service nova] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Received unexpected event network-vif-plugged-400e10af-326e-4457-bf67-f7e350fd821e for instance with vm_state active and task_state deleting.
Aug 26 23:22:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:06 user nova-compute[73497]: DEBUG nova.compute.manager [req-b641c3d4-5d47-4f2e-8f0a-def8000beb68 req-6b32641f-577b-4b16-930e-2f4f1973d30c service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-plugged-d114632c-d651-4419-9f82-ecaa90cd381b {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b641c3d4-5d47-4f2e-8f0a-def8000beb68 req-6b32641f-577b-4b16-930e-2f4f1973d30c service nova] Acquiring lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b641c3d4-5d47-4f2e-8f0a-def8000beb68 req-6b32641f-577b-4b16-930e-2f4f1973d30c service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b641c3d4-5d47-4f2e-8f0a-def8000beb68 req-6b32641f-577b-4b16-930e-2f4f1973d30c service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:06 user nova-compute[73497]: DEBUG nova.compute.manager [req-b641c3d4-5d47-4f2e-8f0a-def8000beb68 req-6b32641f-577b-4b16-930e-2f4f1973d30c service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] No waiting events found dispatching network-vif-plugged-d114632c-d651-4419-9f82-ecaa90cd381b {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:06 user nova-compute[73497]: WARNING nova.compute.manager [req-b641c3d4-5d47-4f2e-8f0a-def8000beb68 req-6b32641f-577b-4b16-930e-2f4f1973d30c service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received unexpected event network-vif-plugged-d114632c-d651-4419-9f82-ecaa90cd381b for instance with vm_state building and task_state spawning.
Aug 26 23:22:06 user nova-compute[73497]: DEBUG nova.compute.manager [req-b641c3d4-5d47-4f2e-8f0a-def8000beb68 req-6b32641f-577b-4b16-930e-2f4f1973d30c service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-plugged-c268fbf7-6a36-44b5-8361-42160a69b1d4 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b641c3d4-5d47-4f2e-8f0a-def8000beb68 req-6b32641f-577b-4b16-930e-2f4f1973d30c service nova] Acquiring lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b641c3d4-5d47-4f2e-8f0a-def8000beb68 req-6b32641f-577b-4b16-930e-2f4f1973d30c service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b641c3d4-5d47-4f2e-8f0a-def8000beb68 req-6b32641f-577b-4b16-930e-2f4f1973d30c service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:06 user nova-compute[73497]: DEBUG nova.compute.manager [req-b641c3d4-5d47-4f2e-8f0a-def8000beb68 req-6b32641f-577b-4b16-930e-2f4f1973d30c service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] No waiting events found dispatching network-vif-plugged-c268fbf7-6a36-44b5-8361-42160a69b1d4 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:06 user nova-compute[73497]: WARNING nova.compute.manager [req-b641c3d4-5d47-4f2e-8f0a-def8000beb68 req-6b32641f-577b-4b16-930e-2f4f1973d30c service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received unexpected event network-vif-plugged-c268fbf7-6a36-44b5-8361-42160a69b1d4 for instance with vm_state building and task_state spawning.
Aug 26 23:22:06 user nova-compute[73497]: DEBUG nova.compute.manager [req-b641c3d4-5d47-4f2e-8f0a-def8000beb68 req-6b32641f-577b-4b16-930e-2f4f1973d30c service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-plugged-c268fbf7-6a36-44b5-8361-42160a69b1d4 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b641c3d4-5d47-4f2e-8f0a-def8000beb68 req-6b32641f-577b-4b16-930e-2f4f1973d30c service nova] Acquiring lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b641c3d4-5d47-4f2e-8f0a-def8000beb68 req-6b32641f-577b-4b16-930e-2f4f1973d30c service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b641c3d4-5d47-4f2e-8f0a-def8000beb68 req-6b32641f-577b-4b16-930e-2f4f1973d30c service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:06 user nova-compute[73497]: DEBUG nova.compute.manager [req-b641c3d4-5d47-4f2e-8f0a-def8000beb68 req-6b32641f-577b-4b16-930e-2f4f1973d30c service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] No waiting events found dispatching network-vif-plugged-c268fbf7-6a36-44b5-8361-42160a69b1d4 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:06 user nova-compute[73497]: WARNING nova.compute.manager [req-b641c3d4-5d47-4f2e-8f0a-def8000beb68 req-6b32641f-577b-4b16-930e-2f4f1973d30c service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received unexpected event network-vif-plugged-c268fbf7-6a36-44b5-8361-42160a69b1d4 for instance with vm_state building and task_state spawning.
Aug 26 23:22:06 user nova-compute[73497]: DEBUG nova.compute.manager [req-b641c3d4-5d47-4f2e-8f0a-def8000beb68 req-6b32641f-577b-4b16-930e-2f4f1973d30c service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-plugged-792a72cb-3624-45eb-a8f7-01cf52196f2d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b641c3d4-5d47-4f2e-8f0a-def8000beb68 req-6b32641f-577b-4b16-930e-2f4f1973d30c service nova] Acquiring lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b641c3d4-5d47-4f2e-8f0a-def8000beb68 req-6b32641f-577b-4b16-930e-2f4f1973d30c service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b641c3d4-5d47-4f2e-8f0a-def8000beb68 req-6b32641f-577b-4b16-930e-2f4f1973d30c service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:06 user nova-compute[73497]: DEBUG nova.compute.manager [req-b641c3d4-5d47-4f2e-8f0a-def8000beb68 req-6b32641f-577b-4b16-930e-2f4f1973d30c service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] No waiting events found dispatching network-vif-plugged-792a72cb-3624-45eb-a8f7-01cf52196f2d {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:06 user nova-compute[73497]: WARNING nova.compute.manager [req-b641c3d4-5d47-4f2e-8f0a-def8000beb68 req-6b32641f-577b-4b16-930e-2f4f1973d30c service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received unexpected event network-vif-plugged-792a72cb-3624-45eb-a8f7-01cf52196f2d for instance with vm_state building and task_state spawning.
Aug 26 23:22:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:06 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:22:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:06 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Took 1.72 seconds to deallocate network for instance.
Aug 26 23:22:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-87c6a71a-9686-4882-81d4-667f7356c426 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-87c6a71a-9686-4882-81d4-667f7356c426 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:07 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-87c6a71a-9686-4882-81d4-667f7356c426 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:22:07 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-87c6a71a-9686-4882-81d4-667f7356c426 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:22:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-87c6a71a-9686-4882-81d4-667f7356c426 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.756s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:07 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-87c6a71a-9686-4882-81d4-667f7356c426 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Deleted allocations for instance 926f8e5c-8d8a-4f07-bf08-e60700ce4698
Aug 26 23:22:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-87c6a71a-9686-4882-81d4-667f7356c426 tempest-ServersNegativeTestJSON-1339597493 tempest-ServersNegativeTestJSON-1339597493-project-member] Lock "926f8e5c-8d8a-4f07-bf08-e60700ce4698" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.280s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG nova.compute.manager [req-7405943e-d6c9-49ae-a349-984376460563 req-cc02f798-9b63-4b25-b1a8-85333a506a73 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-plugged-372fa1fa-b52b-479a-b228-91eebb1d3e3f {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7405943e-d6c9-49ae-a349-984376460563 req-cc02f798-9b63-4b25-b1a8-85333a506a73 service nova] Acquiring lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7405943e-d6c9-49ae-a349-984376460563 req-cc02f798-9b63-4b25-b1a8-85333a506a73 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7405943e-d6c9-49ae-a349-984376460563 req-cc02f798-9b63-4b25-b1a8-85333a506a73 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG nova.compute.manager [req-7405943e-d6c9-49ae-a349-984376460563 req-cc02f798-9b63-4b25-b1a8-85333a506a73 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] No waiting events found dispatching network-vif-plugged-372fa1fa-b52b-479a-b228-91eebb1d3e3f {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:08 user nova-compute[73497]: WARNING nova.compute.manager [req-7405943e-d6c9-49ae-a349-984376460563 req-cc02f798-9b63-4b25-b1a8-85333a506a73 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received unexpected event network-vif-plugged-372fa1fa-b52b-479a-b228-91eebb1d3e3f for instance with vm_state building and task_state spawning.
Aug 26 23:22:08 user nova-compute[73497]: DEBUG nova.compute.manager [req-7405943e-d6c9-49ae-a349-984376460563 req-cc02f798-9b63-4b25-b1a8-85333a506a73 service nova] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Received event network-vif-deleted-400e10af-326e-4457-bf67-f7e350fd821e {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG nova.compute.manager [req-7405943e-d6c9-49ae-a349-984376460563 req-cc02f798-9b63-4b25-b1a8-85333a506a73 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-plugged-372fa1fa-b52b-479a-b228-91eebb1d3e3f {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7405943e-d6c9-49ae-a349-984376460563 req-cc02f798-9b63-4b25-b1a8-85333a506a73 service nova] Acquiring lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7405943e-d6c9-49ae-a349-984376460563 req-cc02f798-9b63-4b25-b1a8-85333a506a73 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7405943e-d6c9-49ae-a349-984376460563 req-cc02f798-9b63-4b25-b1a8-85333a506a73 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG nova.compute.manager [req-7405943e-d6c9-49ae-a349-984376460563 req-cc02f798-9b63-4b25-b1a8-85333a506a73 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] No waiting events found dispatching network-vif-plugged-372fa1fa-b52b-479a-b228-91eebb1d3e3f {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:08 user nova-compute[73497]: WARNING nova.compute.manager [req-7405943e-d6c9-49ae-a349-984376460563 req-cc02f798-9b63-4b25-b1a8-85333a506a73 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received unexpected event network-vif-plugged-372fa1fa-b52b-479a-b228-91eebb1d3e3f for instance with vm_state building and task_state spawning.
Aug 26 23:22:08 user nova-compute[73497]: DEBUG nova.compute.manager [req-7405943e-d6c9-49ae-a349-984376460563 req-cc02f798-9b63-4b25-b1a8-85333a506a73 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-plugged-7c81f6a7-92b5-496b-867f-c10965da8e40 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7405943e-d6c9-49ae-a349-984376460563 req-cc02f798-9b63-4b25-b1a8-85333a506a73 service nova] Acquiring lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7405943e-d6c9-49ae-a349-984376460563 req-cc02f798-9b63-4b25-b1a8-85333a506a73 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7405943e-d6c9-49ae-a349-984376460563 req-cc02f798-9b63-4b25-b1a8-85333a506a73 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG nova.compute.manager [req-7405943e-d6c9-49ae-a349-984376460563 req-cc02f798-9b63-4b25-b1a8-85333a506a73 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] No waiting events found dispatching network-vif-plugged-7c81f6a7-92b5-496b-867f-c10965da8e40 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:08 user nova-compute[73497]: WARNING nova.compute.manager [req-7405943e-d6c9-49ae-a349-984376460563 req-cc02f798-9b63-4b25-b1a8-85333a506a73 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received unexpected event network-vif-plugged-7c81f6a7-92b5-496b-867f-c10965da8e40 for instance with vm_state building and task_state spawning.
Aug 26 23:22:08 user nova-compute[73497]: DEBUG nova.compute.manager [req-7405943e-d6c9-49ae-a349-984376460563 req-cc02f798-9b63-4b25-b1a8-85333a506a73 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-plugged-7c81f6a7-92b5-496b-867f-c10965da8e40 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7405943e-d6c9-49ae-a349-984376460563 req-cc02f798-9b63-4b25-b1a8-85333a506a73 service nova] Acquiring lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7405943e-d6c9-49ae-a349-984376460563 req-cc02f798-9b63-4b25-b1a8-85333a506a73 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7405943e-d6c9-49ae-a349-984376460563 req-cc02f798-9b63-4b25-b1a8-85333a506a73 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG nova.compute.manager [req-7405943e-d6c9-49ae-a349-984376460563 req-cc02f798-9b63-4b25-b1a8-85333a506a73 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] No waiting events found dispatching network-vif-plugged-7c81f6a7-92b5-496b-867f-c10965da8e40 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:08 user nova-compute[73497]: WARNING nova.compute.manager [req-7405943e-d6c9-49ae-a349-984376460563 req-cc02f798-9b63-4b25-b1a8-85333a506a73 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received unexpected event network-vif-plugged-7c81f6a7-92b5-496b-867f-c10965da8e40 for instance with vm_state building and task_state spawning.
Aug 26 23:22:08 user nova-compute[73497]: DEBUG nova.compute.manager [req-7405943e-d6c9-49ae-a349-984376460563 req-cc02f798-9b63-4b25-b1a8-85333a506a73 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-plugged-35958938-f4c5-4745-99ca-0f0761fd801c {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7405943e-d6c9-49ae-a349-984376460563 req-cc02f798-9b63-4b25-b1a8-85333a506a73 service nova] Acquiring lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7405943e-d6c9-49ae-a349-984376460563 req-cc02f798-9b63-4b25-b1a8-85333a506a73 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7405943e-d6c9-49ae-a349-984376460563 req-cc02f798-9b63-4b25-b1a8-85333a506a73 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG nova.compute.manager [req-7405943e-d6c9-49ae-a349-984376460563 req-cc02f798-9b63-4b25-b1a8-85333a506a73 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] No waiting events found dispatching network-vif-plugged-35958938-f4c5-4745-99ca-0f0761fd801c {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:08 user nova-compute[73497]: WARNING nova.compute.manager [req-7405943e-d6c9-49ae-a349-984376460563 req-cc02f798-9b63-4b25-b1a8-85333a506a73 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received unexpected event network-vif-plugged-35958938-f4c5-4745-99ca-0f0761fd801c for instance with vm_state building and task_state spawning.
Aug 26 23:22:08 user nova-compute[73497]: DEBUG nova.compute.manager [req-7405943e-d6c9-49ae-a349-984376460563 req-cc02f798-9b63-4b25-b1a8-85333a506a73 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-plugged-35958938-f4c5-4745-99ca-0f0761fd801c {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7405943e-d6c9-49ae-a349-984376460563 req-cc02f798-9b63-4b25-b1a8-85333a506a73 service nova] Acquiring lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7405943e-d6c9-49ae-a349-984376460563 req-cc02f798-9b63-4b25-b1a8-85333a506a73 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7405943e-d6c9-49ae-a349-984376460563 req-cc02f798-9b63-4b25-b1a8-85333a506a73 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG nova.compute.manager [req-7405943e-d6c9-49ae-a349-984376460563 req-cc02f798-9b63-4b25-b1a8-85333a506a73 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] No waiting events found dispatching network-vif-plugged-35958938-f4c5-4745-99ca-0f0761fd801c {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:08 user nova-compute[73497]: WARNING nova.compute.manager [req-7405943e-d6c9-49ae-a349-984376460563 req-cc02f798-9b63-4b25-b1a8-85333a506a73 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received unexpected event network-vif-plugged-35958938-f4c5-4745-99ca-0f0761fd801c for instance with vm_state building and task_state spawning.
Aug 26 23:22:08 user nova-compute[73497]: DEBUG nova.compute.manager [req-4f395a39-1558-4cdb-9fd3-3e179640d1db req-e2eab8d1-0e2d-41ce-8e51-af7f1dc58b6a service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-plugged-792a72cb-3624-45eb-a8f7-01cf52196f2d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4f395a39-1558-4cdb-9fd3-3e179640d1db req-e2eab8d1-0e2d-41ce-8e51-af7f1dc58b6a service nova] Acquiring lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4f395a39-1558-4cdb-9fd3-3e179640d1db req-e2eab8d1-0e2d-41ce-8e51-af7f1dc58b6a service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4f395a39-1558-4cdb-9fd3-3e179640d1db req-e2eab8d1-0e2d-41ce-8e51-af7f1dc58b6a service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG nova.compute.manager [req-4f395a39-1558-4cdb-9fd3-3e179640d1db req-e2eab8d1-0e2d-41ce-8e51-af7f1dc58b6a service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] No waiting events found dispatching network-vif-plugged-792a72cb-3624-45eb-a8f7-01cf52196f2d {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:08 user nova-compute[73497]: WARNING nova.compute.manager [req-4f395a39-1558-4cdb-9fd3-3e179640d1db req-e2eab8d1-0e2d-41ce-8e51-af7f1dc58b6a service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received unexpected event network-vif-plugged-792a72cb-3624-45eb-a8f7-01cf52196f2d for instance with vm_state building and task_state spawning.
Aug 26 23:22:08 user nova-compute[73497]: DEBUG nova.compute.manager [req-4f395a39-1558-4cdb-9fd3-3e179640d1db req-e2eab8d1-0e2d-41ce-8e51-af7f1dc58b6a service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-plugged-6361122d-0a82-4b1d-8ea5-dedb8984f15f {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4f395a39-1558-4cdb-9fd3-3e179640d1db req-e2eab8d1-0e2d-41ce-8e51-af7f1dc58b6a service nova] Acquiring lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4f395a39-1558-4cdb-9fd3-3e179640d1db req-e2eab8d1-0e2d-41ce-8e51-af7f1dc58b6a service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4f395a39-1558-4cdb-9fd3-3e179640d1db req-e2eab8d1-0e2d-41ce-8e51-af7f1dc58b6a service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG nova.compute.manager [req-4f395a39-1558-4cdb-9fd3-3e179640d1db req-e2eab8d1-0e2d-41ce-8e51-af7f1dc58b6a service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] No waiting events found dispatching network-vif-plugged-6361122d-0a82-4b1d-8ea5-dedb8984f15f {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:08 user nova-compute[73497]: WARNING nova.compute.manager [req-4f395a39-1558-4cdb-9fd3-3e179640d1db req-e2eab8d1-0e2d-41ce-8e51-af7f1dc58b6a service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received unexpected event network-vif-plugged-6361122d-0a82-4b1d-8ea5-dedb8984f15f for instance with vm_state building and task_state spawning.
Aug 26 23:22:08 user nova-compute[73497]: DEBUG nova.compute.manager [req-4f395a39-1558-4cdb-9fd3-3e179640d1db req-e2eab8d1-0e2d-41ce-8e51-af7f1dc58b6a service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-plugged-6361122d-0a82-4b1d-8ea5-dedb8984f15f {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4f395a39-1558-4cdb-9fd3-3e179640d1db req-e2eab8d1-0e2d-41ce-8e51-af7f1dc58b6a service nova] Acquiring lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4f395a39-1558-4cdb-9fd3-3e179640d1db req-e2eab8d1-0e2d-41ce-8e51-af7f1dc58b6a service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4f395a39-1558-4cdb-9fd3-3e179640d1db req-e2eab8d1-0e2d-41ce-8e51-af7f1dc58b6a service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG nova.compute.manager [req-4f395a39-1558-4cdb-9fd3-3e179640d1db req-e2eab8d1-0e2d-41ce-8e51-af7f1dc58b6a service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] No waiting events found dispatching network-vif-plugged-6361122d-0a82-4b1d-8ea5-dedb8984f15f {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:08 user nova-compute[73497]: WARNING nova.compute.manager [req-4f395a39-1558-4cdb-9fd3-3e179640d1db req-e2eab8d1-0e2d-41ce-8e51-af7f1dc58b6a service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received unexpected event network-vif-plugged-6361122d-0a82-4b1d-8ea5-dedb8984f15f for instance with vm_state building and task_state spawning.
Aug 26 23:22:08 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092128.8185372, a6c7669c-f338-4e2b-9ba7-96d8e66d10ed => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:22:08 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] VM Resumed (Lifecycle Event)
Aug 26 23:22:08 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:22:08 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Instance spawned successfully.
Aug 26 23:22:08 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:22:08 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:22:08 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092128.8223639, a6c7669c-f338-4e2b-9ba7-96d8e66d10ed => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:22:08 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] VM Started (Lifecycle Event)
Aug 26 23:22:08 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:22:08 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:22:08 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:22:09 user nova-compute[73497]: INFO nova.compute.manager [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Took 12.48 seconds to spawn the instance on the hypervisor.
Aug 26 23:22:09 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:22:09 user nova-compute[73497]: INFO nova.compute.manager [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Took 53.01 seconds to build instance.
Aug 26 23:22:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e9ea76c7-606e-44b1-afdd-142f3b263461 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 53.107s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:11 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:22:11 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoxmeCnv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:22:11 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:22:11 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:22:11 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:22:11 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:22:11 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:22:11 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:22:11 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:22:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:11 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89fba50-828d-4c39-92c0-a715f29a2199]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:11 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:22:11 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:22:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:11 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bdc4665-3aaa-4abc-b165-48f28b1cc2be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:11 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662] added
Aug 26 23:22:11 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:22:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:11 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e08af9-3687-4a0a-b800-b2b950a3848d]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:11 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:22:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:11 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4cf525-841d-4f13-9bf5-8794e2313628]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:11 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:22:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AoxmeCnv {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AoxmeCnv" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:11 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed66f1ff-30e8-4989-8bf3-d63ca2a9467f]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:11 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AoxmeCnv'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:22:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:11 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f4a3a2-852d-4f83-9f9d-14ef25c92ef8]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:11 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:22:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:12 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a00238-a384-4ba8-adf0-1087ae484bb1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:12 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:22:12 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:22:12 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:22:12 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:22:12 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:22:12 user nova-compute[73497]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:22:12 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:22:12 user nova-compute[73497]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)
Aug 26 23:22:12 user nova-compute[73497]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)
Aug 26 23:22:12 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:22:12 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:22:12 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:22:12 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:22:12 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:22:12 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:22:12 user nova-compute[73497]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:22:12 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:22:12 user nova-compute[73497]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)
Aug 26 23:22:12 user nova-compute[73497]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)
Aug 26 23:22:12 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:22:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:12 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc31dee1-5adc-4a0b-b449-1245f0fa3be8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:12 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662, portal: 172.16.0.220,3260]
Aug 26 23:22:12 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662, portal: 172.16.0.220,3260] successful.
Aug 26 23:22:12 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:22:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:12 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f85bb4-d4ad-4473-9ea1-3ac80c7e9b8d]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:12 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:22:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:12 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee254097-3e06-4d1b-be8b-d0dfba766f26]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:12 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:22:12 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:22:12 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:22:12 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:22:12 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:22:12 user nova-compute[73497]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:22:12 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:22:12 user nova-compute[73497]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)
Aug 26 23:22:12 user nova-compute[73497]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)
Aug 26 23:22:12 user nova-compute[73497]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)
Aug 26 23:22:12 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:22:12 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:22:12 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:22:12 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:22:12 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:22:12 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:22:12 user nova-compute[73497]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:22:12 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:22:12 user nova-compute[73497]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)
Aug 26 23:22:12 user nova-compute[73497]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)
Aug 26 23:22:12 user nova-compute[73497]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)
Aug 26 23:22:12 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:22:12 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:22:12 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:22:12 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] HCTL ('42', '-', '-', 0) found on session 26 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:22:12 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:22:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:12 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c996a1-1da3-46ba-8029-b46c9d34a73e]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:12 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Searching for a device in session 26 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:22:12 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoxmeCnv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:22:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:22:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '26439336133663233', 'path': '/dev/sdk'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:22:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439336133663233', 'path': '/dev/sdk'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:22:13 user nova-compute[73497]: DEBUG nova.objects.instance [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lazy-loading 'flavor' on Instance uuid 7c124dd9-4dce-4c6f-925c-6eda8e187d84 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:22:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 23:22:13 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:22:13 user nova-compute[73497]:   <source dev="/dev/sdk"/>
Aug 26 23:22:13 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:22:13 user nova-compute[73497]:   <serial>00fbc86c-3cce-40a9-83b5-dbbf5bf49662</serial>
Aug 26 23:22:13 user nova-compute[73497]: </disk>
Aug 26 23:22:13 user nova-compute[73497]:  {{(pid=73497) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 23:22:13 user nova-compute[73497]: DEBUG nova.network.neutron [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Port 61639246-9d84-4629-9666-154897feaeae binding to destination host user is already ACTIVE {{(pid=73497) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 26 23:22:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Acquiring lock "refresh_cache-ee6283d5-40de-432d-997c-0be52ff673ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:22:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Acquired lock "refresh_cache-ee6283d5-40de-432d-997c-0be52ff673ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:22:13 user nova-compute[73497]: DEBUG nova.network.neutron [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:22:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:22:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:22:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] No VIF found with MAC fa:16:3e:1c:46:66, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:22:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b460dad0-8ece-4603-86e6-29d187d103ea tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.712s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:13 user nova-compute[73497]: DEBUG nova.network.neutron [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Updating instance_info_cache with network_info: [{"id": "61639246-9d84-4629-9666-154897feaeae", "address": "fa:16:3e:56:41:f9", "network": {"id": "108c66fb-49a3-4c69-a3ac-93d9643a1d3e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025099504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e765258a50d46dea25bfd9c72970eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61639246-9d", "ovs_interfaceid": "61639246-9d84-4629-9666-154897feaeae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:22:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Releasing lock "refresh_cache-ee6283d5-40de-432d-997c-0be52ff673ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Creating tmpfile /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/tmpp3j89ms1 to verify with other compute node that the instance is on the same shared storage. {{(pid=73497) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG nova.compute.manager [req-cc4ef6c6-eb3f-4804-aa01-73e2a60e4820 req-aac6c2a0-c6c3-47c7-8ccc-21880108dfa8 service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Received event network-vif-unplugged-61639246-9d84-4629-9666-154897feaeae {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cc4ef6c6-eb3f-4804-aa01-73e2a60e4820 req-aac6c2a0-c6c3-47c7-8ccc-21880108dfa8 service nova] Acquiring lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cc4ef6c6-eb3f-4804-aa01-73e2a60e4820 req-aac6c2a0-c6c3-47c7-8ccc-21880108dfa8 service nova] Lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cc4ef6c6-eb3f-4804-aa01-73e2a60e4820 req-aac6c2a0-c6c3-47c7-8ccc-21880108dfa8 service nova] Lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG nova.compute.manager [req-cc4ef6c6-eb3f-4804-aa01-73e2a60e4820 req-aac6c2a0-c6c3-47c7-8ccc-21880108dfa8 service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] No waiting events found dispatching network-vif-unplugged-61639246-9d84-4629-9666-154897feaeae {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:14 user nova-compute[73497]: WARNING nova.compute.manager [req-cc4ef6c6-eb3f-4804-aa01-73e2a60e4820 req-aac6c2a0-c6c3-47c7-8ccc-21880108dfa8 service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Received unexpected event network-vif-unplugged-61639246-9d84-4629-9666-154897feaeae for instance with vm_state resized and task_state resize_reverting.
Aug 26 23:22:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:14 user nova-compute[73497]: INFO nova.compute.manager [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Rescuing
Aug 26 23:22:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Acquiring lock "refresh_cache-7c124dd9-4dce-4c6f-925c-6eda8e187d84" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Acquired lock "refresh_cache-7c124dd9-4dce-4c6f-925c-6eda8e187d84" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG nova.network.neutron [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:22:14 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Instance destroyed successfully.
Aug 26 23:22:14 user nova-compute[73497]: DEBUG nova.objects.instance [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lazy-loading 'resources' on Instance uuid ee6283d5-40de-432d-997c-0be52ff673ca {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:16:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-956611518',display_name='tempest-ServerActionsTestOtherB-server-956611518',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-956611518',id=13,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqify97xxdfMwMioKw2wicMrkUmyII/F1wNcYn2coMZNsxaRCqyQGjP8va1kHwD6Z9ddCdHd23iUWPYbjiNJPdJt82WzvrKCaPX0PtGf0585mA5lLDP0NEIbnQp6LuyOw==',key_name='tempest-keypair-800864699',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:20:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e765258a50d46dea25bfd9c72970eb9',ramdisk_id='',reservation_id='r-owyjaonv',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-435374476',owner_user_name='tempest-ServerActionsTestOtherB-435374476-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:20:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd09339d0e1d46d4a268f6ac8651a9f5',uuid=ee6283d5-40de-432d-997c-0be52ff673ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "61639246-9d84-4629-9666-154897feaeae", "address": "fa:16:3e:56:41:f9", "network": {"id": "108c66fb-49a3-4c69-a3ac-93d9643a1d3e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025099504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e765258a50d46dea25bfd9c72970eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61639246-9d", "ovs_interfaceid": "61639246-9d84-4629-9666-154897feaeae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Converting VIF {"id": "61639246-9d84-4629-9666-154897feaeae", "address": "fa:16:3e:56:41:f9", "network": {"id": "108c66fb-49a3-4c69-a3ac-93d9643a1d3e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025099504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e765258a50d46dea25bfd9c72970eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61639246-9d", "ovs_interfaceid": "61639246-9d84-4629-9666-154897feaeae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=61639246-9d84-4629-9666-154897feaeae,network=Network(108c66fb-49a3-4c69-a3ac-93d9643a1d3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61639246-9d') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG os_vif [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=61639246-9d84-4629-9666-154897feaeae,network=Network(108c66fb-49a3-4c69-a3ac-93d9643a1d3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61639246-9d') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61639246-9d, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:14 user nova-compute[73497]: INFO os_vif [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=61639246-9d84-4629-9666-154897feaeae,network=Network(108c66fb-49a3-4c69-a3ac-93d9643a1d3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61639246-9d')
Aug 26 23:22:14 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbmOUkyq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:22:14 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:22:14 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b46d47-cdf9-4024-a5a3-778b286f89a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddbf42e-1db9-43db-9783-6fe01a2efbbf]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:22:14 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:22:14 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:22:14 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:22:14 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:22:14 user nova-compute[73497]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:22:14 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:22:14 user nova-compute[73497]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)
Aug 26 23:22:14 user nova-compute[73497]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)
Aug 26 23:22:14 user nova-compute[73497]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)
Aug 26 23:22:14 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:22:14 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:22:14 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:22:14 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:22:14 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:22:14 user nova-compute[73497]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:22:14 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:22:14 user nova-compute[73497]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)
Aug 26 23:22:14 user nova-compute[73497]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)
Aug 26 23:22:14 user nova-compute[73497]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)
Aug 26 23:22:14 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282c68f5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c'): ({'sdg'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Removing single pathed devices sdg {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42d81ac-3336-407d-a6aa-8cd903865470]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3eac65-6d1e-4973-be1c-8ebbd685d884]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Flushing IO for device /dev/sdg {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b6265f-b8a4-409a-b7ba-37a0627007a1]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:22:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:15 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[621b580d-b201-495d-a225-bc11aa9d8f07]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:15 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:22:15 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] SCSI volumes sdg have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:22:15 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:22:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:15 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f2abae-ef65-4589-bb52-4f4548eca5fb]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:15 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:22:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:15 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a31854-bfc2-45c9-b5dd-1276eebae1c0]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:15 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c, portal: 172.16.0.220,3260]
Aug 26 23:22:15 user nova-compute[73497]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c, portal: 172.16.0.220,3260] successful.
Aug 26 23:22:15 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:22:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:15 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a79a16-cb99-4fb7-920b-60aec662f63c]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:15 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:22:15 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:22:15 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] <== disconnect_volume: return (353ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:22:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:22:15 user nova-compute[73497]: DEBUG nova.network.neutron [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Updating instance_info_cache with network_info: [{"id": "127a3626-0dfe-4050-83d8-43658958e8df", "address": "fa:16:3e:1c:46:66", "network": {"id": "0b5f5877-f6f2-4814-878a-25181e72db29", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-155251039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19a5c1c2c4a456a86efbbadd38d94c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127a3626-0d", "ovs_interfaceid": "127a3626-0dfe-4050-83d8-43658958e8df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:22:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Releasing lock "refresh_cache-7c124dd9-4dce-4c6f-925c-6eda8e187d84" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:22:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:16 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Instance destroyed successfully.
Aug 26 23:22:16 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Attempting a stable device rescue
Aug 26 23:22:16 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=73497) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 23:22:16 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Instance directory exists: not creating {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 23:22:16 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Creating image(s)
Aug 26 23:22:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "/opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "/opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:16 user nova-compute[73497]: DEBUG nova.objects.instance [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7c124dd9-4dce-4c6f-925c-6eda8e187d84 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:22:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Acquiring lock "930c5246d5d1dd8f93734b8bd20eaa1a1067cc13" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "930c5246d5d1dd8f93734b8bd20eaa1a1067cc13" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:16 user nova-compute[73497]: DEBUG nova.objects.instance [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lazy-loading 'migration_context' on Instance uuid ee6283d5-40de-432d-997c-0be52ff673ca {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:22:16 user nova-compute[73497]: DEBUG nova.objects.base [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Object Instance<ee6283d5-40de-432d-997c-0be52ff673ca> lazy-loaded attributes: resources,migration_context {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:22:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/930c5246d5d1dd8f93734b8bd20eaa1a1067cc13.part --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:17 user nova-compute[73497]: DEBUG nova.compute.manager [req-be9c4454-c1a3-46d1-bc03-89b777525eac req-dfc18b38-912f-40f3-93c9-cd6b71cdefe5 service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Received event network-vif-plugged-61639246-9d84-4629-9666-154897feaeae {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-be9c4454-c1a3-46d1-bc03-89b777525eac req-dfc18b38-912f-40f3-93c9-cd6b71cdefe5 service nova] Acquiring lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-be9c4454-c1a3-46d1-bc03-89b777525eac req-dfc18b38-912f-40f3-93c9-cd6b71cdefe5 service nova] Lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-be9c4454-c1a3-46d1-bc03-89b777525eac req-dfc18b38-912f-40f3-93c9-cd6b71cdefe5 service nova] Lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:17 user nova-compute[73497]: DEBUG nova.compute.manager [req-be9c4454-c1a3-46d1-bc03-89b777525eac req-dfc18b38-912f-40f3-93c9-cd6b71cdefe5 service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] No waiting events found dispatching network-vif-plugged-61639246-9d84-4629-9666-154897feaeae {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:17 user nova-compute[73497]: WARNING nova.compute.manager [req-be9c4454-c1a3-46d1-bc03-89b777525eac req-dfc18b38-912f-40f3-93c9-cd6b71cdefe5 service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Received unexpected event network-vif-plugged-61639246-9d84-4629-9666-154897feaeae for instance with vm_state resized and task_state resize_reverting.
Aug 26 23:22:17 user nova-compute[73497]: DEBUG nova.compute.manager [req-be9c4454-c1a3-46d1-bc03-89b777525eac req-dfc18b38-912f-40f3-93c9-cd6b71cdefe5 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Received event network-vif-unplugged-127a3626-0dfe-4050-83d8-43658958e8df {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-be9c4454-c1a3-46d1-bc03-89b777525eac req-dfc18b38-912f-40f3-93c9-cd6b71cdefe5 service nova] Acquiring lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-be9c4454-c1a3-46d1-bc03-89b777525eac req-dfc18b38-912f-40f3-93c9-cd6b71cdefe5 service nova] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-be9c4454-c1a3-46d1-bc03-89b777525eac req-dfc18b38-912f-40f3-93c9-cd6b71cdefe5 service nova] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:17 user nova-compute[73497]: DEBUG nova.compute.manager [req-be9c4454-c1a3-46d1-bc03-89b777525eac req-dfc18b38-912f-40f3-93c9-cd6b71cdefe5 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] No waiting events found dispatching network-vif-unplugged-127a3626-0dfe-4050-83d8-43658958e8df {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:17 user nova-compute[73497]: WARNING nova.compute.manager [req-be9c4454-c1a3-46d1-bc03-89b777525eac req-dfc18b38-912f-40f3-93c9-cd6b71cdefe5 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Received unexpected event network-vif-unplugged-127a3626-0dfe-4050-83d8-43658958e8df for instance with vm_state active and task_state rescuing.
Aug 26 23:22:17 user nova-compute[73497]: DEBUG nova.compute.manager [req-be9c4454-c1a3-46d1-bc03-89b777525eac req-dfc18b38-912f-40f3-93c9-cd6b71cdefe5 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Received event network-vif-plugged-127a3626-0dfe-4050-83d8-43658958e8df {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-be9c4454-c1a3-46d1-bc03-89b777525eac req-dfc18b38-912f-40f3-93c9-cd6b71cdefe5 service nova] Acquiring lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-be9c4454-c1a3-46d1-bc03-89b777525eac req-dfc18b38-912f-40f3-93c9-cd6b71cdefe5 service nova] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-be9c4454-c1a3-46d1-bc03-89b777525eac req-dfc18b38-912f-40f3-93c9-cd6b71cdefe5 service nova] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:17 user nova-compute[73497]: DEBUG nova.compute.manager [req-be9c4454-c1a3-46d1-bc03-89b777525eac req-dfc18b38-912f-40f3-93c9-cd6b71cdefe5 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] No waiting events found dispatching network-vif-plugged-127a3626-0dfe-4050-83d8-43658958e8df {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:17 user nova-compute[73497]: WARNING nova.compute.manager [req-be9c4454-c1a3-46d1-bc03-89b777525eac req-dfc18b38-912f-40f3-93c9-cd6b71cdefe5 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Received unexpected event network-vif-plugged-127a3626-0dfe-4050-83d8-43658958e8df for instance with vm_state active and task_state rescuing.
Aug 26 23:22:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/930c5246d5d1dd8f93734b8bd20eaa1a1067cc13.part --force-share --output=json" returned: 0 in 0.192s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:17 user nova-compute[73497]: DEBUG nova.virt.images [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] efff8146-2014-402a-a3fa-bc7a7470c5db was qcow2, converting to raw {{(pid=73497) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 23:22:17 user nova-compute[73497]: DEBUG nova.privsep.utils [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73497) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 23:22:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/930c5246d5d1dd8f93734b8bd20eaa1a1067cc13.part /opt/stack/data/nova/instances/_base/930c5246d5d1dd8f93734b8bd20eaa1a1067cc13.converted {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:17 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:22:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/930c5246d5d1dd8f93734b8bd20eaa1a1067cc13.part /opt/stack/data/nova/instances/_base/930c5246d5d1dd8f93734b8bd20eaa1a1067cc13.converted" returned: 0 in 0.336s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/930c5246d5d1dd8f93734b8bd20eaa1a1067cc13.converted --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:17 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:22:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 1.785s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/930c5246d5d1dd8f93734b8bd20eaa1a1067cc13.converted --force-share --output=json" returned: 0 in 0.205s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "930c5246d5d1dd8f93734b8bd20eaa1a1067cc13" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.831s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Acquiring lock "930c5246d5d1dd8f93734b8bd20eaa1a1067cc13" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "930c5246d5d1dd8f93734b8bd20eaa1a1067cc13" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/930c5246d5d1dd8f93734b8bd20eaa1a1067cc13 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:18 user nova-compute[73497]: INFO nova.compute.manager [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Swapping old allocation on dict_keys(['10adb234-fb0d-4578-975f-a62ca871f8a1']) held by migration 14136b35-f57f-4887-b829-d288d7ca3655 for instance
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/930c5246d5d1dd8f93734b8bd20eaa1a1067cc13 --force-share --output=json" returned: 0 in 0.194s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/930c5246d5d1dd8f93734b8bd20eaa1a1067cc13,backing_fmt=raw /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk.rescue {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Overwriting current allocation {'allocations': {'10adb234-fb0d-4578-975f-a62ca871f8a1': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 29}}, 'project_id': '1e765258a50d46dea25bfd9c72970eb9', 'user_id': 'cd09339d0e1d46d4a268f6ac8651a9f5', 'consumer_generation': 1} on consumer ee6283d5-40de-432d-997c-0be52ff673ca {{(pid=73497) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/930c5246d5d1dd8f93734b8bd20eaa1a1067cc13,backing_fmt=raw /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk.rescue" returned: 0 in 0.052s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "930c5246d5d1dd8f93734b8bd20eaa1a1067cc13" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.objects.instance [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lazy-loading 'migration_context' on Instance uuid 7c124dd9-4dce-4c6f-925c-6eda8e187d84 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.objects.base [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Object Instance<7c124dd9-4dce-4c6f-925c-6eda8e187d84> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Start _get_guest_xml network_info=[{"id": "127a3626-0dfe-4050-83d8-43658958e8df", "address": "fa:16:3e:1c:46:66", "network": {"id": "0b5f5877-f6f2-4814-878a-25181e72db29", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-155251039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-155251039-network", "vif_mac": "fa:16:3e:1c:46:66"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19a5c1c2c4a456a86efbbadd38d94c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127a3626-0d", "ovs_interfaceid": "127a3626-0dfe-4050-83d8-43658958e8df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'efff8146-2014-402a-a3fa-bc7a7470c5db', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '44aca921-bfe1-447d-877f-b8a658dde9b8', 'guest_format': None, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoxmeCnv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': '7c124dd9-4dce-4c6f-925c-6eda8e187d84', 'attached_at': '', 'detached_at': '', 'volume_id': '00fbc86c-3cce-40a9-83b5-dbbf5bf49662', 'serial': '00fbc86c-3cce-40a9-83b5-dbbf5bf49662'}, 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.objects.instance [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lazy-loading 'resources' on Instance uuid 7c124dd9-4dce-4c6f-925c-6eda8e187d84 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.objects.base [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Object Instance<7c124dd9-4dce-4c6f-925c-6eda8e187d84> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.objects.instance [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lazy-loading 'numa_topology' on Instance uuid 7c124dd9-4dce-4c6f-925c-6eda8e187d84 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.objects.base [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Object Instance<7c124dd9-4dce-4c6f-925c-6eda8e187d84> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:22:18 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:22:18 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.objects.instance [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7c124dd9-4dce-4c6f-925c-6eda8e187d84 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.objects.base [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Object Instance<7c124dd9-4dce-4c6f-925c-6eda8e187d84> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoxmeCnv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:22:18 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:22:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:22:18 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:22:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:22:18 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[932021d6-c06c-4263-9c91-e140f82040c9]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = AoxmeCnv\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 26 23:22:18 user nova-compute[73497]: node.name = iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662
Aug 26 23:22:18 user nova-compute[73497]: node.tpgt = -1
Aug 26 23:22:18 user nova-compute[73497]: node.startup = automatic
Aug 26 23:22:18 user nova-compute[73497]: node.leading_login = No
Aug 26 23:22:18 user nova-compute[73497]: iface.iscsi_ifacename = default
Aug 26 23:22:18 user nova-compute[73497]: iface.net_ifacename = <empty>
Aug 26 23:22:18 user nova-compute[73497]: iface.ipaddress = <empty>
Aug 26 23:22:18 user nova-compute[73497]: iface.prefix_len = 0
Aug 26 23:22:18 user nova-compute[73497]: iface.hwaddress = <empty>
Aug 26 23:22:18 user nova-compute[73497]: iface.transport_name = tcp
Aug 26 23:22:18 user nova-compute[73497]: iface.initiatorname = <empty>
Aug 26 23:22:18 user nova-compute[73497]: iface.state = <empty>
Aug 26 23:22:18 user nova-compute[73497]: iface.vlan_id = 0
Aug 26 23:22:18 user nova-compute[73497]: iface.vlan_priority = 0
Aug 26 23:22:18 user nova-compute[73497]: iface.vlan_state = <empty>
Aug 26 23:22:18 user nova-compute[73497]: iface.iface_num = 0
Aug 26 23:22:18 user nova-compute[73497]: iface.mtu = 0
Aug 26 23:22:18 user nova-compute[73497]: iface.port = 0
Aug 26 23:22:18 user nova-compute[73497]: iface.bootproto = <empty>
Aug 26 23:22:18 user nova-compute[73497]: iface.subnet_mask = <empty>
Aug 26 23:22:18 user nova-compute[73497]: iface.gateway = <empty>
Aug 26 23:22:18 user nova-compute[73497]: iface.dhcp_alt_client_id_state = <empty>
Aug 26 23:22:18 user nova-compute[73497]: iface.dhcp_alt_client_id = <empty>
Aug 26 23:22:18 user nova-compute[73497]: iface.dhcp_dns = <empty>
Aug 26 23:22:18 user nova-compute[73497]: iface.dhcp_learn_iqn = <empty>
Aug 26 23:22:18 user nova-compute[73497]: iface.dhcp_req_vendor_id_state = <empty>
Aug 26 23:22:18 user nova-compute[73497]: iface.dhcp_vendor_id_state = <empty>
Aug 26 23:22:18 user nova-compute[73497]: iface.dhcp_vendor_id = <empty>
Aug 26 23:22:18 user nova-compute[73497]: iface.dhcp_slp_da = <empty>
Aug 26 23:22:18 user nova-compute[73497]: iface.fragmentation = <empty>
Aug 26 23:22:18 user nova-compute[73497]: iface.gratuitous_arp = <empty>
Aug 26 23:22:18 user nova-compute[73497]: iface.incoming_forwarding = <empty>
Aug 26 23:22:18 user nova-compute[73497]: iface.tos_state = <empty>
Aug 26 23:22:18 user nova-compute[73497]: iface.tos = 0
Aug 26 23:22:18 user nova-compute[73497]: iface.ttl = 0
Aug 26 23:22:18 user nova-compute[73497]: iface.delayed_ack = <empty>
Aug 26 23:22:18 user nova-compute[73497]: iface.tcp_nagle = <empty>
Aug 26 23:22:18 user nova-compute[73497]: iface.tcp_wsf_state = <empty>
Aug 26 23:22:18 user nova-compute[73497]: iface.tcp_wsf = 0
Aug 26 23:22:18 user nova-compute[73497]: iface.tcp_timer_scale = 0
Aug 26 23:22:18 user nova-compute[73497]: iface.tcp_timestamp = <empty>
Aug 26 23:22:18 user nova-compute[73497]: iface.redirect = <empty>
Aug 26 23:22:18 user nova-compute[73497]: iface.def_task_mgmt_timeout = 0
Aug 26 23:22:18 user nova-compute[73497]: iface.header_digest = <empty>
Aug 26 23:22:18 user nova-compute[73497]: iface.data_digest = <empty>
Aug 26 23:22:18 user nova-compute[73497]: iface.immediate_data = <empty>
Aug 26 23:22:18 user nova-compute[73497]: iface.initial_r2t = <empty>
Aug 26 23:22:18 user nova-compute[73497]: iface.data_seq_inorder = <empty>
Aug 26 23:22:18 user nova-compute[73497]: iface.data_pdu_inorder = <empty>
Aug 26 23:22:18 user nova-compute[73497]: iface.erl = 0
Aug 26 23:22:18 user nova-compute[73497]: iface.max_receive_data_len = 0
Aug 26 23:22:18 user nova-compute[73497]: iface.first_burst_len = 0
Aug 26 23:22:18 user nova-compute[73497]: iface.max_outstanding_r2t = 0
Aug 26 23:22:18 user nova-compute[73497]: iface.max_burst_len = 0
Aug 26 23:22:18 user nova-compute[73497]: iface.chap_auth = <empty>
Aug 26 23:22:18 user nova-compute[73497]: iface.bidi_chap = <empty>
Aug 26 23:22:18 user nova-compute[73497]: iface.strict_login_compliance = <empty>
Aug 26 23:22:18 user nova-compute[73497]: iface.discovery_auth = <empty>
Aug 26 23:22:18 user nova-compute[73497]: iface.discovery_logout = <empty>
Aug 26 23:22:18 user nova-compute[73497]: node.discovery_address = <empty>
Aug 26 23:22:18 user nova-compute[73497]: node.discovery_port = 0
Aug 26 23:22:18 user nova-compute[73497]: node.discovery_type = static
Aug 26 23:22:18 user nova-compute[73497]: node.session.initial_cmdsn = 0
Aug 26 23:22:18 user nova-compute[73497]: node.session.initial_login_retry_max = 8
Aug 26 23:22:18 user nova-compute[73497]: node.session.xmit_thread_priority = -20
Aug 26 23:22:18 user nova-compute[73497]: node.session.cmds_max = 128
Aug 26 23:22:18 user nova-compute[73497]: node.session.queue_depth = 32
Aug 26 23:22:18 user nova-compute[73497]: node.session.nr_sessions = 1
Aug 26 23:22:18 user nova-compute[73497]: node.session.auth.authmethod = CHAP
Aug 26 23:22:18 user nova-compute[73497]: node.session.auth.username = AoxmeCnv
Aug 26 23:22:18 user nova-compute[73497]: node.session.auth.password = ***
Aug 26 23:22:18 user nova-compute[73497]: node.session.auth.username_in = <empty>
Aug 26 23:22:18 user nova-compute[73497]: node.session.auth.password_in = <empty>
Aug 26 23:22:18 user nova-compute[73497]: node.session.auth.chap_algs = MD5
Aug 26 23:22:18 user nova-compute[73497]: node.session.timeo.replacement_timeout = 120
Aug 26 23:22:18 user nova-compute[73497]: node.session.err_timeo.abort_timeout = 15
Aug 26 23:22:18 user nova-compute[73497]: node.session.err_timeo.lu_reset_timeout = 30
Aug 26 23:22:18 user nova-compute[73497]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 26 23:22:18 user nova-compute[73497]: node.session.err_timeo.host_reset_timeout = 60
Aug 26 23:22:18 user nova-compute[73497]: node.session.iscsi.FastAbort = Yes
Aug 26 23:22:18 user nova-compute[73497]: node.session.iscsi.InitialR2T = No
Aug 26 23:22:18 user nova-compute[73497]: node.session.iscsi.ImmediateData = Yes
Aug 26 23:22:18 user nova-compute[73497]: node.session.iscsi.FirstBurstLength = 262144
Aug 26 23:22:18 user nova-compute[73497]: node.session.iscsi.MaxBurstLength = 16776192
Aug 26 23:22:18 user nova-compute[73497]: node.session.iscsi.DefaultTime2Retain = 0
Aug 26 23:22:18 user nova-compute[73497]: node.session.iscsi.DefaultTime2Wait = 2
Aug 26 23:22:18 user nova-compute[73497]: node.session.iscsi.MaxConnections = 1
Aug 26 23:22:18 user nova-compute[73497]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 26 23:22:18 user nova-compute[73497]: node.session.iscsi.ERL = 0
Aug 26 23:22:18 user nova-compute[73497]: node.session.scan = manual
Aug 26 23:22:18 user nova-compute[73497]: node.session.reopen_max = 0
Aug 26 23:22:18 user nova-compute[73497]: node.conn[0].address = 172.16.0.220
Aug 26 23:22:18 user nova-compute[73497]: node.conn[0].port = 3260
Aug 26 23:22:18 user nova-compute[73497]: node.conn[0].startup = manual
Aug 26 23:22:18 user nova-compute[73497]: node.conn[0].tcp.window_size = 524288
Aug 26 23:22:18 user nova-compute[73497]: node.conn[0].tcp.type_of_service = 0
Aug 26 23:22:18 user nova-compute[73497]: node.conn[0].timeo.logout_timeout = 15
Aug 26 23:22:18 user nova-compute[73497]: node.conn[0].timeo.login_timeout = 15
Aug 26 23:22:18 user nova-compute[73497]: node.conn[0].timeo.auth_timeout = 45
Aug 26 23:22:18 user nova-compute[73497]: node.conn[0].timeo.noop_out_interval = 5
Aug 26 23:22:18 user nova-compute[73497]: node.conn[0].timeo.noop_out_timeout = 5
Aug 26 23:22:18 user nova-compute[73497]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 26 23:22:18 user nova-compute[73497]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 26 23:22:18 user nova-compute[73497]: node.conn[0].iscsi.HeaderDigest = None
Aug 26 23:22:18 user nova-compute[73497]: node.conn[0].iscsi.DataDigest = None
Aug 26 23:22:18 user nova-compute[73497]: node.conn[0].iscsi.IFMarker = No
Aug 26 23:22:18 user nova-compute[73497]: node.conn[0].iscsi.OFMarker = No
Aug 26 23:22:18 user nova-compute[73497]: # END RECORD
Aug 26 23:22:18 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[406ff40c-af5c-4b69-9512-0ae786687b84]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[18687eac-646b-4b75-9fd9-1fa90a139591]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AoxmeCnv {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Acquiring lock "refresh_cache-ee6283d5-40de-432d-997c-0be52ff673ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Acquired lock "refresh_cache-ee6283d5-40de-432d-997c-0be52ff673ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.network.neutron [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AoxmeCnv" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dae9f72-a5e0-4347-a582-228da4a05411]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AoxmeCnv'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[06730101-b492-48dc-8c11-78c11285bbf9]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b168350-cb6e-472c-a60c-5fe3d6583109]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:22:18 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:22:18 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:22:18 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:22:18 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:22:18 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:22:18 user nova-compute[73497]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)
Aug 26 23:22:18 user nova-compute[73497]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)
Aug 26 23:22:18 user nova-compute[73497]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)
Aug 26 23:22:18 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:22:18 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:22:18 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:22:18 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:22:18 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:22:18 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:22:18 user nova-compute[73497]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)
Aug 26 23:22:18 user nova-compute[73497]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)
Aug 26 23:22:18 user nova-compute[73497]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)
Aug 26 23:22:18 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.159s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] HCTL ('42', '0', '0', 0) found on session 26 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Scanning host 42 c: 0, t: 0, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.013s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69a48bf-9abd-4d76-8f28-88e2dfc91771]: (4, ('0 0 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Searching for a device in session 26 and hctl ('42', '0', '0', 0) yield: sdk {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoxmeCnv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.182s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] <== connect_volume: return (183ms) {'type': 'block', 'scsi_wwn': '26439336133663233', 'path': '/dev/sdk'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439336133663233', 'path': '/dev/sdk'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1727169761',display_name='tempest-ServerStableDeviceRescueTest-server-1727169761',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1727169761',id=17,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0c6dCTiAMo7WCdbWslqH9tRAbJDKdO8xWor1zTiSdHMPGnIJqmEvuGj4G36lWhcWYWS/KgnWVp5bD+V07b0Shoxky7106vuRftXiegNWPYOB3XSzzs7Pa+BYY/5QFS6Q==',key_name='tempest-keypair-1129487804',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:18:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d19a5c1c2c4a456a86efbbadd38d94c6',ramdisk_id='',reservation_id='r-3ltexvmi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1149676122',owner_user_name='tempest-ServerStableDeviceRescueTest-1149676122-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:20:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5745595130cb414283855ace84751a92',uuid=7c124dd9-4dce-4c6f-925c-6eda8e187d84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "127a3626-0dfe-4050-83d8-43658958e8df", "address": "fa:16:3e:1c:46:66", "network": {"id": "0b5f5877-f6f2-4814-878a-25181e72db29", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-155251039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-155251039-network", "vif_mac": "fa:16:3e:1c:46:66"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19a5c1c2c4a456a86efbbadd38d94c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127a3626-0d", "ovs_interfaceid": "127a3626-0dfe-4050-83d8-43658958e8df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Converting VIF {"id": "127a3626-0dfe-4050-83d8-43658958e8df", "address": "fa:16:3e:1c:46:66", "network": {"id": "0b5f5877-f6f2-4814-878a-25181e72db29", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-155251039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-155251039-network", "vif_mac": "fa:16:3e:1c:46:66"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19a5c1c2c4a456a86efbbadd38d94c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127a3626-0d", "ovs_interfaceid": "127a3626-0dfe-4050-83d8-43658958e8df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:46:66,bridge_name='br-int',has_traffic_filtering=True,id=127a3626-0dfe-4050-83d8-43658958e8df,network=Network(0b5f5877-f6f2-4814-878a-25181e72db29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap127a3626-0d') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.objects.instance [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c124dd9-4dce-4c6f-925c-6eda8e187d84 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.objects.base [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Object Instance<7c124dd9-4dce-4c6f-925c-6eda8e187d84> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:22:18 user nova-compute[73497]:   <uuid>7c124dd9-4dce-4c6f-925c-6eda8e187d84</uuid>
Aug 26 23:22:18 user nova-compute[73497]:   <name>instance-00000011</name>
Aug 26 23:22:18 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:22:18 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:22:18 user nova-compute[73497]:   <metadata>
Aug 26 23:22:18 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:22:18 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:22:18 user nova-compute[73497]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1727169761</nova:name>
Aug 26 23:22:18 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:22:18</nova:creationTime>
Aug 26 23:22:18 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:22:18 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:22:18 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:22:18 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:22:18 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:22:18 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:22:18 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:22:18 user nova-compute[73497]:       <nova:owner>
Aug 26 23:22:18 user nova-compute[73497]:         <nova:user uuid="5745595130cb414283855ace84751a92">tempest-ServerStableDeviceRescueTest-1149676122-project-member</nova:user>
Aug 26 23:22:18 user nova-compute[73497]:         <nova:project uuid="d19a5c1c2c4a456a86efbbadd38d94c6">tempest-ServerStableDeviceRescueTest-1149676122</nova:project>
Aug 26 23:22:18 user nova-compute[73497]:       </nova:owner>
Aug 26 23:22:18 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:22:18 user nova-compute[73497]:       <nova:ports>
Aug 26 23:22:18 user nova-compute[73497]:         <nova:port uuid="127a3626-0dfe-4050-83d8-43658958e8df">
Aug 26 23:22:18 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 23:22:18 user nova-compute[73497]:         </nova:port>
Aug 26 23:22:18 user nova-compute[73497]:       </nova:ports>
Aug 26 23:22:18 user nova-compute[73497]:     </nova:instance>
Aug 26 23:22:18 user nova-compute[73497]:   </metadata>
Aug 26 23:22:18 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:22:18 user nova-compute[73497]:     <system>
Aug 26 23:22:18 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:22:18 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:22:18 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:22:18 user nova-compute[73497]:       <entry name="serial">7c124dd9-4dce-4c6f-925c-6eda8e187d84</entry>
Aug 26 23:22:18 user nova-compute[73497]:       <entry name="uuid">7c124dd9-4dce-4c6f-925c-6eda8e187d84</entry>
Aug 26 23:22:18 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:22:18 user nova-compute[73497]:     </system>
Aug 26 23:22:18 user nova-compute[73497]:   </sysinfo>
Aug 26 23:22:18 user nova-compute[73497]:   <os>
Aug 26 23:22:18 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:22:18 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:22:18 user nova-compute[73497]:   </os>
Aug 26 23:22:18 user nova-compute[73497]:   <features>
Aug 26 23:22:18 user nova-compute[73497]:     <acpi/>
Aug 26 23:22:18 user nova-compute[73497]:     <apic/>
Aug 26 23:22:18 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:22:18 user nova-compute[73497]:   </features>
Aug 26 23:22:18 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:22:18 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:22:18 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:22:18 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:22:18 user nova-compute[73497]:   </clock>
Aug 26 23:22:18 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:22:18 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:22:18 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:22:18 user nova-compute[73497]:   </cpu>
Aug 26 23:22:18 user nova-compute[73497]:   <devices>
Aug 26 23:22:18 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:22:18 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:22:18 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk"/>
Aug 26 23:22:18 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:22:18 user nova-compute[73497]:     </disk>
Aug 26 23:22:18 user nova-compute[73497]:     <disk type="block" device="disk">
Aug 26 23:22:18 user nova-compute[73497]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:22:18 user nova-compute[73497]:       <source dev="/dev/sdk"/>
Aug 26 23:22:18 user nova-compute[73497]:       <target dev="vdb" bus="virtio"/>
Aug 26 23:22:18 user nova-compute[73497]:       <serial>00fbc86c-3cce-40a9-83b5-dbbf5bf49662</serial>
Aug 26 23:22:18 user nova-compute[73497]:     </disk>
Aug 26 23:22:18 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:22:18 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:22:18 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk.rescue"/>
Aug 26 23:22:18 user nova-compute[73497]:       <target dev="vdc" bus="virtio"/>
Aug 26 23:22:18 user nova-compute[73497]:       <boot order="1"/>
Aug 26 23:22:18 user nova-compute[73497]:     </disk>
Aug 26 23:22:18 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:22:18 user nova-compute[73497]:       <mac address="fa:16:3e:1c:46:66"/>
Aug 26 23:22:18 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:22:18 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:22:18 user nova-compute[73497]:       <target dev="tap127a3626-0d"/>
Aug 26 23:22:18 user nova-compute[73497]:     </interface>
Aug 26 23:22:18 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:22:18 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/console.log" append="off"/>
Aug 26 23:22:18 user nova-compute[73497]:     </serial>
Aug 26 23:22:18 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:22:18 user nova-compute[73497]:     <video>
Aug 26 23:22:18 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:22:18 user nova-compute[73497]:     </video>
Aug 26 23:22:18 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:22:18 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:22:18 user nova-compute[73497]:     </rng>
Aug 26 23:22:18 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:22:18 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:22:18 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:22:18 user nova-compute[73497]:     </memballoon>
Aug 26 23:22:18 user nova-compute[73497]:   </devices>
Aug 26 23:22:18 user nova-compute[73497]: </domain>
Aug 26 23:22:18 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:22:18 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Instance destroyed successfully.
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] No VIF found with MAC fa:16:3e:1c:46:66, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG nova.network.neutron [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Updating instance_info_cache with network_info: [{"id": "61639246-9d84-4629-9666-154897feaeae", "address": "fa:16:3e:56:41:f9", "network": {"id": "108c66fb-49a3-4c69-a3ac-93d9643a1d3e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025099504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e765258a50d46dea25bfd9c72970eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61639246-9d", "ovs_interfaceid": "61639246-9d84-4629-9666-154897feaeae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Releasing lock "refresh_cache-ee6283d5-40de-432d-997c-0be52ff673ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG os_brick.utils [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d44fb9a-f0fb-436a-a37c-f9843e006e37]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ab8795-bc5c-4292-9614-343b382826b3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e28d787-aa47-4670-a046-f96ab8233666]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab87a00e-d5d1-475d-889a-c86010acf4f3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:22:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:22:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:22:19 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:22:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5f21be-d66d-42b2-854b-900432e56e50]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:22:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:22:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:22:19 user nova-compute[73497]: DEBUG os_brick.utils [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:22:19 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693092124.321504, 926f8e5c-8d8a-4f07-bf08-e60700ce4698 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:22:19 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] VM Stopped (Lifecycle Event)
Aug 26 23:22:19 user nova-compute[73497]: DEBUG nova.compute.manager [None req-628b58bb-978f-4969-92ce-d083046fee53 None None] [instance: 926f8e5c-8d8a-4f07-bf08-e60700ce4698] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:22:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:20 user nova-compute[73497]: DEBUG nova.compute.manager [req-7d6a7e0a-b11f-46b2-b88b-808a3611058e req-e116ee3b-b19d-412e-b538-56a511ead8f5 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Received event network-vif-plugged-127a3626-0dfe-4050-83d8-43658958e8df {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7d6a7e0a-b11f-46b2-b88b-808a3611058e req-e116ee3b-b19d-412e-b538-56a511ead8f5 service nova] Acquiring lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7d6a7e0a-b11f-46b2-b88b-808a3611058e req-e116ee3b-b19d-412e-b538-56a511ead8f5 service nova] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7d6a7e0a-b11f-46b2-b88b-808a3611058e req-e116ee3b-b19d-412e-b538-56a511ead8f5 service nova] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:20 user nova-compute[73497]: DEBUG nova.compute.manager [req-7d6a7e0a-b11f-46b2-b88b-808a3611058e req-e116ee3b-b19d-412e-b538-56a511ead8f5 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] No waiting events found dispatching network-vif-plugged-127a3626-0dfe-4050-83d8-43658958e8df {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:20 user nova-compute[73497]: WARNING nova.compute.manager [req-7d6a7e0a-b11f-46b2-b88b-808a3611058e req-e116ee3b-b19d-412e-b538-56a511ead8f5 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Received unexpected event network-vif-plugged-127a3626-0dfe-4050-83d8-43658958e8df for instance with vm_state active and task_state rescuing.
Aug 26 23:22:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:22 user nova-compute[73497]: DEBUG nova.compute.manager [req-6e7af88b-df24-4ea8-af17-14f054dbe010 req-169d2978-6d91-46c6-9113-135b81b30ee8 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-changed-dbc2a5c3-3411-4be9-aa3b-a902180c81c2 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:22 user nova-compute[73497]: DEBUG nova.compute.manager [req-6e7af88b-df24-4ea8-af17-14f054dbe010 req-169d2978-6d91-46c6-9113-135b81b30ee8 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Refreshing instance network info cache due to event network-changed-dbc2a5c3-3411-4be9-aa3b-a902180c81c2. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:22:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6e7af88b-df24-4ea8-af17-14f054dbe010 req-169d2978-6d91-46c6-9113-135b81b30ee8 service nova] Acquiring lock "refresh_cache-2f46a6a8-a043-455a-98f8-dae359594f56" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:22:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6e7af88b-df24-4ea8-af17-14f054dbe010 req-169d2978-6d91-46c6-9113-135b81b30ee8 service nova] Acquired lock "refresh_cache-2f46a6a8-a043-455a-98f8-dae359594f56" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:22:22 user nova-compute[73497]: DEBUG nova.network.neutron [req-6e7af88b-df24-4ea8-af17-14f054dbe010 req-169d2978-6d91-46c6-9113-135b81b30ee8 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Refreshing network info cache for port dbc2a5c3-3411-4be9-aa3b-a902180c81c2 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:22:22 user nova-compute[73497]: DEBUG nova.compute.manager [req-ec529c55-3df3-4dc1-9c8d-c2495cfdc052 req-4a23f58c-c800-42f7-ba1f-3220b8927e96 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Received event network-vif-plugged-127a3626-0dfe-4050-83d8-43658958e8df {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ec529c55-3df3-4dc1-9c8d-c2495cfdc052 req-4a23f58c-c800-42f7-ba1f-3220b8927e96 service nova] Acquiring lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ec529c55-3df3-4dc1-9c8d-c2495cfdc052 req-4a23f58c-c800-42f7-ba1f-3220b8927e96 service nova] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ec529c55-3df3-4dc1-9c8d-c2495cfdc052 req-4a23f58c-c800-42f7-ba1f-3220b8927e96 service nova] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:22 user nova-compute[73497]: DEBUG nova.compute.manager [req-ec529c55-3df3-4dc1-9c8d-c2495cfdc052 req-4a23f58c-c800-42f7-ba1f-3220b8927e96 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] No waiting events found dispatching network-vif-plugged-127a3626-0dfe-4050-83d8-43658958e8df {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:22 user nova-compute[73497]: WARNING nova.compute.manager [req-ec529c55-3df3-4dc1-9c8d-c2495cfdc052 req-4a23f58c-c800-42f7-ba1f-3220b8927e96 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Received unexpected event network-vif-plugged-127a3626-0dfe-4050-83d8-43658958e8df for instance with vm_state active and task_state rescuing.
Aug 26 23:22:22 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Removed pending event for 7c124dd9-4dce-4c6f-925c-6eda8e187d84 due to event {{(pid=73497) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 23:22:22 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092142.3706386, 7c124dd9-4dce-4c6f-925c-6eda8e187d84 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:22:22 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] VM Resumed (Lifecycle Event)
Aug 26 23:22:22 user nova-compute[73497]: DEBUG nova.compute.manager [None req-be40e535-4c76-4876-888c-40318abbba82 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:22:22 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:22:22 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:22:22 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 23:22:22 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092142.3796463, 7c124dd9-4dce-4c6f-925c-6eda8e187d84 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:22:22 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] VM Started (Lifecycle Event)
Aug 26 23:22:22 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:22:22 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:22:22 user nova-compute[73497]: DEBUG nova.network.neutron [req-6e7af88b-df24-4ea8-af17-14f054dbe010 req-169d2978-6d91-46c6-9113-135b81b30ee8 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Updated VIF entry in instance network info cache for port dbc2a5c3-3411-4be9-aa3b-a902180c81c2. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:22:22 user nova-compute[73497]: DEBUG nova.network.neutron [req-6e7af88b-df24-4ea8-af17-14f054dbe010 req-169d2978-6d91-46c6-9113-135b81b30ee8 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Updating instance_info_cache with network_info: [{"id": "dbc2a5c3-3411-4be9-aa3b-a902180c81c2", "address": "fa:16:3e:7e:8e:8a", "network": {"id": "43d07640-08ec-4f81-9b86-a9b192b9aaf3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-376476172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbc2a5c3-34", "ovs_interfaceid": "dbc2a5c3-3411-4be9-aa3b-a902180c81c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5dbd55d2-5e99-474c-a1f5-8c87c783aa07", "address": "fa:16:3e:07:92:18", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbd55d2-5e", "ovs_interfaceid": "5dbd55d2-5e99-474c-a1f5-8c87c783aa07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "66a415ff-2dea-4458-bdba-35ac845cd7d6", "address": "fa:16:3e:7c:f6:90", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a415ff-2d", "ovs_interfaceid": "66a415ff-2dea-4458-bdba-35ac845cd7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0e19373c-aa09-49fa-a349-1a7caafa8b61", "address": "fa:16:3e:46:67:4c", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e19373c-aa", "ovs_interfaceid": "0e19373c-aa09-49fa-a349-1a7caafa8b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fb8cf209-6174-4bcd-9beb-d2f21ef40e5e", "address": "fa:16:3e:86:4c:dd", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8cf209-61", "ovs_interfaceid": "fb8cf209-6174-4bcd-9beb-d2f21ef40e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b2bc5017-c7ab-43ff-b092-f49336426174", "address": "fa:16:3e:15:05:18", "network": {"id": "061595cf-a510-4019-9445-60a0fa5b2338", "bridge": "br-int", "label": "tempest-device-tagging-net2-827609296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bc5017-c7", "ovs_interfaceid": "b2bc5017-c7ab-43ff-b092-f49336426174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a9571bef-59d5-4a2d-9803-69bf1e5335d1", "address": "fa:16:3e:75:bf:5d", "network": {"id": "061595cf-a510-4019-9445-60a0fa5b2338", "bridge": "br-int", "label": "tempest-device-tagging-net2-827609296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9571bef-59", "ovs_interfaceid": "a9571bef-59d5-4a2d-9803-69bf1e5335d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:22:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6e7af88b-df24-4ea8-af17-14f054dbe010 req-169d2978-6d91-46c6-9113-135b81b30ee8 service nova] Releasing lock "refresh_cache-2f46a6a8-a043-455a-98f8-dae359594f56" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:22:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Acquiring lock "2f46a6a8-a043-455a-98f8-dae359594f56" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Lock "2f46a6a8-a043-455a-98f8-dae359594f56" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Acquiring lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:25 user nova-compute[73497]: INFO nova.compute.manager [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Terminating instance
Aug 26 23:22:25 user nova-compute[73497]: DEBUG nova.compute.manager [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:22:25 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:25 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:25 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:25 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:25 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:25 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:25 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:25 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:25 user nova-compute[73497]: DEBUG nova.compute.manager [req-39308009-dc61-44b3-a53a-798b48e84d63 req-c0a80803-0ae0-43a7-9cce-8171190675c4 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-unplugged-dbc2a5c3-3411-4be9-aa3b-a902180c81c2 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-39308009-dc61-44b3-a53a-798b48e84d63 req-c0a80803-0ae0-43a7-9cce-8171190675c4 service nova] Acquiring lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-39308009-dc61-44b3-a53a-798b48e84d63 req-c0a80803-0ae0-43a7-9cce-8171190675c4 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-39308009-dc61-44b3-a53a-798b48e84d63 req-c0a80803-0ae0-43a7-9cce-8171190675c4 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:25 user nova-compute[73497]: DEBUG nova.compute.manager [req-39308009-dc61-44b3-a53a-798b48e84d63 req-c0a80803-0ae0-43a7-9cce-8171190675c4 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] No waiting events found dispatching network-vif-unplugged-dbc2a5c3-3411-4be9-aa3b-a902180c81c2 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:25 user nova-compute[73497]: DEBUG nova.compute.manager [req-39308009-dc61-44b3-a53a-798b48e84d63 req-c0a80803-0ae0-43a7-9cce-8171190675c4 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-unplugged-dbc2a5c3-3411-4be9-aa3b-a902180c81c2 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:22:25 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:25 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:25 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:26 user nova-compute[73497]: DEBUG nova.compute.manager [req-34c458ce-1dde-4b11-a9c2-b6dab13d4c5b req-9f97c81b-0896-4157-9aff-26870435df45 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-unplugged-66a415ff-2dea-4458-bdba-35ac845cd7d6 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-34c458ce-1dde-4b11-a9c2-b6dab13d4c5b req-9f97c81b-0896-4157-9aff-26870435df45 service nova] Acquiring lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-34c458ce-1dde-4b11-a9c2-b6dab13d4c5b req-9f97c81b-0896-4157-9aff-26870435df45 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-34c458ce-1dde-4b11-a9c2-b6dab13d4c5b req-9f97c81b-0896-4157-9aff-26870435df45 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:26 user nova-compute[73497]: DEBUG nova.compute.manager [req-34c458ce-1dde-4b11-a9c2-b6dab13d4c5b req-9f97c81b-0896-4157-9aff-26870435df45 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] No waiting events found dispatching network-vif-unplugged-66a415ff-2dea-4458-bdba-35ac845cd7d6 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:26 user nova-compute[73497]: DEBUG nova.compute.manager [req-34c458ce-1dde-4b11-a9c2-b6dab13d4c5b req-9f97c81b-0896-4157-9aff-26870435df45 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-unplugged-66a415ff-2dea-4458-bdba-35ac845cd7d6 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:22:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:26 user nova-compute[73497]: DEBUG nova.compute.manager [req-aca4fb65-9a1b-4174-bfa3-0ffce9c1a281 req-e65929fd-db12-4afa-b904-c719f14d4f61 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-unplugged-0e19373c-aa09-49fa-a349-1a7caafa8b61 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-aca4fb65-9a1b-4174-bfa3-0ffce9c1a281 req-e65929fd-db12-4afa-b904-c719f14d4f61 service nova] Acquiring lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-aca4fb65-9a1b-4174-bfa3-0ffce9c1a281 req-e65929fd-db12-4afa-b904-c719f14d4f61 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-aca4fb65-9a1b-4174-bfa3-0ffce9c1a281 req-e65929fd-db12-4afa-b904-c719f14d4f61 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:26 user nova-compute[73497]: DEBUG nova.compute.manager [req-aca4fb65-9a1b-4174-bfa3-0ffce9c1a281 req-e65929fd-db12-4afa-b904-c719f14d4f61 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] No waiting events found dispatching network-vif-unplugged-0e19373c-aa09-49fa-a349-1a7caafa8b61 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:26 user nova-compute[73497]: DEBUG nova.compute.manager [req-aca4fb65-9a1b-4174-bfa3-0ffce9c1a281 req-e65929fd-db12-4afa-b904-c719f14d4f61 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-unplugged-0e19373c-aa09-49fa-a349-1a7caafa8b61 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:22:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:27 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Instance destroyed successfully.
Aug 26 23:22:27 user nova-compute[73497]: DEBUG nova.objects.instance [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Lazy-loading 'resources' on Instance uuid 2f46a6a8-a043-455a-98f8-dae359594f56 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1775784956',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1775784956',id=21,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9PcDWaqvZjQMAm2aFt+GxNtEgti/NEeHD88SVIby22zzwNaIAqngw48wB+G3YfNVc+s3B1+0Mu4lcCj5+9KN6J/GDGAN+VKjqnDSozbka/CKrR8HOKCotXzucPkwM8Jw==',key_name='tempest-keypair-312567637',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:20:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70d34ef8af644207b59d77a2d42c5f21',ramdisk_id='',reservation_id='r-xfpadl0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-802076125',owner_user_name='tempest-TaggedBootDevicesTest-802076125-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:20:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db2fc512067944a7aa32ec31c9db0252',uuid=2f46a6a8-a043-455a-98f8-dae359594f56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbc2a5c3-3411-4be9-aa3b-a902180c81c2", "address": "fa:16:3e:7e:8e:8a", "network": {"id": "43d07640-08ec-4f81-9b86-a9b192b9aaf3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-376476172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbc2a5c3-34", "ovs_interfaceid": "dbc2a5c3-3411-4be9-aa3b-a902180c81c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converting VIF {"id": "dbc2a5c3-3411-4be9-aa3b-a902180c81c2", "address": "fa:16:3e:7e:8e:8a", "network": {"id": "43d07640-08ec-4f81-9b86-a9b192b9aaf3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-376476172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbc2a5c3-34", "ovs_interfaceid": "dbc2a5c3-3411-4be9-aa3b-a902180c81c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:8e:8a,bridge_name='br-int',has_traffic_filtering=True,id=dbc2a5c3-3411-4be9-aa3b-a902180c81c2,network=Network(43d07640-08ec-4f81-9b86-a9b192b9aaf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbc2a5c3-34') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG os_vif [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:8e:8a,bridge_name='br-int',has_traffic_filtering=True,id=dbc2a5c3-3411-4be9-aa3b-a902180c81c2,network=Network(43d07640-08ec-4f81-9b86-a9b192b9aaf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbc2a5c3-34') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbc2a5c3-34, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:27 user nova-compute[73497]: INFO os_vif [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:8e:8a,bridge_name='br-int',has_traffic_filtering=True,id=dbc2a5c3-3411-4be9-aa3b-a902180c81c2,network=Network(43d07640-08ec-4f81-9b86-a9b192b9aaf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbc2a5c3-34')
Aug 26 23:22:27 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1775784956',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1775784956',id=21,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9PcDWaqvZjQMAm2aFt+GxNtEgti/NEeHD88SVIby22zzwNaIAqngw48wB+G3YfNVc+s3B1+0Mu4lcCj5+9KN6J/GDGAN+VKjqnDSozbka/CKrR8HOKCotXzucPkwM8Jw==',key_name='tempest-keypair-312567637',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:20:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70d34ef8af644207b59d77a2d42c5f21',ramdisk_id='',reservation_id='r-xfpadl0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-802076125',owner_user_name='tempest-TaggedBootDevicesTest-802076125-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:20:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db2fc512067944a7aa32ec31c9db0252',uuid=2f46a6a8-a043-455a-98f8-dae359594f56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5dbd55d2-5e99-474c-a1f5-8c87c783aa07", "address": "fa:16:3e:07:92:18", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbd55d2-5e", "ovs_interfaceid": "5dbd55d2-5e99-474c-a1f5-8c87c783aa07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converting VIF {"id": "5dbd55d2-5e99-474c-a1f5-8c87c783aa07", "address": "fa:16:3e:07:92:18", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbd55d2-5e", "ovs_interfaceid": "5dbd55d2-5e99-474c-a1f5-8c87c783aa07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:92:18,bridge_name='br-int',has_traffic_filtering=True,id=5dbd55d2-5e99-474c-a1f5-8c87c783aa07,network=Network(cf1f6776-4e09-43f5-8ab1-3a654646b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5dbd55d2-5e') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG os_vif [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:92:18,bridge_name='br-int',has_traffic_filtering=True,id=5dbd55d2-5e99-474c-a1f5-8c87c783aa07,network=Network(cf1f6776-4e09-43f5-8ab1-3a654646b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5dbd55d2-5e') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5dbd55d2-5e, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:27 user nova-compute[73497]: INFO os_vif [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:92:18,bridge_name='br-int',has_traffic_filtering=True,id=5dbd55d2-5e99-474c-a1f5-8c87c783aa07,network=Network(cf1f6776-4e09-43f5-8ab1-3a654646b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5dbd55d2-5e')
Aug 26 23:22:27 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1775784956',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1775784956',id=21,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9PcDWaqvZjQMAm2aFt+GxNtEgti/NEeHD88SVIby22zzwNaIAqngw48wB+G3YfNVc+s3B1+0Mu4lcCj5+9KN6J/GDGAN+VKjqnDSozbka/CKrR8HOKCotXzucPkwM8Jw==',key_name='tempest-keypair-312567637',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:20:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70d34ef8af644207b59d77a2d42c5f21',ramdisk_id='',reservation_id='r-xfpadl0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-802076125',owner_user_name='tempest-TaggedBootDevicesTest-802076125-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:20:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db2fc512067944a7aa32ec31c9db0252',uuid=2f46a6a8-a043-455a-98f8-dae359594f56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66a415ff-2dea-4458-bdba-35ac845cd7d6", "address": "fa:16:3e:7c:f6:90", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a415ff-2d", "ovs_interfaceid": "66a415ff-2dea-4458-bdba-35ac845cd7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converting VIF {"id": "66a415ff-2dea-4458-bdba-35ac845cd7d6", "address": "fa:16:3e:7c:f6:90", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a415ff-2d", "ovs_interfaceid": "66a415ff-2dea-4458-bdba-35ac845cd7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:f6:90,bridge_name='br-int',has_traffic_filtering=True,id=66a415ff-2dea-4458-bdba-35ac845cd7d6,network=Network(cf1f6776-4e09-43f5-8ab1-3a654646b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap66a415ff-2d') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG os_vif [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:f6:90,bridge_name='br-int',has_traffic_filtering=True,id=66a415ff-2dea-4458-bdba-35ac845cd7d6,network=Network(cf1f6776-4e09-43f5-8ab1-3a654646b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap66a415ff-2d') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66a415ff-2d, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:27 user nova-compute[73497]: INFO os_vif [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:f6:90,bridge_name='br-int',has_traffic_filtering=True,id=66a415ff-2dea-4458-bdba-35ac845cd7d6,network=Network(cf1f6776-4e09-43f5-8ab1-3a654646b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap66a415ff-2d')
Aug 26 23:22:27 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1775784956',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1775784956',id=21,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9PcDWaqvZjQMAm2aFt+GxNtEgti/NEeHD88SVIby22zzwNaIAqngw48wB+G3YfNVc+s3B1+0Mu4lcCj5+9KN6J/GDGAN+VKjqnDSozbka/CKrR8HOKCotXzucPkwM8Jw==',key_name='tempest-keypair-312567637',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:20:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70d34ef8af644207b59d77a2d42c5f21',ramdisk_id='',reservation_id='r-xfpadl0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-802076125',owner_user_name='tempest-TaggedBootDevicesTest-802076125-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:20:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db2fc512067944a7aa32ec31c9db0252',uuid=2f46a6a8-a043-455a-98f8-dae359594f56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e19373c-aa09-49fa-a349-1a7caafa8b61", "address": "fa:16:3e:46:67:4c", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e19373c-aa", "ovs_interfaceid": "0e19373c-aa09-49fa-a349-1a7caafa8b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converting VIF {"id": "0e19373c-aa09-49fa-a349-1a7caafa8b61", "address": "fa:16:3e:46:67:4c", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e19373c-aa", "ovs_interfaceid": "0e19373c-aa09-49fa-a349-1a7caafa8b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:67:4c,bridge_name='br-int',has_traffic_filtering=True,id=0e19373c-aa09-49fa-a349-1a7caafa8b61,network=Network(cf1f6776-4e09-43f5-8ab1-3a654646b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e19373c-aa') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG os_vif [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:67:4c,bridge_name='br-int',has_traffic_filtering=True,id=0e19373c-aa09-49fa-a349-1a7caafa8b61,network=Network(cf1f6776-4e09-43f5-8ab1-3a654646b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e19373c-aa') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e19373c-aa, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:27 user nova-compute[73497]: INFO os_vif [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:67:4c,bridge_name='br-int',has_traffic_filtering=True,id=0e19373c-aa09-49fa-a349-1a7caafa8b61,network=Network(cf1f6776-4e09-43f5-8ab1-3a654646b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e19373c-aa')
Aug 26 23:22:27 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1775784956',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1775784956',id=21,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9PcDWaqvZjQMAm2aFt+GxNtEgti/NEeHD88SVIby22zzwNaIAqngw48wB+G3YfNVc+s3B1+0Mu4lcCj5+9KN6J/GDGAN+VKjqnDSozbka/CKrR8HOKCotXzucPkwM8Jw==',key_name='tempest-keypair-312567637',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:20:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70d34ef8af644207b59d77a2d42c5f21',ramdisk_id='',reservation_id='r-xfpadl0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-802076125',owner_user_name='tempest-TaggedBootDevicesTest-802076125-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:20:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db2fc512067944a7aa32ec31c9db0252',uuid=2f46a6a8-a043-455a-98f8-dae359594f56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb8cf209-6174-4bcd-9beb-d2f21ef40e5e", "address": "fa:16:3e:86:4c:dd", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8cf209-61", "ovs_interfaceid": "fb8cf209-6174-4bcd-9beb-d2f21ef40e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converting VIF {"id": "fb8cf209-6174-4bcd-9beb-d2f21ef40e5e", "address": "fa:16:3e:86:4c:dd", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8cf209-61", "ovs_interfaceid": "fb8cf209-6174-4bcd-9beb-d2f21ef40e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:4c:dd,bridge_name='br-int',has_traffic_filtering=True,id=fb8cf209-6174-4bcd-9beb-d2f21ef40e5e,network=Network(cf1f6776-4e09-43f5-8ab1-3a654646b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb8cf209-61') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG os_vif [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:4c:dd,bridge_name='br-int',has_traffic_filtering=True,id=fb8cf209-6174-4bcd-9beb-d2f21ef40e5e,network=Network(cf1f6776-4e09-43f5-8ab1-3a654646b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb8cf209-61') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb8cf209-61, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:27 user nova-compute[73497]: INFO os_vif [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:4c:dd,bridge_name='br-int',has_traffic_filtering=True,id=fb8cf209-6174-4bcd-9beb-d2f21ef40e5e,network=Network(cf1f6776-4e09-43f5-8ab1-3a654646b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb8cf209-61')
Aug 26 23:22:27 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1775784956',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1775784956',id=21,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9PcDWaqvZjQMAm2aFt+GxNtEgti/NEeHD88SVIby22zzwNaIAqngw48wB+G3YfNVc+s3B1+0Mu4lcCj5+9KN6J/GDGAN+VKjqnDSozbka/CKrR8HOKCotXzucPkwM8Jw==',key_name='tempest-keypair-312567637',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:20:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70d34ef8af644207b59d77a2d42c5f21',ramdisk_id='',reservation_id='r-xfpadl0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-802076125',owner_user_name='tempest-TaggedBootDevicesTest-802076125-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:20:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db2fc512067944a7aa32ec31c9db0252',uuid=2f46a6a8-a043-455a-98f8-dae359594f56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2bc5017-c7ab-43ff-b092-f49336426174", "address": "fa:16:3e:15:05:18", "network": {"id": "061595cf-a510-4019-9445-60a0fa5b2338", "bridge": "br-int", "label": "tempest-device-tagging-net2-827609296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bc5017-c7", "ovs_interfaceid": "b2bc5017-c7ab-43ff-b092-f49336426174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converting VIF {"id": "b2bc5017-c7ab-43ff-b092-f49336426174", "address": "fa:16:3e:15:05:18", "network": {"id": "061595cf-a510-4019-9445-60a0fa5b2338", "bridge": "br-int", "label": "tempest-device-tagging-net2-827609296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bc5017-c7", "ovs_interfaceid": "b2bc5017-c7ab-43ff-b092-f49336426174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:05:18,bridge_name='br-int',has_traffic_filtering=True,id=b2bc5017-c7ab-43ff-b092-f49336426174,network=Network(061595cf-a510-4019-9445-60a0fa5b2338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2bc5017-c7') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG os_vif [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:05:18,bridge_name='br-int',has_traffic_filtering=True,id=b2bc5017-c7ab-43ff-b092-f49336426174,network=Network(061595cf-a510-4019-9445-60a0fa5b2338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2bc5017-c7') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2bc5017-c7, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:27 user nova-compute[73497]: INFO os_vif [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:05:18,bridge_name='br-int',has_traffic_filtering=True,id=b2bc5017-c7ab-43ff-b092-f49336426174,network=Network(061595cf-a510-4019-9445-60a0fa5b2338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2bc5017-c7')
Aug 26 23:22:27 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1775784956',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1775784956',id=21,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9PcDWaqvZjQMAm2aFt+GxNtEgti/NEeHD88SVIby22zzwNaIAqngw48wB+G3YfNVc+s3B1+0Mu4lcCj5+9KN6J/GDGAN+VKjqnDSozbka/CKrR8HOKCotXzucPkwM8Jw==',key_name='tempest-keypair-312567637',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:20:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70d34ef8af644207b59d77a2d42c5f21',ramdisk_id='',reservation_id='r-xfpadl0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-802076125',owner_user_name='tempest-TaggedBootDevicesTest-802076125-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:20:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db2fc512067944a7aa32ec31c9db0252',uuid=2f46a6a8-a043-455a-98f8-dae359594f56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9571bef-59d5-4a2d-9803-69bf1e5335d1", "address": "fa:16:3e:75:bf:5d", "network": {"id": "061595cf-a510-4019-9445-60a0fa5b2338", "bridge": "br-int", "label": "tempest-device-tagging-net2-827609296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9571bef-59", "ovs_interfaceid": "a9571bef-59d5-4a2d-9803-69bf1e5335d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converting VIF {"id": "a9571bef-59d5-4a2d-9803-69bf1e5335d1", "address": "fa:16:3e:75:bf:5d", "network": {"id": "061595cf-a510-4019-9445-60a0fa5b2338", "bridge": "br-int", "label": "tempest-device-tagging-net2-827609296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9571bef-59", "ovs_interfaceid": "a9571bef-59d5-4a2d-9803-69bf1e5335d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:bf:5d,bridge_name='br-int',has_traffic_filtering=True,id=a9571bef-59d5-4a2d-9803-69bf1e5335d1,network=Network(061595cf-a510-4019-9445-60a0fa5b2338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9571bef-59') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG os_vif [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:bf:5d,bridge_name='br-int',has_traffic_filtering=True,id=a9571bef-59d5-4a2d-9803-69bf1e5335d1,network=Network(061595cf-a510-4019-9445-60a0fa5b2338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9571bef-59') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9571bef-59, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:22:27 user nova-compute[73497]: INFO os_vif [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:bf:5d,bridge_name='br-int',has_traffic_filtering=True,id=a9571bef-59d5-4a2d-9803-69bf1e5335d1,network=Network(061595cf-a510-4019-9445-60a0fa5b2338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9571bef-59')
Aug 26 23:22:27 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUlHYgXE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:22:27 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:22:27 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c85dc3-53a6-4b81-a9a4-cf079c4996ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG nova.compute.manager [req-1b42a3b1-79d8-431e-925d-448a5dd68159 req-abe61e75-7b6e-47b6-afc9-48fccdebb766 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-plugged-dbc2a5c3-3411-4be9-aa3b-a902180c81c2 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1b42a3b1-79d8-431e-925d-448a5dd68159 req-abe61e75-7b6e-47b6-afc9-48fccdebb766 service nova] Acquiring lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1b42a3b1-79d8-431e-925d-448a5dd68159 req-abe61e75-7b6e-47b6-afc9-48fccdebb766 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1b42a3b1-79d8-431e-925d-448a5dd68159 req-abe61e75-7b6e-47b6-afc9-48fccdebb766 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG nova.compute.manager [req-1b42a3b1-79d8-431e-925d-448a5dd68159 req-abe61e75-7b6e-47b6-afc9-48fccdebb766 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] No waiting events found dispatching network-vif-plugged-dbc2a5c3-3411-4be9-aa3b-a902180c81c2 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:27 user nova-compute[73497]: WARNING nova.compute.manager [req-1b42a3b1-79d8-431e-925d-448a5dd68159 req-abe61e75-7b6e-47b6-afc9-48fccdebb766 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received unexpected event network-vif-plugged-dbc2a5c3-3411-4be9-aa3b-a902180c81c2 for instance with vm_state active and task_state deleting.
Aug 26 23:22:27 user nova-compute[73497]: DEBUG nova.compute.manager [req-1b42a3b1-79d8-431e-925d-448a5dd68159 req-abe61e75-7b6e-47b6-afc9-48fccdebb766 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-unplugged-5dbd55d2-5e99-474c-a1f5-8c87c783aa07 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1b42a3b1-79d8-431e-925d-448a5dd68159 req-abe61e75-7b6e-47b6-afc9-48fccdebb766 service nova] Acquiring lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1b42a3b1-79d8-431e-925d-448a5dd68159 req-abe61e75-7b6e-47b6-afc9-48fccdebb766 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1b42a3b1-79d8-431e-925d-448a5dd68159 req-abe61e75-7b6e-47b6-afc9-48fccdebb766 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG nova.compute.manager [req-1b42a3b1-79d8-431e-925d-448a5dd68159 req-abe61e75-7b6e-47b6-afc9-48fccdebb766 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] No waiting events found dispatching network-vif-unplugged-5dbd55d2-5e99-474c-a1f5-8c87c783aa07 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG nova.compute.manager [req-1b42a3b1-79d8-431e-925d-448a5dd68159 req-abe61e75-7b6e-47b6-afc9-48fccdebb766 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-unplugged-5dbd55d2-5e99-474c-a1f5-8c87c783aa07 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG nova.compute.manager [req-1b42a3b1-79d8-431e-925d-448a5dd68159 req-abe61e75-7b6e-47b6-afc9-48fccdebb766 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-plugged-5dbd55d2-5e99-474c-a1f5-8c87c783aa07 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1b42a3b1-79d8-431e-925d-448a5dd68159 req-abe61e75-7b6e-47b6-afc9-48fccdebb766 service nova] Acquiring lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1b42a3b1-79d8-431e-925d-448a5dd68159 req-abe61e75-7b6e-47b6-afc9-48fccdebb766 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1b42a3b1-79d8-431e-925d-448a5dd68159 req-abe61e75-7b6e-47b6-afc9-48fccdebb766 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG nova.compute.manager [req-1b42a3b1-79d8-431e-925d-448a5dd68159 req-abe61e75-7b6e-47b6-afc9-48fccdebb766 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] No waiting events found dispatching network-vif-plugged-5dbd55d2-5e99-474c-a1f5-8c87c783aa07 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:27 user nova-compute[73497]: WARNING nova.compute.manager [req-1b42a3b1-79d8-431e-925d-448a5dd68159 req-abe61e75-7b6e-47b6-afc9-48fccdebb766 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received unexpected event network-vif-plugged-5dbd55d2-5e99-474c-a1f5-8c87c783aa07 for instance with vm_state active and task_state deleting.
Aug 26 23:22:27 user nova-compute[73497]: DEBUG nova.compute.manager [req-1b42a3b1-79d8-431e-925d-448a5dd68159 req-abe61e75-7b6e-47b6-afc9-48fccdebb766 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-unplugged-a9571bef-59d5-4a2d-9803-69bf1e5335d1 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1b42a3b1-79d8-431e-925d-448a5dd68159 req-abe61e75-7b6e-47b6-afc9-48fccdebb766 service nova] Acquiring lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1b42a3b1-79d8-431e-925d-448a5dd68159 req-abe61e75-7b6e-47b6-afc9-48fccdebb766 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1b42a3b1-79d8-431e-925d-448a5dd68159 req-abe61e75-7b6e-47b6-afc9-48fccdebb766 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG nova.compute.manager [req-1b42a3b1-79d8-431e-925d-448a5dd68159 req-abe61e75-7b6e-47b6-afc9-48fccdebb766 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] No waiting events found dispatching network-vif-unplugged-a9571bef-59d5-4a2d-9803-69bf1e5335d1 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG nova.compute.manager [req-1b42a3b1-79d8-431e-925d-448a5dd68159 req-abe61e75-7b6e-47b6-afc9-48fccdebb766 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-unplugged-a9571bef-59d5-4a2d-9803-69bf1e5335d1 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG nova.compute.manager [req-1b42a3b1-79d8-431e-925d-448a5dd68159 req-abe61e75-7b6e-47b6-afc9-48fccdebb766 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-plugged-a9571bef-59d5-4a2d-9803-69bf1e5335d1 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1b42a3b1-79d8-431e-925d-448a5dd68159 req-abe61e75-7b6e-47b6-afc9-48fccdebb766 service nova] Acquiring lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1b42a3b1-79d8-431e-925d-448a5dd68159 req-abe61e75-7b6e-47b6-afc9-48fccdebb766 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1b42a3b1-79d8-431e-925d-448a5dd68159 req-abe61e75-7b6e-47b6-afc9-48fccdebb766 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG nova.compute.manager [req-1b42a3b1-79d8-431e-925d-448a5dd68159 req-abe61e75-7b6e-47b6-afc9-48fccdebb766 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] No waiting events found dispatching network-vif-plugged-a9571bef-59d5-4a2d-9803-69bf1e5335d1 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:27 user nova-compute[73497]: WARNING nova.compute.manager [req-1b42a3b1-79d8-431e-925d-448a5dd68159 req-abe61e75-7b6e-47b6-afc9-48fccdebb766 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received unexpected event network-vif-plugged-a9571bef-59d5-4a2d-9803-69bf1e5335d1 for instance with vm_state active and task_state deleting.
Aug 26 23:22:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de68482-6fbd-48b6-b08e-cc2304465b75]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:22:27 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:22:27 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:22:27 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:22:27 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:22:27 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:22:27 user nova-compute[73497]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)
Aug 26 23:22:27 user nova-compute[73497]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)
Aug 26 23:22:27 user nova-compute[73497]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)
Aug 26 23:22:27 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:22:27 user nova-compute[73497]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f (non-flash)
Aug 26 23:22:27 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:22:27 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:22:27 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:22:27 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:22:27 user nova-compute[73497]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)
Aug 26 23:22:27 user nova-compute[73497]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)
Aug 26 23:22:27 user nova-compute[73497]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)
Aug 26 23:22:27 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281c3b3e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f'): ({'sdd'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Removing single pathed devices sdd {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec12323-6813-428f-b2c6-3003512c9228]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ee0987-2d51-49f3-821e-722654360ef7]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Flushing IO for device /dev/sdd {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebac776-6795-48dd-bf29-5bb7bdbf8ce3]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[febe3296-7711-4e4a-a176-3cf414990375]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:22:27 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] SCSI volumes sdd have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[99abf3e2-d702-4284-94b8-1749d4d82e2a]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1f8a56-31ce-462c-a57e-657b69586b52]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f, portal: 172.16.0.220,3260]
Aug 26 23:22:28 user nova-compute[73497]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f, portal: 172.16.0.220,3260] successful.
Aug 26 23:22:28 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f7bbdf2-e9e8-47df-9f5c-626c7c644a5f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.054s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a7101e-03bf-49a5-9fb7-a16422187966]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] <== disconnect_volume: return (399ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxFTKOjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:22:28 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG nova.compute.manager [req-36aef9fc-9ce1-4dc1-815a-44ae6ebe21d6 req-b8c1f581-9e92-454c-b855-009a266a21ca service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-plugged-66a415ff-2dea-4458-bdba-35ac845cd7d6 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-36aef9fc-9ce1-4dc1-815a-44ae6ebe21d6 req-b8c1f581-9e92-454c-b855-009a266a21ca service nova] Acquiring lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-36aef9fc-9ce1-4dc1-815a-44ae6ebe21d6 req-b8c1f581-9e92-454c-b855-009a266a21ca service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-36aef9fc-9ce1-4dc1-815a-44ae6ebe21d6 req-b8c1f581-9e92-454c-b855-009a266a21ca service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG nova.compute.manager [req-36aef9fc-9ce1-4dc1-815a-44ae6ebe21d6 req-b8c1f581-9e92-454c-b855-009a266a21ca service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] No waiting events found dispatching network-vif-plugged-66a415ff-2dea-4458-bdba-35ac845cd7d6 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:28 user nova-compute[73497]: WARNING nova.compute.manager [req-36aef9fc-9ce1-4dc1-815a-44ae6ebe21d6 req-b8c1f581-9e92-454c-b855-009a266a21ca service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received unexpected event network-vif-plugged-66a415ff-2dea-4458-bdba-35ac845cd7d6 for instance with vm_state active and task_state deleting.
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5871317-e421-440f-85a1-3bfe3d69f8b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb514c5-1a9f-4fc9-9fbc-7ff7c0af1331]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:22:28 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:22:28 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:22:28 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:22:28 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:22:28 user nova-compute[73497]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)
Aug 26 23:22:28 user nova-compute[73497]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)
Aug 26 23:22:28 user nova-compute[73497]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)
Aug 26 23:22:28 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:22:28 user nova-compute[73497]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee (non-flash)
Aug 26 23:22:28 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:22:28 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:22:28 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:22:28 user nova-compute[73497]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)
Aug 26 23:22:28 user nova-compute[73497]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)
Aug 26 23:22:28 user nova-compute[73497]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)
Aug 26 23:22:28 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282c45a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee'): ({'sdf'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Removing single pathed devices sdf {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[352616ef-7bb4-4897-b69c-e20216e1f6b9]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9768c0a6-ff5b-4411-a288-9b7aaeaede45]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Flushing IO for device /dev/sdf {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9a9923-56e2-428d-80f1-d33173672305]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG nova.compute.manager [req-bd8eff1e-a793-4088-99e1-6c0fe130a542 req-8ce01be3-6eaf-4b14-9761-42fd9322ccc3 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-plugged-0e19373c-aa09-49fa-a349-1a7caafa8b61 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-bd8eff1e-a793-4088-99e1-6c0fe130a542 req-8ce01be3-6eaf-4b14-9761-42fd9322ccc3 service nova] Acquiring lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-bd8eff1e-a793-4088-99e1-6c0fe130a542 req-8ce01be3-6eaf-4b14-9761-42fd9322ccc3 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-bd8eff1e-a793-4088-99e1-6c0fe130a542 req-8ce01be3-6eaf-4b14-9761-42fd9322ccc3 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG nova.compute.manager [req-bd8eff1e-a793-4088-99e1-6c0fe130a542 req-8ce01be3-6eaf-4b14-9761-42fd9322ccc3 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] No waiting events found dispatching network-vif-plugged-0e19373c-aa09-49fa-a349-1a7caafa8b61 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:28 user nova-compute[73497]: WARNING nova.compute.manager [req-bd8eff1e-a793-4088-99e1-6c0fe130a542 req-8ce01be3-6eaf-4b14-9761-42fd9322ccc3 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received unexpected event network-vif-plugged-0e19373c-aa09-49fa-a349-1a7caafa8b61 for instance with vm_state active and task_state deleting.
Aug 26 23:22:28 user nova-compute[73497]: DEBUG nova.compute.manager [req-bd8eff1e-a793-4088-99e1-6c0fe130a542 req-8ce01be3-6eaf-4b14-9761-42fd9322ccc3 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-unplugged-fb8cf209-6174-4bcd-9beb-d2f21ef40e5e {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-bd8eff1e-a793-4088-99e1-6c0fe130a542 req-8ce01be3-6eaf-4b14-9761-42fd9322ccc3 service nova] Acquiring lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-bd8eff1e-a793-4088-99e1-6c0fe130a542 req-8ce01be3-6eaf-4b14-9761-42fd9322ccc3 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-bd8eff1e-a793-4088-99e1-6c0fe130a542 req-8ce01be3-6eaf-4b14-9761-42fd9322ccc3 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG nova.compute.manager [req-bd8eff1e-a793-4088-99e1-6c0fe130a542 req-8ce01be3-6eaf-4b14-9761-42fd9322ccc3 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] No waiting events found dispatching network-vif-unplugged-fb8cf209-6174-4bcd-9beb-d2f21ef40e5e {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG nova.compute.manager [req-bd8eff1e-a793-4088-99e1-6c0fe130a542 req-8ce01be3-6eaf-4b14-9761-42fd9322ccc3 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-unplugged-fb8cf209-6174-4bcd-9beb-d2f21ef40e5e for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG nova.compute.manager [req-bd8eff1e-a793-4088-99e1-6c0fe130a542 req-8ce01be3-6eaf-4b14-9761-42fd9322ccc3 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-plugged-fb8cf209-6174-4bcd-9beb-d2f21ef40e5e {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-bd8eff1e-a793-4088-99e1-6c0fe130a542 req-8ce01be3-6eaf-4b14-9761-42fd9322ccc3 service nova] Acquiring lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-bd8eff1e-a793-4088-99e1-6c0fe130a542 req-8ce01be3-6eaf-4b14-9761-42fd9322ccc3 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-bd8eff1e-a793-4088-99e1-6c0fe130a542 req-8ce01be3-6eaf-4b14-9761-42fd9322ccc3 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG nova.compute.manager [req-bd8eff1e-a793-4088-99e1-6c0fe130a542 req-8ce01be3-6eaf-4b14-9761-42fd9322ccc3 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] No waiting events found dispatching network-vif-plugged-fb8cf209-6174-4bcd-9beb-d2f21ef40e5e {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:28 user nova-compute[73497]: WARNING nova.compute.manager [req-bd8eff1e-a793-4088-99e1-6c0fe130a542 req-8ce01be3-6eaf-4b14-9761-42fd9322ccc3 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received unexpected event network-vif-plugged-fb8cf209-6174-4bcd-9beb-d2f21ef40e5e for instance with vm_state active and task_state deleting.
Aug 26 23:22:28 user nova-compute[73497]: DEBUG nova.compute.manager [req-bd8eff1e-a793-4088-99e1-6c0fe130a542 req-8ce01be3-6eaf-4b14-9761-42fd9322ccc3 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-unplugged-b2bc5017-c7ab-43ff-b092-f49336426174 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-bd8eff1e-a793-4088-99e1-6c0fe130a542 req-8ce01be3-6eaf-4b14-9761-42fd9322ccc3 service nova] Acquiring lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-bd8eff1e-a793-4088-99e1-6c0fe130a542 req-8ce01be3-6eaf-4b14-9761-42fd9322ccc3 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-bd8eff1e-a793-4088-99e1-6c0fe130a542 req-8ce01be3-6eaf-4b14-9761-42fd9322ccc3 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG nova.compute.manager [req-bd8eff1e-a793-4088-99e1-6c0fe130a542 req-8ce01be3-6eaf-4b14-9761-42fd9322ccc3 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] No waiting events found dispatching network-vif-unplugged-b2bc5017-c7ab-43ff-b092-f49336426174 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG nova.compute.manager [req-bd8eff1e-a793-4088-99e1-6c0fe130a542 req-8ce01be3-6eaf-4b14-9761-42fd9322ccc3 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-unplugged-b2bc5017-c7ab-43ff-b092-f49336426174 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG nova.compute.manager [req-bd8eff1e-a793-4088-99e1-6c0fe130a542 req-8ce01be3-6eaf-4b14-9761-42fd9322ccc3 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-plugged-b2bc5017-c7ab-43ff-b092-f49336426174 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-bd8eff1e-a793-4088-99e1-6c0fe130a542 req-8ce01be3-6eaf-4b14-9761-42fd9322ccc3 service nova] Acquiring lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-bd8eff1e-a793-4088-99e1-6c0fe130a542 req-8ce01be3-6eaf-4b14-9761-42fd9322ccc3 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-bd8eff1e-a793-4088-99e1-6c0fe130a542 req-8ce01be3-6eaf-4b14-9761-42fd9322ccc3 service nova] Lock "2f46a6a8-a043-455a-98f8-dae359594f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG nova.compute.manager [req-bd8eff1e-a793-4088-99e1-6c0fe130a542 req-8ce01be3-6eaf-4b14-9761-42fd9322ccc3 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] No waiting events found dispatching network-vif-plugged-b2bc5017-c7ab-43ff-b092-f49336426174 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:28 user nova-compute[73497]: WARNING nova.compute.manager [req-bd8eff1e-a793-4088-99e1-6c0fe130a542 req-8ce01be3-6eaf-4b14-9761-42fd9322ccc3 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received unexpected event network-vif-plugged-b2bc5017-c7ab-43ff-b092-f49336426174 for instance with vm_state active and task_state deleting.
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.057s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43e867d-ceac-417e-84b7-c8c2dcbc9238]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] SCSI volumes sdf have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[935a73be-a6da-4fca-8899-b077be699190]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9957152b-2fec-4059-afc3-3156608b5ff9]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee, portal: 172.16.0.220,3260]
Aug 26 23:22:28 user nova-compute[73497]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee, portal: 172.16.0.220,3260] successful.
Aug 26 23:22:28 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fae83862-cb43-4437-9680-f544f97fe6ee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaeba567-e2b1-4424-8ddf-23e414bfae60]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] <== disconnect_volume: return (388ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OwQNLdAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:22:28 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fcaa89a-4581-408e-92f9-ebf9aa6974a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[02358fc6-bcf4-48c8-9e63-b8f8aec28b93]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:22:28 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:22:28 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:22:28 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:22:28 user nova-compute[73497]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)
Aug 26 23:22:28 user nova-compute[73497]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)
Aug 26 23:22:28 user nova-compute[73497]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)
Aug 26 23:22:28 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:22:28 user nova-compute[73497]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a (non-flash)
Aug 26 23:22:28 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:22:28 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:22:28 user nova-compute[73497]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)
Aug 26 23:22:28 user nova-compute[73497]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)
Aug 26 23:22:28 user nova-compute[73497]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)
Aug 26 23:22:28 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282c45a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a'): ({'sdh'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Removing single pathed devices sdh {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a5d7cb-89e9-4c58-98ab-4b9976cf6725]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca34020-4392-4171-90f6-b07b7c54e591]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Flushing IO for device /dev/sdh {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[81786aa0-337a-4c65-b48a-fc73d1a74d47]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.057s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db69f4f-dbf6-47ad-bf15-5e2834d8eea5]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] SCSI volumes sdh have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b066b07-14c5-4612-a21d-730c1b630404]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce076a98-59db-4d3d-a932-5a36e58e1572]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a, portal: 172.16.0.220,3260]
Aug 26 23:22:28 user nova-compute[73497]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a, portal: 172.16.0.220,3260] successful.
Aug 26 23:22:28 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a71fdf-6491-4e87-ac8f-81fff9209a5a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13bfbdc-109c-4927-a7e6-5f261b689b57]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] <== disconnect_volume: return (393ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:22:28 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:22:28 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Deleting instance files /opt/stack/data/nova/instances/2f46a6a8-a043-455a-98f8-dae359594f56_del
Aug 26 23:22:28 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Deletion of /opt/stack/data/nova/instances/2f46a6a8-a043-455a-98f8-dae359594f56_del complete
Aug 26 23:22:29 user nova-compute[73497]: INFO nova.compute.manager [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Took 3.75 seconds to destroy the instance on the hypervisor.
Aug 26 23:22:29 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:22:29 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:22:29 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:22:29 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693092134.7925413, ee6283d5-40de-432d-997c-0be52ff673ca => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:22:29 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] VM Stopped (Lifecycle Event)
Aug 26 23:22:29 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4d192fc6-8d2d-419b-8f0a-19e645de9ad6 None None] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:22:30 user nova-compute[73497]: DEBUG nova.compute.manager [req-f7161a10-7af4-423a-bd19-1980f5189396 req-344886d9-dc73-4d2c-bb07-7e302ad3f1d9 service nova] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Received event network-changed-a712145b-99c7-4279-b125-c98565a252f2 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:30 user nova-compute[73497]: DEBUG nova.compute.manager [req-f7161a10-7af4-423a-bd19-1980f5189396 req-344886d9-dc73-4d2c-bb07-7e302ad3f1d9 service nova] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Refreshing instance network info cache due to event network-changed-a712145b-99c7-4279-b125-c98565a252f2. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:22:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f7161a10-7af4-423a-bd19-1980f5189396 req-344886d9-dc73-4d2c-bb07-7e302ad3f1d9 service nova] Acquiring lock "refresh_cache-bde0a05a-a075-4298-907e-cb00798c90af" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:22:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f7161a10-7af4-423a-bd19-1980f5189396 req-344886d9-dc73-4d2c-bb07-7e302ad3f1d9 service nova] Acquired lock "refresh_cache-bde0a05a-a075-4298-907e-cb00798c90af" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:22:30 user nova-compute[73497]: DEBUG nova.network.neutron [req-f7161a10-7af4-423a-bd19-1980f5189396 req-344886d9-dc73-4d2c-bb07-7e302ad3f1d9 service nova] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Refreshing network info cache for port a712145b-99c7-4279-b125-c98565a252f2 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:22:30 user nova-compute[73497]: DEBUG nova.network.neutron [req-f7161a10-7af4-423a-bd19-1980f5189396 req-344886d9-dc73-4d2c-bb07-7e302ad3f1d9 service nova] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Updated VIF entry in instance network info cache for port a712145b-99c7-4279-b125-c98565a252f2. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:22:30 user nova-compute[73497]: DEBUG nova.network.neutron [req-f7161a10-7af4-423a-bd19-1980f5189396 req-344886d9-dc73-4d2c-bb07-7e302ad3f1d9 service nova] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Updating instance_info_cache with network_info: [{"id": "a712145b-99c7-4279-b125-c98565a252f2", "address": "fa:16:3e:c7:e6:d8", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa712145b-99", "ovs_interfaceid": "a712145b-99c7-4279-b125-c98565a252f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:22:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f7161a10-7af4-423a-bd19-1980f5189396 req-344886d9-dc73-4d2c-bb07-7e302ad3f1d9 service nova] Releasing lock "refresh_cache-bde0a05a-a075-4298-907e-cb00798c90af" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:22:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-72c72340-f462-4cf9-9570-053407c06d37 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "bde0a05a-a075-4298-907e-cb00798c90af" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-72c72340-f462-4cf9-9570-053407c06d37 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "bde0a05a-a075-4298-907e-cb00798c90af" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-72c72340-f462-4cf9-9570-053407c06d37 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "bde0a05a-a075-4298-907e-cb00798c90af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-72c72340-f462-4cf9-9570-053407c06d37 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "bde0a05a-a075-4298-907e-cb00798c90af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-72c72340-f462-4cf9-9570-053407c06d37 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "bde0a05a-a075-4298-907e-cb00798c90af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:31 user nova-compute[73497]: INFO nova.compute.manager [None req-72c72340-f462-4cf9-9570-053407c06d37 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Terminating instance
Aug 26 23:22:31 user nova-compute[73497]: DEBUG nova.compute.manager [None req-72c72340-f462-4cf9-9570-053407c06d37 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:22:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:32 user nova-compute[73497]: DEBUG nova.compute.manager [req-3e5b97fb-99a5-4087-8063-313e6fd0f434 req-ec8ba5b0-d2c7-42f3-93ad-b8a5e584dd4a service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-deleted-0e19373c-aa09-49fa-a349-1a7caafa8b61 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:32 user nova-compute[73497]: INFO nova.compute.manager [req-3e5b97fb-99a5-4087-8063-313e6fd0f434 req-ec8ba5b0-d2c7-42f3-93ad-b8a5e584dd4a service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Neutron deleted interface 0e19373c-aa09-49fa-a349-1a7caafa8b61; detaching it from the instance and deleting it from the info cache
Aug 26 23:22:32 user nova-compute[73497]: DEBUG nova.network.neutron [req-3e5b97fb-99a5-4087-8063-313e6fd0f434 req-ec8ba5b0-d2c7-42f3-93ad-b8a5e584dd4a service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Updating instance_info_cache with network_info: [{"id": "dbc2a5c3-3411-4be9-aa3b-a902180c81c2", "address": "fa:16:3e:7e:8e:8a", "network": {"id": "43d07640-08ec-4f81-9b86-a9b192b9aaf3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-376476172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbc2a5c3-34", "ovs_interfaceid": "dbc2a5c3-3411-4be9-aa3b-a902180c81c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5dbd55d2-5e99-474c-a1f5-8c87c783aa07", "address": "fa:16:3e:07:92:18", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbd55d2-5e", "ovs_interfaceid": "5dbd55d2-5e99-474c-a1f5-8c87c783aa07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "66a415ff-2dea-4458-bdba-35ac845cd7d6", "address": "fa:16:3e:7c:f6:90", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a415ff-2d", "ovs_interfaceid": "66a415ff-2dea-4458-bdba-35ac845cd7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb8cf209-6174-4bcd-9beb-d2f21ef40e5e", "address": "fa:16:3e:86:4c:dd", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8cf209-61", "ovs_interfaceid": "fb8cf209-6174-4bcd-9beb-d2f21ef40e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b2bc5017-c7ab-43ff-b092-f49336426174", "address": "fa:16:3e:15:05:18", "network": {"id": "061595cf-a510-4019-9445-60a0fa5b2338", "bridge": "br-int", "label": "tempest-device-tagging-net2-827609296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bc5017-c7", "ovs_interfaceid": "b2bc5017-c7ab-43ff-b092-f49336426174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a9571bef-59d5-4a2d-9803-69bf1e5335d1", "address": "fa:16:3e:75:bf:5d", "network": {"id": "061595cf-a510-4019-9445-60a0fa5b2338", "bridge": "br-int", "label": "tempest-device-tagging-net2-827609296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9571bef-59", "ovs_interfaceid": "a9571bef-59d5-4a2d-9803-69bf1e5335d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:22:32 user nova-compute[73497]: DEBUG nova.compute.manager [req-3e5b97fb-99a5-4087-8063-313e6fd0f434 req-ec8ba5b0-d2c7-42f3-93ad-b8a5e584dd4a service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Detach interface failed, port_id=0e19373c-aa09-49fa-a349-1a7caafa8b61, reason: Instance 2f46a6a8-a043-455a-98f8-dae359594f56 could not be found. {{(pid=73497) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 23:22:32 user nova-compute[73497]: DEBUG nova.compute.manager [req-3e5b97fb-99a5-4087-8063-313e6fd0f434 req-ec8ba5b0-d2c7-42f3-93ad-b8a5e584dd4a service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-deleted-fb8cf209-6174-4bcd-9beb-d2f21ef40e5e {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:32 user nova-compute[73497]: INFO nova.compute.manager [req-3e5b97fb-99a5-4087-8063-313e6fd0f434 req-ec8ba5b0-d2c7-42f3-93ad-b8a5e584dd4a service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Neutron deleted interface fb8cf209-6174-4bcd-9beb-d2f21ef40e5e; detaching it from the instance and deleting it from the info cache
Aug 26 23:22:32 user nova-compute[73497]: DEBUG nova.network.neutron [req-3e5b97fb-99a5-4087-8063-313e6fd0f434 req-ec8ba5b0-d2c7-42f3-93ad-b8a5e584dd4a service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Updating instance_info_cache with network_info: [{"id": "dbc2a5c3-3411-4be9-aa3b-a902180c81c2", "address": "fa:16:3e:7e:8e:8a", "network": {"id": "43d07640-08ec-4f81-9b86-a9b192b9aaf3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-376476172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbc2a5c3-34", "ovs_interfaceid": "dbc2a5c3-3411-4be9-aa3b-a902180c81c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5dbd55d2-5e99-474c-a1f5-8c87c783aa07", "address": "fa:16:3e:07:92:18", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbd55d2-5e", "ovs_interfaceid": "5dbd55d2-5e99-474c-a1f5-8c87c783aa07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "66a415ff-2dea-4458-bdba-35ac845cd7d6", "address": "fa:16:3e:7c:f6:90", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a415ff-2d", "ovs_interfaceid": "66a415ff-2dea-4458-bdba-35ac845cd7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b2bc5017-c7ab-43ff-b092-f49336426174", "address": "fa:16:3e:15:05:18", "network": {"id": "061595cf-a510-4019-9445-60a0fa5b2338", "bridge": "br-int", "label": "tempest-device-tagging-net2-827609296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bc5017-c7", "ovs_interfaceid": "b2bc5017-c7ab-43ff-b092-f49336426174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a9571bef-59d5-4a2d-9803-69bf1e5335d1", "address": "fa:16:3e:75:bf:5d", "network": {"id": "061595cf-a510-4019-9445-60a0fa5b2338", "bridge": "br-int", "label": "tempest-device-tagging-net2-827609296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9571bef-59", "ovs_interfaceid": "a9571bef-59d5-4a2d-9803-69bf1e5335d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:22:32 user nova-compute[73497]: DEBUG nova.compute.manager [req-3e5b97fb-99a5-4087-8063-313e6fd0f434 req-ec8ba5b0-d2c7-42f3-93ad-b8a5e584dd4a service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Detach interface failed, port_id=fb8cf209-6174-4bcd-9beb-d2f21ef40e5e, reason: Instance 2f46a6a8-a043-455a-98f8-dae359594f56 could not be found. {{(pid=73497) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 23:22:32 user nova-compute[73497]: DEBUG nova.compute.manager [req-3e5b97fb-99a5-4087-8063-313e6fd0f434 req-ec8ba5b0-d2c7-42f3-93ad-b8a5e584dd4a service nova] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Received event network-vif-unplugged-a712145b-99c7-4279-b125-c98565a252f2 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3e5b97fb-99a5-4087-8063-313e6fd0f434 req-ec8ba5b0-d2c7-42f3-93ad-b8a5e584dd4a service nova] Acquiring lock "bde0a05a-a075-4298-907e-cb00798c90af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3e5b97fb-99a5-4087-8063-313e6fd0f434 req-ec8ba5b0-d2c7-42f3-93ad-b8a5e584dd4a service nova] Lock "bde0a05a-a075-4298-907e-cb00798c90af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3e5b97fb-99a5-4087-8063-313e6fd0f434 req-ec8ba5b0-d2c7-42f3-93ad-b8a5e584dd4a service nova] Lock "bde0a05a-a075-4298-907e-cb00798c90af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:32 user nova-compute[73497]: DEBUG nova.compute.manager [req-3e5b97fb-99a5-4087-8063-313e6fd0f434 req-ec8ba5b0-d2c7-42f3-93ad-b8a5e584dd4a service nova] [instance: bde0a05a-a075-4298-907e-cb00798c90af] No waiting events found dispatching network-vif-unplugged-a712145b-99c7-4279-b125-c98565a252f2 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:32 user nova-compute[73497]: DEBUG nova.compute.manager [req-3e5b97fb-99a5-4087-8063-313e6fd0f434 req-ec8ba5b0-d2c7-42f3-93ad-b8a5e584dd4a service nova] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Received event network-vif-unplugged-a712145b-99c7-4279-b125-c98565a252f2 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:22:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:32 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Instance destroyed successfully.
Aug 26 23:22:32 user nova-compute[73497]: DEBUG nova.objects.instance [None req-72c72340-f462-4cf9-9570-053407c06d37 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lazy-loading 'resources' on Instance uuid bde0a05a-a075-4298-907e-cb00798c90af {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:22:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-72c72340-f462-4cf9-9570-053407c06d37 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:20:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-627150927',display_name='tempest-AttachVolumeNegativeTest-server-627150927',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-627150927',id=22,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/9qhd/GhkzSHpHihosoi6JmUsgRits6X8Unh98xfGdlKbs6a+O5gbOAdwvif6YLfQVufvUt7j2vE7T8022llM5qcU032JWrmL3/vNxxLEr1FEmU+L9CId1VlHMWffA7A==',key_name='tempest-keypair-535794588',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:20:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d784b1d6c31e41d6a03fc377b0be69f5',ramdisk_id='',reservation_id='r-bt1za8ho',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1095215256',owner_user_name='tempest-AttachVolumeNegativeTest-1095215256-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:20:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e38409b92a95475db83540cbc4222466',uuid=bde0a05a-a075-4298-907e-cb00798c90af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a712145b-99c7-4279-b125-c98565a252f2", "address": "fa:16:3e:c7:e6:d8", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa712145b-99", "ovs_interfaceid": "a712145b-99c7-4279-b125-c98565a252f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:22:32 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-72c72340-f462-4cf9-9570-053407c06d37 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Converting VIF {"id": "a712145b-99c7-4279-b125-c98565a252f2", "address": "fa:16:3e:c7:e6:d8", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa712145b-99", "ovs_interfaceid": "a712145b-99c7-4279-b125-c98565a252f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:22:32 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-72c72340-f462-4cf9-9570-053407c06d37 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:e6:d8,bridge_name='br-int',has_traffic_filtering=True,id=a712145b-99c7-4279-b125-c98565a252f2,network=Network(7bae9729-050d-4ff3-a842-91d0ec2c08d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa712145b-99') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:22:32 user nova-compute[73497]: DEBUG os_vif [None req-72c72340-f462-4cf9-9570-053407c06d37 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:e6:d8,bridge_name='br-int',has_traffic_filtering=True,id=a712145b-99c7-4279-b125-c98565a252f2,network=Network(7bae9729-050d-4ff3-a842-91d0ec2c08d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa712145b-99') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:22:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa712145b-99, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:22:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:32 user nova-compute[73497]: INFO os_vif [None req-72c72340-f462-4cf9-9570-053407c06d37 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:e6:d8,bridge_name='br-int',has_traffic_filtering=True,id=a712145b-99c7-4279-b125-c98565a252f2,network=Network(7bae9729-050d-4ff3-a842-91d0ec2c08d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa712145b-99')
Aug 26 23:22:32 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-72c72340-f462-4cf9-9570-053407c06d37 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Deleting instance files /opt/stack/data/nova/instances/bde0a05a-a075-4298-907e-cb00798c90af_del
Aug 26 23:22:32 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-72c72340-f462-4cf9-9570-053407c06d37 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Deletion of /opt/stack/data/nova/instances/bde0a05a-a075-4298-907e-cb00798c90af_del complete
Aug 26 23:22:32 user nova-compute[73497]: INFO nova.compute.manager [None req-72c72340-f462-4cf9-9570-053407c06d37 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 26 23:22:32 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-72c72340-f462-4cf9-9570-053407c06d37 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:22:32 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:22:32 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: bde0a05a-a075-4298-907e-cb00798c90af] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:22:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Starting finish_revert_migration {{(pid=73497) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Start _get_guest_xml network_info=[{"id": "61639246-9d84-4629-9666-154897feaeae", "address": "fa:16:3e:56:41:f9", "network": {"id": "108c66fb-49a3-4c69-a3ac-93d9643a1d3e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025099504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e765258a50d46dea25bfd9c72970eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61639246-9d", "ovs_interfaceid": "61639246-9d84-4629-9666-154897feaeae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b96f2474-5acb-45b5-b26a-7b170802b814', 'guest_format': None, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbmOUkyq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ee6283d5-40de-432d-997c-0be52ff673ca', 'attached_at': '2023-08-26T23:22:33.000000', 'detached_at': '', 'volume_id': 'a1647697-14cc-47fd-a9c1-003e0115159c', 'serial': 'a1647697-14cc-47fd-a9c1-003e0115159c'}, 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:22:33 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:22:33 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:22:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG nova.objects.instance [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lazy-loading 'vcpu_model' on Instance uuid ee6283d5-40de-432d-997c-0be52ff673ca {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbmOUkyq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:22:33 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:22:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:22:33 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:22:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:22:33 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:22:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[db06b001-e4c4-4ed3-95b3-d2e11f58e81a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:22:33 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ece5ee4-7f94-4821-a5ad-17605b323027]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c] added
Aug 26 23:22:33 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[05caadd1-42fd-4026-9bb9-1ca656917a28]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d39063-f398-4d43-bbd4-2ce533e8a66f]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BbmOUkyq {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BbmOUkyq" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a6738d-3c5b-4c50-a6ef-7abc7fc5476e]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BbmOUkyq'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fd62af-d758-4cee-b8ee-8291bb584dfe]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e3f73c-62b3-4982-93e5-1bf95cb5d89a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:22:33 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:22:33 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:22:33 user nova-compute[73497]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)
Aug 26 23:22:33 user nova-compute[73497]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)
Aug 26 23:22:33 user nova-compute[73497]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)
Aug 26 23:22:33 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:22:33 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:22:33 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:22:33 user nova-compute[73497]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)
Aug 26 23:22:33 user nova-compute[73497]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)
Aug 26 23:22:33 user nova-compute[73497]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)
Aug 26 23:22:33 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --login" returned: 0 in 0.127s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0846afb-f8c4-499d-b576-fbbb07aaf838]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c, portal: 172.16.0.220,3260]
Aug 26 23:22:33 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c, portal: 172.16.0.220,3260] successful.
Aug 26 23:22:33 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[83511853-7623-490a-9e0e-760f727b151b]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[572b10ff-15e8-4c30-8eaa-a5b9a455bbed]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:22:33 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:22:33 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:22:33 user nova-compute[73497]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)
Aug 26 23:22:33 user nova-compute[73497]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)
Aug 26 23:22:33 user nova-compute[73497]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)
Aug 26 23:22:33 user nova-compute[73497]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:22:33 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:22:33 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:22:33 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:22:33 user nova-compute[73497]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)
Aug 26 23:22:33 user nova-compute[73497]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)
Aug 26 23:22:33 user nova-compute[73497]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)
Aug 26 23:22:33 user nova-compute[73497]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:22:33 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.380s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:22:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:22:34 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:22:34 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:22:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:34 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f63f957-221a-4582-ae28-fe6fe29eea96]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:22:34 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:22:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbmOUkyq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:22:34 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:22:34 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Took 1.56 seconds to deallocate network for instance.
Aug 26 23:22:34 user nova-compute[73497]: DEBUG nova.compute.manager [req-6fa322db-3f4c-4850-8006-2dd471efc85e req-64cf6a8e-db3f-49e2-bc6a-0a92724978bb service nova] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Received event network-vif-deleted-a712145b-99c7-4279-b125-c98565a252f2 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-72c72340-f462-4cf9-9570-053407c06d37 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-72c72340-f462-4cf9-9570-053407c06d37 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:34 user nova-compute[73497]: DEBUG nova.compute.manager [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Received event network-vif-plugged-a712145b-99c7-4279-b125-c98565a252f2 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] Acquiring lock "bde0a05a-a075-4298-907e-cb00798c90af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] Lock "bde0a05a-a075-4298-907e-cb00798c90af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] Lock "bde0a05a-a075-4298-907e-cb00798c90af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:34 user nova-compute[73497]: DEBUG nova.compute.manager [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] [instance: bde0a05a-a075-4298-907e-cb00798c90af] No waiting events found dispatching network-vif-plugged-a712145b-99c7-4279-b125-c98565a252f2 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:34 user nova-compute[73497]: WARNING nova.compute.manager [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Received unexpected event network-vif-plugged-a712145b-99c7-4279-b125-c98565a252f2 for instance with vm_state deleted and task_state None.
Aug 26 23:22:34 user nova-compute[73497]: DEBUG nova.compute.manager [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-deleted-a9571bef-59d5-4a2d-9803-69bf1e5335d1 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:34 user nova-compute[73497]: INFO nova.compute.manager [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Neutron deleted interface a9571bef-59d5-4a2d-9803-69bf1e5335d1; detaching it from the instance and deleting it from the info cache
Aug 26 23:22:34 user nova-compute[73497]: DEBUG nova.network.neutron [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Updating instance_info_cache with network_info: [{"id": "dbc2a5c3-3411-4be9-aa3b-a902180c81c2", "address": "fa:16:3e:7e:8e:8a", "network": {"id": "43d07640-08ec-4f81-9b86-a9b192b9aaf3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-376476172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbc2a5c3-34", "ovs_interfaceid": "dbc2a5c3-3411-4be9-aa3b-a902180c81c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5dbd55d2-5e99-474c-a1f5-8c87c783aa07", "address": "fa:16:3e:07:92:18", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbd55d2-5e", "ovs_interfaceid": "5dbd55d2-5e99-474c-a1f5-8c87c783aa07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "66a415ff-2dea-4458-bdba-35ac845cd7d6", "address": "fa:16:3e:7c:f6:90", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a415ff-2d", "ovs_interfaceid": "66a415ff-2dea-4458-bdba-35ac845cd7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b2bc5017-c7ab-43ff-b092-f49336426174", "address": "fa:16:3e:15:05:18", "network": {"id": "061595cf-a510-4019-9445-60a0fa5b2338", "bridge": "br-int", "label": "tempest-device-tagging-net2-827609296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bc5017-c7", "ovs_interfaceid": "b2bc5017-c7ab-43ff-b092-f49336426174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:22:34 user nova-compute[73497]: DEBUG nova.compute.manager [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Detach interface failed, port_id=a9571bef-59d5-4a2d-9803-69bf1e5335d1, reason: Instance 2f46a6a8-a043-455a-98f8-dae359594f56 could not be found. {{(pid=73497) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 23:22:34 user nova-compute[73497]: DEBUG nova.compute.manager [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Received event network-vif-plugged-a712145b-99c7-4279-b125-c98565a252f2 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] Acquiring lock "bde0a05a-a075-4298-907e-cb00798c90af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] Lock "bde0a05a-a075-4298-907e-cb00798c90af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] Lock "bde0a05a-a075-4298-907e-cb00798c90af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:34 user nova-compute[73497]: DEBUG nova.compute.manager [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] [instance: bde0a05a-a075-4298-907e-cb00798c90af] No waiting events found dispatching network-vif-plugged-a712145b-99c7-4279-b125-c98565a252f2 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:34 user nova-compute[73497]: WARNING nova.compute.manager [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Received unexpected event network-vif-plugged-a712145b-99c7-4279-b125-c98565a252f2 for instance with vm_state deleted and task_state None.
Aug 26 23:22:34 user nova-compute[73497]: DEBUG nova.compute.manager [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Received event network-vif-plugged-a712145b-99c7-4279-b125-c98565a252f2 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] Acquiring lock "bde0a05a-a075-4298-907e-cb00798c90af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] Lock "bde0a05a-a075-4298-907e-cb00798c90af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] Lock "bde0a05a-a075-4298-907e-cb00798c90af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.009s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:34 user nova-compute[73497]: DEBUG nova.compute.manager [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] [instance: bde0a05a-a075-4298-907e-cb00798c90af] No waiting events found dispatching network-vif-plugged-a712145b-99c7-4279-b125-c98565a252f2 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:34 user nova-compute[73497]: WARNING nova.compute.manager [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Received unexpected event network-vif-plugged-a712145b-99c7-4279-b125-c98565a252f2 for instance with vm_state deleted and task_state None.
Aug 26 23:22:34 user nova-compute[73497]: DEBUG nova.compute.manager [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Received event network-vif-unplugged-a712145b-99c7-4279-b125-c98565a252f2 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] Acquiring lock "bde0a05a-a075-4298-907e-cb00798c90af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] Lock "bde0a05a-a075-4298-907e-cb00798c90af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] Lock "bde0a05a-a075-4298-907e-cb00798c90af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:34 user nova-compute[73497]: DEBUG nova.compute.manager [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] [instance: bde0a05a-a075-4298-907e-cb00798c90af] No waiting events found dispatching network-vif-unplugged-a712145b-99c7-4279-b125-c98565a252f2 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:34 user nova-compute[73497]: WARNING nova.compute.manager [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Received unexpected event network-vif-unplugged-a712145b-99c7-4279-b125-c98565a252f2 for instance with vm_state deleted and task_state None.
Aug 26 23:22:34 user nova-compute[73497]: DEBUG nova.compute.manager [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-deleted-dbc2a5c3-3411-4be9-aa3b-a902180c81c2 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:34 user nova-compute[73497]: INFO nova.compute.manager [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Neutron deleted interface dbc2a5c3-3411-4be9-aa3b-a902180c81c2; detaching it from the instance and deleting it from the info cache
Aug 26 23:22:34 user nova-compute[73497]: DEBUG nova.network.neutron [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Updating instance_info_cache with network_info: [{"id": "5dbd55d2-5e99-474c-a1f5-8c87c783aa07", "address": "fa:16:3e:07:92:18", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbd55d2-5e", "ovs_interfaceid": "5dbd55d2-5e99-474c-a1f5-8c87c783aa07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "66a415ff-2dea-4458-bdba-35ac845cd7d6", "address": "fa:16:3e:7c:f6:90", "network": {"id": "cf1f6776-4e09-43f5-8ab1-3a654646b103", "bridge": "br-int", "label": "tempest-device-tagging-net1-662378017", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a415ff-2d", "ovs_interfaceid": "66a415ff-2dea-4458-bdba-35ac845cd7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b2bc5017-c7ab-43ff-b092-f49336426174", "address": "fa:16:3e:15:05:18", "network": {"id": "061595cf-a510-4019-9445-60a0fa5b2338", "bridge": "br-int", "label": "tempest-device-tagging-net2-827609296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70d34ef8af644207b59d77a2d42c5f21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bc5017-c7", "ovs_interfaceid": "b2bc5017-c7ab-43ff-b092-f49336426174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:22:34 user nova-compute[73497]: DEBUG nova.compute.manager [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Detach interface failed, port_id=dbc2a5c3-3411-4be9-aa3b-a902180c81c2, reason: Instance 2f46a6a8-a043-455a-98f8-dae359594f56 could not be found. {{(pid=73497) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 23:22:34 user nova-compute[73497]: DEBUG nova.compute.manager [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Received event network-vif-plugged-a712145b-99c7-4279-b125-c98565a252f2 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] Acquiring lock "bde0a05a-a075-4298-907e-cb00798c90af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] Lock "bde0a05a-a075-4298-907e-cb00798c90af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] Lock "bde0a05a-a075-4298-907e-cb00798c90af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:34 user nova-compute[73497]: DEBUG nova.compute.manager [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] [instance: bde0a05a-a075-4298-907e-cb00798c90af] No waiting events found dispatching network-vif-plugged-a712145b-99c7-4279-b125-c98565a252f2 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:34 user nova-compute[73497]: WARNING nova.compute.manager [req-4057466b-d197-4d6f-818f-1a2b1f390e8c req-cf32db58-0f02-4a08-9107-3671e57ab2d2 service nova] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Received unexpected event network-vif-plugged-a712145b-99c7-4279-b125-c98565a252f2 for instance with vm_state deleted and task_state None.
Aug 26 23:22:34 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:22:34 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Took 5.37 seconds to deallocate network for instance.
Aug 26 23:22:34 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-72c72340-f462-4cf9-9570-053407c06d37 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:22:34 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-72c72340-f462-4cf9-9570-053407c06d37 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:22:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-72c72340-f462-4cf9-9570-053407c06d37 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.507s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:34 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-72c72340-f462-4cf9-9570-053407c06d37 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Deleted allocations for instance bde0a05a-a075-4298-907e-cb00798c90af
Aug 26 23:22:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-72c72340-f462-4cf9-9570-053407c06d37 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "bde0a05a-a075-4298-907e-cb00798c90af" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.165s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:35 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.426s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:22:35 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] <== connect_volume: return (1428ms) {'type': 'block', 'scsi_wwn': '23335303436633232', 'path': '/dev/sdd'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:22:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335303436633232', 'path': '/dev/sdd'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:22:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:16:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-956611518',display_name='tempest-ServerActionsTestOtherB-server-956611518',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-956611518',id=13,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqify97xxdfMwMioKw2wicMrkUmyII/F1wNcYn2coMZNsxaRCqyQGjP8va1kHwD6Z9ddCdHd23iUWPYbjiNJPdJt82WzvrKCaPX0PtGf0585mA5lLDP0NEIbnQp6LuyOw==',key_name='tempest-keypair-800864699',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:20:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1e765258a50d46dea25bfd9c72970eb9',ramdisk_id='',reservation_id='r-owyjaonv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-435374476',owner_user_name='tempest-ServerActionsTestOtherB-435374476-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:22:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd09339d0e1d46d4a268f6ac8651a9f5',uuid=ee6283d5-40de-432d-997c-0be52ff673ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "61639246-9d84-4629-9666-154897feaeae", "address": "fa:16:3e:56:41:f9", "network": {"id": "108c66fb-49a3-4c69-a3ac-93d9643a1d3e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025099504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e765258a50d46dea25bfd9c72970eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61639246-9d", "ovs_interfaceid": "61639246-9d84-4629-9666-154897feaeae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:22:35 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Converting VIF {"id": "61639246-9d84-4629-9666-154897feaeae", "address": "fa:16:3e:56:41:f9", "network": {"id": "108c66fb-49a3-4c69-a3ac-93d9643a1d3e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025099504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e765258a50d46dea25bfd9c72970eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61639246-9d", "ovs_interfaceid": "61639246-9d84-4629-9666-154897feaeae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:22:35 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=61639246-9d84-4629-9666-154897feaeae,network=Network(108c66fb-49a3-4c69-a3ac-93d9643a1d3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61639246-9d') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:22:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:22:35 user nova-compute[73497]:   <uuid>ee6283d5-40de-432d-997c-0be52ff673ca</uuid>
Aug 26 23:22:35 user nova-compute[73497]:   <name>instance-0000000d</name>
Aug 26 23:22:35 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:22:35 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:22:35 user nova-compute[73497]:   <metadata>
Aug 26 23:22:35 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:22:35 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:22:35 user nova-compute[73497]:       <nova:name>tempest-ServerActionsTestOtherB-server-956611518</nova:name>
Aug 26 23:22:35 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:22:33</nova:creationTime>
Aug 26 23:22:35 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:22:35 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:22:35 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:22:35 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:22:35 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:22:35 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:22:35 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:22:35 user nova-compute[73497]:       <nova:owner>
Aug 26 23:22:35 user nova-compute[73497]:         <nova:user uuid="cd09339d0e1d46d4a268f6ac8651a9f5">tempest-ServerActionsTestOtherB-435374476-project-member</nova:user>
Aug 26 23:22:35 user nova-compute[73497]:         <nova:project uuid="1e765258a50d46dea25bfd9c72970eb9">tempest-ServerActionsTestOtherB-435374476</nova:project>
Aug 26 23:22:35 user nova-compute[73497]:       </nova:owner>
Aug 26 23:22:35 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:22:35 user nova-compute[73497]:       <nova:ports>
Aug 26 23:22:35 user nova-compute[73497]:         <nova:port uuid="61639246-9d84-4629-9666-154897feaeae">
Aug 26 23:22:35 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 23:22:35 user nova-compute[73497]:         </nova:port>
Aug 26 23:22:35 user nova-compute[73497]:       </nova:ports>
Aug 26 23:22:35 user nova-compute[73497]:     </nova:instance>
Aug 26 23:22:35 user nova-compute[73497]:   </metadata>
Aug 26 23:22:35 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:22:35 user nova-compute[73497]:     <system>
Aug 26 23:22:35 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:22:35 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:22:35 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:22:35 user nova-compute[73497]:       <entry name="serial">ee6283d5-40de-432d-997c-0be52ff673ca</entry>
Aug 26 23:22:35 user nova-compute[73497]:       <entry name="uuid">ee6283d5-40de-432d-997c-0be52ff673ca</entry>
Aug 26 23:22:35 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:22:35 user nova-compute[73497]:     </system>
Aug 26 23:22:35 user nova-compute[73497]:   </sysinfo>
Aug 26 23:22:35 user nova-compute[73497]:   <os>
Aug 26 23:22:35 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:22:35 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:22:35 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:22:35 user nova-compute[73497]:   </os>
Aug 26 23:22:35 user nova-compute[73497]:   <features>
Aug 26 23:22:35 user nova-compute[73497]:     <acpi/>
Aug 26 23:22:35 user nova-compute[73497]:     <apic/>
Aug 26 23:22:35 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:22:35 user nova-compute[73497]:   </features>
Aug 26 23:22:35 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:22:35 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:22:35 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:22:35 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:22:35 user nova-compute[73497]:   </clock>
Aug 26 23:22:35 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:22:35 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:22:35 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:22:35 user nova-compute[73497]:   </cpu>
Aug 26 23:22:35 user nova-compute[73497]:   <devices>
Aug 26 23:22:35 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:22:35 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:22:35 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk"/>
Aug 26 23:22:35 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:22:35 user nova-compute[73497]:     </disk>
Aug 26 23:22:35 user nova-compute[73497]:     <disk type="block" device="disk">
Aug 26 23:22:35 user nova-compute[73497]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:22:35 user nova-compute[73497]:       <source dev="/dev/sdd"/>
Aug 26 23:22:35 user nova-compute[73497]:       <target dev="vdb" bus="virtio"/>
Aug 26 23:22:35 user nova-compute[73497]:       <serial>a1647697-14cc-47fd-a9c1-003e0115159c</serial>
Aug 26 23:22:35 user nova-compute[73497]:     </disk>
Aug 26 23:22:35 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:22:35 user nova-compute[73497]:       <mac address="fa:16:3e:56:41:f9"/>
Aug 26 23:22:35 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:22:35 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:22:35 user nova-compute[73497]:       <target dev="tap61639246-9d"/>
Aug 26 23:22:35 user nova-compute[73497]:     </interface>
Aug 26 23:22:35 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:22:35 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/console.log" append="off"/>
Aug 26 23:22:35 user nova-compute[73497]:     </serial>
Aug 26 23:22:35 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:22:35 user nova-compute[73497]:     <video>
Aug 26 23:22:35 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:22:35 user nova-compute[73497]:     </video>
Aug 26 23:22:35 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:22:35 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:22:35 user nova-compute[73497]:     </rng>
Aug 26 23:22:35 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:22:35 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:22:35 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:22:35 user nova-compute[73497]:     </memballoon>
Aug 26 23:22:35 user nova-compute[73497]:   </devices>
Aug 26 23:22:35 user nova-compute[73497]: </domain>
Aug 26 23:22:35 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:22:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:16:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-956611518',display_name='tempest-ServerActionsTestOtherB-server-956611518',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-956611518',id=13,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqify97xxdfMwMioKw2wicMrkUmyII/F1wNcYn2coMZNsxaRCqyQGjP8va1kHwD6Z9ddCdHd23iUWPYbjiNJPdJt82WzvrKCaPX0PtGf0585mA5lLDP0NEIbnQp6LuyOw==',key_name='tempest-keypair-800864699',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:20:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1e765258a50d46dea25bfd9c72970eb9',ramdisk_id='',reservation_id='r-owyjaonv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-435374476',owner_user_name='tempest-ServerActionsTestOtherB-435374476-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:22:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd09339d0e1d46d4a268f6ac8651a9f5',uuid=ee6283d5-40de-432d-997c-0be52ff673ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "61639246-9d84-4629-9666-154897feaeae", "address": "fa:16:3e:56:41:f9", "network": {"id": "108c66fb-49a3-4c69-a3ac-93d9643a1d3e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025099504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e765258a50d46dea25bfd9c72970eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61639246-9d", "ovs_interfaceid": "61639246-9d84-4629-9666-154897feaeae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:22:35 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Converting VIF {"id": "61639246-9d84-4629-9666-154897feaeae", "address": "fa:16:3e:56:41:f9", "network": {"id": "108c66fb-49a3-4c69-a3ac-93d9643a1d3e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025099504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e765258a50d46dea25bfd9c72970eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61639246-9d", "ovs_interfaceid": "61639246-9d84-4629-9666-154897feaeae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:22:35 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=61639246-9d84-4629-9666-154897feaeae,network=Network(108c66fb-49a3-4c69-a3ac-93d9643a1d3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61639246-9d') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:22:35 user nova-compute[73497]: DEBUG os_vif [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=61639246-9d84-4629-9666-154897feaeae,network=Network(108c66fb-49a3-4c69-a3ac-93d9643a1d3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61639246-9d') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:22:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:22:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:22:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61639246-9d, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:22:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap61639246-9d, col_values=(('external_ids', {'iface-id': '61639246-9d84-4629-9666-154897feaeae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:41:f9', 'vm-uuid': 'ee6283d5-40de-432d-997c-0be52ff673ca'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:22:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:22:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:35 user nova-compute[73497]: INFO os_vif [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=61639246-9d84-4629-9666-154897feaeae,network=Network(108c66fb-49a3-4c69-a3ac-93d9643a1d3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61639246-9d')
Aug 26 23:22:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:36 user nova-compute[73497]: DEBUG nova.compute.manager [req-c5101c00-634a-40c6-a84c-15a70ffb0f56 req-e8422c11-7a0d-4b3b-a8f0-f41eb176459f service nova] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Received event network-vif-deleted-b2bc5017-c7ab-43ff-b092-f49336426174 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:36 user nova-compute[73497]: DEBUG nova.compute.manager [req-56e963cb-0a8c-427c-b6b5-c4cec9f8aa0f req-3d53a54f-edc9-4244-bceb-d5c0428816a5 service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Received event network-vif-plugged-61639246-9d84-4629-9666-154897feaeae {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-56e963cb-0a8c-427c-b6b5-c4cec9f8aa0f req-3d53a54f-edc9-4244-bceb-d5c0428816a5 service nova] Acquiring lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-56e963cb-0a8c-427c-b6b5-c4cec9f8aa0f req-3d53a54f-edc9-4244-bceb-d5c0428816a5 service nova] Lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-56e963cb-0a8c-427c-b6b5-c4cec9f8aa0f req-3d53a54f-edc9-4244-bceb-d5c0428816a5 service nova] Lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:36 user nova-compute[73497]: DEBUG nova.compute.manager [req-56e963cb-0a8c-427c-b6b5-c4cec9f8aa0f req-3d53a54f-edc9-4244-bceb-d5c0428816a5 service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] No waiting events found dispatching network-vif-plugged-61639246-9d84-4629-9666-154897feaeae {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:36 user nova-compute[73497]: WARNING nova.compute.manager [req-56e963cb-0a8c-427c-b6b5-c4cec9f8aa0f req-3d53a54f-edc9-4244-bceb-d5c0428816a5 service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Received unexpected event network-vif-plugged-61639246-9d84-4629-9666-154897feaeae for instance with vm_state resized and task_state resize_reverting.
Aug 26 23:22:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:37 user nova-compute[73497]: INFO nova.compute.manager [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Took 2.58 seconds to detach 3 volumes for instance.
Aug 26 23:22:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:37 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:22:37 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:22:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.437s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:37 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Deleted allocations for instance 2f46a6a8-a043-455a-98f8-dae359594f56
Aug 26 23:22:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d0ba1cf8-1d88-4594-bcf0-53a0c4d5738e tempest-TaggedBootDevicesTest-802076125 tempest-TaggedBootDevicesTest-802076125-project-member] Lock "2f46a6a8-a043-455a-98f8-dae359594f56" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.361s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:38 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092158.5503807, ee6283d5-40de-432d-997c-0be52ff673ca => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:22:38 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] VM Resumed (Lifecycle Event)
Aug 26 23:22:38 user nova-compute[73497]: DEBUG nova.compute.manager [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:22:38 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Instance running successfully.
Aug 26 23:22:38 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] finish_revert_migration finished successfully. {{(pid=73497) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 26 23:22:38 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:22:38 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:22:38 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 26 23:22:38 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092158.5560896, ee6283d5-40de-432d-997c-0be52ff673ca => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:22:38 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] VM Started (Lifecycle Event)
Aug 26 23:22:38 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:22:38 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:22:38 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 26 23:22:38 user nova-compute[73497]: INFO nova.compute.manager [None req-52de23ed-d640-4169-a7cb-be74117fb327 tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Updating instance to original state: 'active'
Aug 26 23:22:38 user nova-compute[73497]: DEBUG nova.compute.manager [req-9ad9414f-6963-4d48-a1d6-cf6350ba943d req-fdcd2e49-88a1-49ac-872b-191218bd5eb9 service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Received event network-vif-plugged-61639246-9d84-4629-9666-154897feaeae {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9ad9414f-6963-4d48-a1d6-cf6350ba943d req-fdcd2e49-88a1-49ac-872b-191218bd5eb9 service nova] Acquiring lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9ad9414f-6963-4d48-a1d6-cf6350ba943d req-fdcd2e49-88a1-49ac-872b-191218bd5eb9 service nova] Lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9ad9414f-6963-4d48-a1d6-cf6350ba943d req-fdcd2e49-88a1-49ac-872b-191218bd5eb9 service nova] Lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:38 user nova-compute[73497]: DEBUG nova.compute.manager [req-9ad9414f-6963-4d48-a1d6-cf6350ba943d req-fdcd2e49-88a1-49ac-872b-191218bd5eb9 service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] No waiting events found dispatching network-vif-plugged-61639246-9d84-4629-9666-154897feaeae {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:38 user nova-compute[73497]: WARNING nova.compute.manager [req-9ad9414f-6963-4d48-a1d6-cf6350ba943d req-fdcd2e49-88a1-49ac-872b-191218bd5eb9 service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Received unexpected event network-vif-plugged-61639246-9d84-4629-9666-154897feaeae for instance with vm_state resized and task_state resize_reverting.
Aug 26 23:22:40 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:42 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693092147.3460767, 2f46a6a8-a043-455a-98f8-dae359594f56 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:22:42 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] VM Stopped (Lifecycle Event)
Aug 26 23:22:42 user nova-compute[73497]: DEBUG nova.compute.manager [None req-2e3df696-dd6c-4f46-9325-abeb32b934ae None None] [instance: 2f46a6a8-a043-455a-98f8-dae359594f56] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:22:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4b6539c4-99e3-45d5-9657-1aa3d422aef9 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "b68b6975-a24a-4861-a583-406b02446ea0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4b6539c4-99e3-45d5-9657-1aa3d422aef9 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "b68b6975-a24a-4861-a583-406b02446ea0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4b6539c4-99e3-45d5-9657-1aa3d422aef9 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "b68b6975-a24a-4861-a583-406b02446ea0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4b6539c4-99e3-45d5-9657-1aa3d422aef9 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "b68b6975-a24a-4861-a583-406b02446ea0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4b6539c4-99e3-45d5-9657-1aa3d422aef9 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "b68b6975-a24a-4861-a583-406b02446ea0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:42 user nova-compute[73497]: INFO nova.compute.manager [None req-4b6539c4-99e3-45d5-9657-1aa3d422aef9 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Terminating instance
Aug 26 23:22:42 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4b6539c4-99e3-45d5-9657-1aa3d422aef9 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:22:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:42 user nova-compute[73497]: DEBUG nova.compute.manager [req-c8b773ae-c3ab-4253-9330-f4dbd6d9b8d5 req-9662db0c-9696-46cf-99dd-7a91cff6e8aa service nova] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Received event network-vif-unplugged-744f8df2-5712-4df4-a4e6-d7705b4d3cc7 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c8b773ae-c3ab-4253-9330-f4dbd6d9b8d5 req-9662db0c-9696-46cf-99dd-7a91cff6e8aa service nova] Acquiring lock "b68b6975-a24a-4861-a583-406b02446ea0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c8b773ae-c3ab-4253-9330-f4dbd6d9b8d5 req-9662db0c-9696-46cf-99dd-7a91cff6e8aa service nova] Lock "b68b6975-a24a-4861-a583-406b02446ea0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c8b773ae-c3ab-4253-9330-f4dbd6d9b8d5 req-9662db0c-9696-46cf-99dd-7a91cff6e8aa service nova] Lock "b68b6975-a24a-4861-a583-406b02446ea0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:42 user nova-compute[73497]: DEBUG nova.compute.manager [req-c8b773ae-c3ab-4253-9330-f4dbd6d9b8d5 req-9662db0c-9696-46cf-99dd-7a91cff6e8aa service nova] [instance: b68b6975-a24a-4861-a583-406b02446ea0] No waiting events found dispatching network-vif-unplugged-744f8df2-5712-4df4-a4e6-d7705b4d3cc7 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:42 user nova-compute[73497]: DEBUG nova.compute.manager [req-c8b773ae-c3ab-4253-9330-f4dbd6d9b8d5 req-9662db0c-9696-46cf-99dd-7a91cff6e8aa service nova] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Received event network-vif-unplugged-744f8df2-5712-4df4-a4e6-d7705b4d3cc7 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:22:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:43 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Instance destroyed successfully.
Aug 26 23:22:43 user nova-compute[73497]: DEBUG nova.objects.instance [None req-4b6539c4-99e3-45d5-9657-1aa3d422aef9 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lazy-loading 'resources' on Instance uuid b68b6975-a24a-4861-a583-406b02446ea0 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:22:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-4b6539c4-99e3-45d5-9657-1aa3d422aef9 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T23:16:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-625758251',display_name='tempest-ServerActionsTestOtherA-server-1293034491',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-625758251',id=15,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmg/g6/JqH0YLHZCpkD8rdnvMd23HQeTLvjge/Sh0DkE/Wj5zHdvAQ5fV67GK4vLmc3pz0PLw+2ofNRJAaMibeeNwiocztzy0e4AyExGxeymNeWH40DsExDFkx2358gAQ==',key_name='tempest-keypair-2050586917',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:19:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80c212cbb083450ea15ec54a96f12510',ramdisk_id='',reservation_id='r-3tzokivj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-81910947',owner_user_name='tempest-ServerActionsTestOtherA-81910947-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:19:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='935b8635557949cfba9b6528b97da95f',uuid=b68b6975-a24a-4861-a583-406b02446ea0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "744f8df2-5712-4df4-a4e6-d7705b4d3cc7", "address": "fa:16:3e:03:fd:29", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744f8df2-57", "ovs_interfaceid": "744f8df2-5712-4df4-a4e6-d7705b4d3cc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:22:43 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-4b6539c4-99e3-45d5-9657-1aa3d422aef9 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Converting VIF {"id": "744f8df2-5712-4df4-a4e6-d7705b4d3cc7", "address": "fa:16:3e:03:fd:29", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744f8df2-57", "ovs_interfaceid": "744f8df2-5712-4df4-a4e6-d7705b4d3cc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:22:43 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-4b6539c4-99e3-45d5-9657-1aa3d422aef9 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:fd:29,bridge_name='br-int',has_traffic_filtering=True,id=744f8df2-5712-4df4-a4e6-d7705b4d3cc7,network=Network(bf99a38a-faaf-4f1e-a161-736ce9089919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744f8df2-57') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:22:43 user nova-compute[73497]: DEBUG os_vif [None req-4b6539c4-99e3-45d5-9657-1aa3d422aef9 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:fd:29,bridge_name='br-int',has_traffic_filtering=True,id=744f8df2-5712-4df4-a4e6-d7705b4d3cc7,network=Network(bf99a38a-faaf-4f1e-a161-736ce9089919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744f8df2-57') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:22:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap744f8df2-57, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:22:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:43 user nova-compute[73497]: INFO os_vif [None req-4b6539c4-99e3-45d5-9657-1aa3d422aef9 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:fd:29,bridge_name='br-int',has_traffic_filtering=True,id=744f8df2-5712-4df4-a4e6-d7705b4d3cc7,network=Network(bf99a38a-faaf-4f1e-a161-736ce9089919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744f8df2-57')
Aug 26 23:22:43 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-4b6539c4-99e3-45d5-9657-1aa3d422aef9 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Deleting instance files /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0_del
Aug 26 23:22:43 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-4b6539c4-99e3-45d5-9657-1aa3d422aef9 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Deletion of /opt/stack/data/nova/instances/b68b6975-a24a-4861-a583-406b02446ea0_del complete
Aug 26 23:22:43 user nova-compute[73497]: INFO nova.compute.manager [None req-4b6539c4-99e3-45d5-9657-1aa3d422aef9 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 26 23:22:43 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-4b6539c4-99e3-45d5-9657-1aa3d422aef9 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:22:43 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:22:43 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: b68b6975-a24a-4861-a583-406b02446ea0] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:22:44 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:22:44 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Took 1.04 seconds to deallocate network for instance.
Aug 26 23:22:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4b6539c4-99e3-45d5-9657-1aa3d422aef9 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4b6539c4-99e3-45d5-9657-1aa3d422aef9 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:44 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-4b6539c4-99e3-45d5-9657-1aa3d422aef9 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:22:44 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-4b6539c4-99e3-45d5-9657-1aa3d422aef9 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:22:44 user nova-compute[73497]: DEBUG nova.compute.manager [req-1a09f3f3-08e4-426b-b2c5-00ed60f637e7 req-b36c21d8-d4e5-433f-ab29-166122379621 service nova] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Received event network-vif-plugged-744f8df2-5712-4df4-a4e6-d7705b4d3cc7 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1a09f3f3-08e4-426b-b2c5-00ed60f637e7 req-b36c21d8-d4e5-433f-ab29-166122379621 service nova] Acquiring lock "b68b6975-a24a-4861-a583-406b02446ea0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1a09f3f3-08e4-426b-b2c5-00ed60f637e7 req-b36c21d8-d4e5-433f-ab29-166122379621 service nova] Lock "b68b6975-a24a-4861-a583-406b02446ea0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1a09f3f3-08e4-426b-b2c5-00ed60f637e7 req-b36c21d8-d4e5-433f-ab29-166122379621 service nova] Lock "b68b6975-a24a-4861-a583-406b02446ea0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:44 user nova-compute[73497]: DEBUG nova.compute.manager [req-1a09f3f3-08e4-426b-b2c5-00ed60f637e7 req-b36c21d8-d4e5-433f-ab29-166122379621 service nova] [instance: b68b6975-a24a-4861-a583-406b02446ea0] No waiting events found dispatching network-vif-plugged-744f8df2-5712-4df4-a4e6-d7705b4d3cc7 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:22:44 user nova-compute[73497]: WARNING nova.compute.manager [req-1a09f3f3-08e4-426b-b2c5-00ed60f637e7 req-b36c21d8-d4e5-433f-ab29-166122379621 service nova] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Received unexpected event network-vif-plugged-744f8df2-5712-4df4-a4e6-d7705b4d3cc7 for instance with vm_state deleted and task_state None.
Aug 26 23:22:44 user nova-compute[73497]: DEBUG nova.compute.manager [req-1a09f3f3-08e4-426b-b2c5-00ed60f637e7 req-b36c21d8-d4e5-433f-ab29-166122379621 service nova] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Received event network-vif-deleted-744f8df2-5712-4df4-a4e6-d7705b4d3cc7 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:22:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4b6539c4-99e3-45d5-9657-1aa3d422aef9 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:44 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-4b6539c4-99e3-45d5-9657-1aa3d422aef9 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Deleted allocations for instance b68b6975-a24a-4861-a583-406b02446ea0
Aug 26 23:22:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4b6539c4-99e3-45d5-9657-1aa3d422aef9 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "b68b6975-a24a-4861-a583-406b02446ea0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.465s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:47 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693092152.471702, bde0a05a-a075-4298-907e-cb00798c90af => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:22:47 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: bde0a05a-a075-4298-907e-cb00798c90af] VM Stopped (Lifecycle Event)
Aug 26 23:22:47 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e9a3f9ca-d521-4954-b4df-c578288aa86b None None] [instance: bde0a05a-a075-4298-907e-cb00798c90af] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:22:48 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:51 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:22:51 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:22:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:52 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:22:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:54 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:22:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:22:54 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:22:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:56 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:22:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:22:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:22:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:22:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:22:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdj (vdc) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:22:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:58 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693092163.3267713, b68b6975-a24a-4861-a583-406b02446ea0 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:22:58 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: b68b6975-a24a-4861-a583-406b02446ea0] VM Stopped (Lifecycle Event)
Aug 26 23:22:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:22:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:58 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:22:58 user nova-compute[73497]: DEBUG nova.compute.manager [None req-fa2c997c-63ee-43a6-81df-2f0cd7b4c163 None None] [instance: b68b6975-a24a-4861-a583-406b02446ea0] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:22:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:22:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:22:59 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:22:59 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:22:59 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=7039MB free_disk=24.99895477294922GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:22:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:22:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:22:59 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 994093f0-e6b2-4c96-b259-c559ef2b1fbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:22:59 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 171985a3-358d-4b26-a66c-372b9b99b386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:22:59 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance aebaeda6-23d1-43a1-afc8-bdc8992067e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:22:59 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance ff1085db-4bfc-4c77-a9e4-39f47ffb6d43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:22:59 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 7c124dd9-4dce-4c6f-925c-6eda8e187d84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:22:59 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 4c68f140-4235-4dcb-b99d-1347bc949d15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:22:59 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 043294e5-0618-4a31-bb19-1227ef1f5d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:22:59 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance e9e5c83f-0678-48d4-a81f-1a3f959aabcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:22:59 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance ee6283d5-40de-432d-997c-0be52ff673ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:22:59 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance a6c7669c-f338-4e2b-9ba7-96d8e66d10ed actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:22:59 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance c601f97e-9e52-40c6-9085-45f38e709721 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:22:59 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:22:59 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:22:59 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:23:00 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:23:00 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:23:00 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:23:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.569s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:23:01 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:23:01 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:23:01 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:23:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-aebaeda6-23d1-43a1-afc8-bdc8992067e5" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:23:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-aebaeda6-23d1-43a1-afc8-bdc8992067e5" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:23:01 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:23:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:23:02 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Updating instance_info_cache with network_info: [{"id": "2fdb126c-c800-488a-9879-08a65e646325", "address": "fa:16:3e:e0:28:c4", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fdb126c-c8", "ovs_interfaceid": "2fdb126c-c800-488a-9879-08a65e646325", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:23:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-aebaeda6-23d1-43a1-afc8-bdc8992067e5" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:23:02 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:23:02 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:23:02 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:23:02 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:23:02 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:23:02 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:23:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:23:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:23:08 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:23:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:23:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:23:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:23:22 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e8d18f2d-8b42-4379-9410-2c5cda525457 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:23:22 user nova-compute[73497]: INFO nova.compute.manager [None req-e8d18f2d-8b42-4379-9410-2c5cda525457 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] instance snapshotting
Aug 26 23:23:22 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-e8d18f2d-8b42-4379-9410-2c5cda525457 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Beginning live snapshot process
Aug 26 23:23:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e8d18f2d-8b42-4379-9410-2c5cda525457 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json -f qcow2 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9275805e-1eac-4bee-8c65-e083c2fa1fa9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "ff1085db-4bfc-4c77-a9e4-39f47ffb6d43" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9275805e-1eac-4bee-8c65-e083c2fa1fa9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "ff1085db-4bfc-4c77-a9e4-39f47ffb6d43" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:23:23 user nova-compute[73497]: INFO nova.compute.manager [None req-9275805e-1eac-4bee-8c65-e083c2fa1fa9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Detaching volume 917dc081-eb80-4c05-ac91-9e6dd93718eb
Aug 26 23:23:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e8d18f2d-8b42-4379-9410-2c5cda525457 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json -f qcow2" returned: 0 in 0.189s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e8d18f2d-8b42-4379-9410-2c5cda525457 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json -f qcow2 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:23 user nova-compute[73497]: INFO nova.virt.block_device [None req-9275805e-1eac-4bee-8c65-e083c2fa1fa9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Attempting to driver detach volume 917dc081-eb80-4c05-ac91-9e6dd93718eb from mountpoint /dev/vdb
Aug 26 23:23:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9275805e-1eac-4bee-8c65-e083c2fa1fa9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Attempting to detach device vdb from instance ff1085db-4bfc-4c77-a9e4-39f47ffb6d43 from the persistent domain config. {{(pid=73497) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-9275805e-1eac-4bee-8c65-e083c2fa1fa9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:23:23 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:23:23 user nova-compute[73497]:   <source dev="/dev/sde"/>
Aug 26 23:23:23 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:23:23 user nova-compute[73497]:   <serial>917dc081-eb80-4c05-ac91-9e6dd93718eb</serial>
Aug 26 23:23:23 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:23:23 user nova-compute[73497]: </disk>
Aug 26 23:23:23 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:23:23 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-9275805e-1eac-4bee-8c65-e083c2fa1fa9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Successfully detached device vdb from instance ff1085db-4bfc-4c77-a9e4-39f47ffb6d43 from the persistent domain config.
Aug 26 23:23:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9275805e-1eac-4bee-8c65-e083c2fa1fa9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ff1085db-4bfc-4c77-a9e4-39f47ffb6d43 from the live domain config. {{(pid=73497) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-9275805e-1eac-4bee-8c65-e083c2fa1fa9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:23:23 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:23:23 user nova-compute[73497]:   <source dev="/dev/sde"/>
Aug 26 23:23:23 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:23:23 user nova-compute[73497]:   <serial>917dc081-eb80-4c05-ac91-9e6dd93718eb</serial>
Aug 26 23:23:23 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:23:23 user nova-compute[73497]: </disk>
Aug 26 23:23:23 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e8d18f2d-8b42-4379-9410-2c5cda525457 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e8d18f2d-8b42-4379-9410-2c5cda525457 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e8d18f2d-8b42-4379-9410-2c5cda525457 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.230s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e8d18f2d-8b42-4379-9410-2c5cda525457 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmprh6p_exu/a3b04c4d7de44a89a0fbfc038e74f8a4.delta 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e8d18f2d-8b42-4379-9410-2c5cda525457 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmprh6p_exu/a3b04c4d7de44a89a0fbfc038e74f8a4.delta 1073741824" returned: 0 in 0.057s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:23 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-e8d18f2d-8b42-4379-9410-2c5cda525457 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 23:23:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Received event <DeviceRemovedEvent: 1693092203.7808952, ff1085db-4bfc-4c77-a9e4-39f47ffb6d43 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73497) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9275805e-1eac-4bee-8c65-e083c2fa1fa9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ff1085db-4bfc-4c77-a9e4-39f47ffb6d43 {{(pid=73497) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 23:23:23 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-9275805e-1eac-4bee-8c65-e083c2fa1fa9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Successfully detached device vdb from instance ff1085db-4bfc-4c77-a9e4-39f47ffb6d43 from the live domain config.
Aug 26 23:23:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9275805e-1eac-4bee-8c65-e083c2fa1fa9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9275805e-1eac-4bee-8c65-e083c2fa1fa9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AOzLgGKJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:23:23 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-9275805e-1eac-4bee-8c65-e083c2fa1fa9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:23:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-9275805e-1eac-4bee-8c65-e083c2fa1fa9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-9275805e-1eac-4bee-8c65-e083c2fa1fa9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9275805e-1eac-4bee-8c65-e083c2fa1fa9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1eafde-b902-4d90-a9d5-44fe21d2a89e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7828b71-5f57-452e-9930-f14ddca7c048]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9275805e-1eac-4bee-8c65-e083c2fa1fa9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:23:23 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:23:23 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:23:23 user nova-compute[73497]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)
Aug 26 23:23:23 user nova-compute[73497]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)
Aug 26 23:23:23 user nova-compute[73497]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)
Aug 26 23:23:23 user nova-compute[73497]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:23:23 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9275805e-1eac-4bee-8c65-e083c2fa1fa9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:23:23 user nova-compute[73497]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb (non-flash)
Aug 26 23:23:23 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:23:23 user nova-compute[73497]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)
Aug 26 23:23:23 user nova-compute[73497]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)
Aug 26 23:23:23 user nova-compute[73497]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)
Aug 26 23:23:23 user nova-compute[73497]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:23:23 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9275805e-1eac-4bee-8c65-e083c2fa1fa9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2839aa8430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb'): ({'sde'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-9275805e-1eac-4bee-8c65-e083c2fa1fa9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Removing single pathed devices sde {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f2f164-5fef-425a-9f00-b590c1223b21]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4db81f-37f4-47b7-ac73-df7f942db3fe]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-9275805e-1eac-4bee-8c65-e083c2fa1fa9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Flushing IO for device /dev/sde {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[df47e139-7776-40a7-b3fe-c0d13262e10f]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-9275805e-1eac-4bee-8c65-e083c2fa1fa9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93e65e4-b05e-4409-bac5-524f685fc034]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-9275805e-1eac-4bee-8c65-e083c2fa1fa9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-9275805e-1eac-4bee-8c65-e083c2fa1fa9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] SCSI volumes sde have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:23:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9275805e-1eac-4bee-8c65-e083c2fa1fa9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:23:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38414fc-0280-4892-9144-ac059b154aae]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:23:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9275805e-1eac-4bee-8c65-e083c2fa1fa9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:23:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb11973-27af-438b-8f32-e58208e01e7b]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:23:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9275805e-1eac-4bee-8c65-e083c2fa1fa9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb, portal: 172.16.0.220,3260]
Aug 26 23:23:24 user nova-compute[73497]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb, portal: 172.16.0.220,3260] successful.
Aug 26 23:23:24 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:23:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:917dc081-eb80-4c05-ac91-9e6dd93718eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3418b306-6696-4f1f-82c0-a6ae6d0eb19f]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:23:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9275805e-1eac-4bee-8c65-e083c2fa1fa9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:23:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-9275805e-1eac-4bee-8c65-e083c2fa1fa9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:23:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9275805e-1eac-4bee-8c65-e083c2fa1fa9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] <== disconnect_volume: return (357ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:23:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9275805e-1eac-4bee-8c65-e083c2fa1fa9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:23:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-e8d18f2d-8b42-4379-9410-2c5cda525457 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73497) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 23:23:25 user nova-compute[73497]: DEBUG nova.objects.instance [None req-9275805e-1eac-4bee-8c65-e083c2fa1fa9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lazy-loading 'flavor' on Instance uuid ff1085db-4bfc-4c77-a9e4-39f47ffb6d43 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:23:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-e8d18f2d-8b42-4379-9410-2c5cda525457 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73497) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 23:23:25 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-e8d18f2d-8b42-4379-9410-2c5cda525457 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 23:23:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9275805e-1eac-4bee-8c65-e083c2fa1fa9 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "ff1085db-4bfc-4c77-a9e4-39f47ffb6d43" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.880s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:23:25 user nova-compute[73497]: DEBUG nova.privsep.utils [None req-e8d18f2d-8b42-4379-9410-2c5cda525457 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73497) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 23:23:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e8d18f2d-8b42-4379-9410-2c5cda525457 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmprh6p_exu/a3b04c4d7de44a89a0fbfc038e74f8a4.delta /opt/stack/data/nova/instances/snapshots/tmprh6p_exu/a3b04c4d7de44a89a0fbfc038e74f8a4 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e8d18f2d-8b42-4379-9410-2c5cda525457 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmprh6p_exu/a3b04c4d7de44a89a0fbfc038e74f8a4.delta /opt/stack/data/nova/instances/snapshots/tmprh6p_exu/a3b04c4d7de44a89a0fbfc038e74f8a4" returned: 0 in 0.681s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:25 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-e8d18f2d-8b42-4379-9410-2c5cda525457 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Snapshot extracted, beginning image upload
Aug 26 23:23:25 user nova-compute[73497]: DEBUG nova.compute.manager [req-6d506ded-b660-4415-b9a3-fa1fde123747 req-fd75ee84-4c2b-462f-a340-09f49e5d0550 service nova] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Received event network-changed-efa7322e-6cca-40b1-9667-83d76383e165 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:23:25 user nova-compute[73497]: DEBUG nova.compute.manager [req-6d506ded-b660-4415-b9a3-fa1fde123747 req-fd75ee84-4c2b-462f-a340-09f49e5d0550 service nova] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Refreshing instance network info cache due to event network-changed-efa7322e-6cca-40b1-9667-83d76383e165. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:23:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6d506ded-b660-4415-b9a3-fa1fde123747 req-fd75ee84-4c2b-462f-a340-09f49e5d0550 service nova] Acquiring lock "refresh_cache-244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:23:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6d506ded-b660-4415-b9a3-fa1fde123747 req-fd75ee84-4c2b-462f-a340-09f49e5d0550 service nova] Acquired lock "refresh_cache-244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:23:25 user nova-compute[73497]: DEBUG nova.network.neutron [req-6d506ded-b660-4415-b9a3-fa1fde123747 req-fd75ee84-4c2b-462f-a340-09f49e5d0550 service nova] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Refreshing network info cache for port efa7322e-6cca-40b1-9667-83d76383e165 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:23:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Acquiring lock "244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:23:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:23:26 user nova-compute[73497]: DEBUG nova.objects.instance [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lazy-loading 'flavor' on Instance uuid 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:23:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:23:26 user nova-compute[73497]: DEBUG nova.network.neutron [req-6d506ded-b660-4415-b9a3-fa1fde123747 req-fd75ee84-4c2b-462f-a340-09f49e5d0550 service nova] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Updated VIF entry in instance network info cache for port efa7322e-6cca-40b1-9667-83d76383e165. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:23:26 user nova-compute[73497]: DEBUG nova.network.neutron [req-6d506ded-b660-4415-b9a3-fa1fde123747 req-fd75ee84-4c2b-462f-a340-09f49e5d0550 service nova] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Updating instance_info_cache with network_info: [{"id": "efa7322e-6cca-40b1-9667-83d76383e165", "address": "fa:16:3e:e4:78:43", "network": {"id": "e5209dd2-0f09-4bab-b0a6-b486792104a3", "bridge": "br-int", "label": "tempest-TestStampPattern-819945601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a539515b1f47d39d42e182bef80e63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa7322e-6c", "ovs_interfaceid": "efa7322e-6cca-40b1-9667-83d76383e165", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:23:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6d506ded-b660-4415-b9a3-fa1fde123747 req-fd75ee84-4c2b-462f-a340-09f49e5d0550 service nova] Releasing lock "refresh_cache-244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:23:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Acquiring lock "244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:23:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:23:26 user nova-compute[73497]: INFO nova.compute.manager [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Attaching volume c228623a-0565-45dc-9306-8ad9b191c3b8 to /dev/vdb
Aug 26 23:23:26 user nova-compute[73497]: DEBUG os_brick.utils [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:23:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3442092-eeb7-4b6a-ad7b-0d75bedace71]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:23:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bf0bad-a69c-4946-a9d3-48d6bf6a9242]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:23:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c553bf7a-7a96-40c9-a5a0-65a40c9122ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:23:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d964f75-59e8-4942-b5e3-daa8c979d60f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:23:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:23:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:23:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:23:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:23:26 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:23:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a3f178-cfb5-4ee8-8d01-c10f338ab8e9]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:23:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:23:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:23:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:23:26 user nova-compute[73497]: DEBUG os_brick.utils [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:23:26 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Updating existing volume attachment record: e9a2338d-3d29-434c-826b-7b4cdbf7a245 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:23:28 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-e8d18f2d-8b42-4379-9410-2c5cda525457 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Snapshot image upload complete
Aug 26 23:23:28 user nova-compute[73497]: INFO nova.compute.manager [None req-e8d18f2d-8b42-4379-9410-2c5cda525457 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Took 5.56 seconds to snapshot the instance on the hypervisor.
Aug 26 23:23:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:23:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:23:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:23:35 user nova-compute[73497]: INFO nova.compute.manager [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Rescuing
Aug 26 23:23:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "refresh_cache-043294e5-0618-4a31-bb19-1227ef1f5d39" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:23:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquired lock "refresh_cache-043294e5-0618-4a31-bb19-1227ef1f5d39" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:23:35 user nova-compute[73497]: DEBUG nova.network.neutron [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:23:35 user nova-compute[73497]: DEBUG nova.network.neutron [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Updating instance_info_cache with network_info: [{"id": "de273950-9851-448e-8ca2-ac699c12994e", "address": "fa:16:3e:fe:2b:69", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde273950-98", "ovs_interfaceid": "de273950-9851-448e-8ca2-ac699c12994e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:23:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Releasing lock "refresh_cache-043294e5-0618-4a31-bb19-1227ef1f5d39" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:23:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:23:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:23:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:23:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:23:36 user nova-compute[73497]: DEBUG nova.compute.manager [req-ce824a51-6dca-4de1-a61c-f343d92509d5 req-992dbaa5-b55d-4013-bf7d-2df05b3c415d service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Received event network-vif-unplugged-de273950-9851-448e-8ca2-ac699c12994e {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:23:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ce824a51-6dca-4de1-a61c-f343d92509d5 req-992dbaa5-b55d-4013-bf7d-2df05b3c415d service nova] Acquiring lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:23:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ce824a51-6dca-4de1-a61c-f343d92509d5 req-992dbaa5-b55d-4013-bf7d-2df05b3c415d service nova] Lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:23:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ce824a51-6dca-4de1-a61c-f343d92509d5 req-992dbaa5-b55d-4013-bf7d-2df05b3c415d service nova] Lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:23:36 user nova-compute[73497]: DEBUG nova.compute.manager [req-ce824a51-6dca-4de1-a61c-f343d92509d5 req-992dbaa5-b55d-4013-bf7d-2df05b3c415d service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] No waiting events found dispatching network-vif-unplugged-de273950-9851-448e-8ca2-ac699c12994e {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:23:36 user nova-compute[73497]: WARNING nova.compute.manager [req-ce824a51-6dca-4de1-a61c-f343d92509d5 req-992dbaa5-b55d-4013-bf7d-2df05b3c415d service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Received unexpected event network-vif-unplugged-de273950-9851-448e-8ca2-ac699c12994e for instance with vm_state active and task_state rescuing.
Aug 26 23:23:36 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Instance destroyed successfully.
Aug 26 23:23:36 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Attempting rescue
Aug 26 23:23:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73497) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 23:23:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Instance directory exists: not creating {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 23:23:36 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Creating image(s)
Aug 26 23:23:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "/opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:23:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "/opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:23:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "/opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:23:36 user nova-compute[73497]: DEBUG nova.objects.instance [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lazy-loading 'trusted_certs' on Instance uuid 043294e5-0618-4a31-bb19-1227ef1f5d39 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:23:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:23:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:23:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:23:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.193s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk.rescue {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk.rescue" returned: 0 in 0.052s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:23:36 user nova-compute[73497]: DEBUG nova.objects.instance [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lazy-loading 'migration_context' on Instance uuid 043294e5-0618-4a31-bb19-1227ef1f5d39 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:23:36 user nova-compute[73497]: DEBUG nova.objects.base [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Object Instance<043294e5-0618-4a31-bb19-1227ef1f5d39> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:23:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:23:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Start _get_guest_xml network_info=[{"id": "de273950-9851-448e-8ca2-ac699c12994e", "address": "fa:16:3e:fe:2b:69", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "vif_mac": "fa:16:3e:fe:2b:69"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde273950-98", "ovs_interfaceid": "de273950-9851-448e-8ca2-ac699c12994e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:23:37 user nova-compute[73497]: DEBUG nova.objects.instance [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lazy-loading 'resources' on Instance uuid 043294e5-0618-4a31-bb19-1227ef1f5d39 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:23:37 user nova-compute[73497]: DEBUG nova.objects.base [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Object Instance<043294e5-0618-4a31-bb19-1227ef1f5d39> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:23:37 user nova-compute[73497]: DEBUG nova.objects.instance [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lazy-loading 'numa_topology' on Instance uuid 043294e5-0618-4a31-bb19-1227ef1f5d39 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:23:37 user nova-compute[73497]: DEBUG nova.objects.base [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Object Instance<043294e5-0618-4a31-bb19-1227ef1f5d39> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:23:37 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:23:37 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:23:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:23:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:23:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:23:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:23:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:23:37 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:23:37 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:23:37 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:23:37 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:23:37 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:23:37 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:23:37 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:23:37 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:23:37 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:23:37 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:23:37 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:23:37 user nova-compute[73497]: DEBUG nova.objects.instance [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lazy-loading 'vcpu_model' on Instance uuid 043294e5-0618-4a31-bb19-1227ef1f5d39 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:23:37 user nova-compute[73497]: DEBUG nova.objects.base [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Object Instance<043294e5-0618-4a31-bb19-1227ef1f5d39> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:23:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:18:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1111344785',display_name='tempest-ServerRescueNegativeTestJSON-server-1111344785',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1111344785',id=19,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:18:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c4ca787dd33440d98779668507369ee',ramdisk_id='',reservation_id='r-mq6jhfdi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1946187856',owner_user_name='tempest-ServerRescueNegativeTestJSON-1946187856-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:18:57Z,user_data=None,user_id='af64aa253eec41a0976c3e527fe41831',uuid=043294e5-0618-4a31-bb19-1227ef1f5d39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de273950-9851-448e-8ca2-ac699c12994e", "address": "fa:16:3e:fe:2b:69", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "vif_mac": "fa:16:3e:fe:2b:69"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde273950-98", "ovs_interfaceid": "de273950-9851-448e-8ca2-ac699c12994e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:23:37 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Converting VIF {"id": "de273950-9851-448e-8ca2-ac699c12994e", "address": "fa:16:3e:fe:2b:69", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "vif_mac": "fa:16:3e:fe:2b:69"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde273950-98", "ovs_interfaceid": "de273950-9851-448e-8ca2-ac699c12994e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:23:37 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:2b:69,bridge_name='br-int',has_traffic_filtering=True,id=de273950-9851-448e-8ca2-ac699c12994e,network=Network(6f13f07f-104d-4d8d-b5fa-afa402402a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde273950-98') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:23:37 user nova-compute[73497]: DEBUG nova.objects.instance [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lazy-loading 'pci_devices' on Instance uuid 043294e5-0618-4a31-bb19-1227ef1f5d39 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:23:37 user nova-compute[73497]: DEBUG nova.objects.base [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Object Instance<043294e5-0618-4a31-bb19-1227ef1f5d39> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:23:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:23:37 user nova-compute[73497]:   <uuid>043294e5-0618-4a31-bb19-1227ef1f5d39</uuid>
Aug 26 23:23:37 user nova-compute[73497]:   <name>instance-00000013</name>
Aug 26 23:23:37 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:23:37 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:23:37 user nova-compute[73497]:   <metadata>
Aug 26 23:23:37 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:23:37 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:23:37 user nova-compute[73497]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1111344785</nova:name>
Aug 26 23:23:37 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:23:37</nova:creationTime>
Aug 26 23:23:37 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:23:37 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:23:37 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:23:37 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:23:37 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:23:37 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:23:37 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:23:37 user nova-compute[73497]:       <nova:owner>
Aug 26 23:23:37 user nova-compute[73497]:         <nova:user uuid="af64aa253eec41a0976c3e527fe41831">tempest-ServerRescueNegativeTestJSON-1946187856-project-member</nova:user>
Aug 26 23:23:37 user nova-compute[73497]:         <nova:project uuid="0c4ca787dd33440d98779668507369ee">tempest-ServerRescueNegativeTestJSON-1946187856</nova:project>
Aug 26 23:23:37 user nova-compute[73497]:       </nova:owner>
Aug 26 23:23:37 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:23:37 user nova-compute[73497]:       <nova:ports>
Aug 26 23:23:37 user nova-compute[73497]:         <nova:port uuid="de273950-9851-448e-8ca2-ac699c12994e">
Aug 26 23:23:37 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 23:23:37 user nova-compute[73497]:         </nova:port>
Aug 26 23:23:37 user nova-compute[73497]:       </nova:ports>
Aug 26 23:23:37 user nova-compute[73497]:     </nova:instance>
Aug 26 23:23:37 user nova-compute[73497]:   </metadata>
Aug 26 23:23:37 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:23:37 user nova-compute[73497]:     <system>
Aug 26 23:23:37 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:23:37 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:23:37 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:23:37 user nova-compute[73497]:       <entry name="serial">043294e5-0618-4a31-bb19-1227ef1f5d39</entry>
Aug 26 23:23:37 user nova-compute[73497]:       <entry name="uuid">043294e5-0618-4a31-bb19-1227ef1f5d39</entry>
Aug 26 23:23:37 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:23:37 user nova-compute[73497]:     </system>
Aug 26 23:23:37 user nova-compute[73497]:   </sysinfo>
Aug 26 23:23:37 user nova-compute[73497]:   <os>
Aug 26 23:23:37 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:23:37 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:23:37 user nova-compute[73497]:   </os>
Aug 26 23:23:37 user nova-compute[73497]:   <features>
Aug 26 23:23:37 user nova-compute[73497]:     <acpi/>
Aug 26 23:23:37 user nova-compute[73497]:     <apic/>
Aug 26 23:23:37 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:23:37 user nova-compute[73497]:   </features>
Aug 26 23:23:37 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:23:37 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:23:37 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:23:37 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:23:37 user nova-compute[73497]:   </clock>
Aug 26 23:23:37 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:23:37 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:23:37 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:23:37 user nova-compute[73497]:   </cpu>
Aug 26 23:23:37 user nova-compute[73497]:   <devices>
Aug 26 23:23:37 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:23:37 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:23:37 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk.rescue"/>
Aug 26 23:23:37 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:23:37 user nova-compute[73497]:     </disk>
Aug 26 23:23:37 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:23:37 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:23:37 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk"/>
Aug 26 23:23:37 user nova-compute[73497]:       <target dev="vdb" bus="virtio"/>
Aug 26 23:23:37 user nova-compute[73497]:     </disk>
Aug 26 23:23:37 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:23:37 user nova-compute[73497]:       <mac address="fa:16:3e:fe:2b:69"/>
Aug 26 23:23:37 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:23:37 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:23:37 user nova-compute[73497]:       <target dev="tapde273950-98"/>
Aug 26 23:23:37 user nova-compute[73497]:     </interface>
Aug 26 23:23:37 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:23:37 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/console.log" append="off"/>
Aug 26 23:23:37 user nova-compute[73497]:     </serial>
Aug 26 23:23:37 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:23:37 user nova-compute[73497]:     <video>
Aug 26 23:23:37 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:23:37 user nova-compute[73497]:     </video>
Aug 26 23:23:37 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:23:37 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:23:37 user nova-compute[73497]:     </rng>
Aug 26 23:23:37 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:23:37 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:23:37 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:23:37 user nova-compute[73497]:     </memballoon>
Aug 26 23:23:37 user nova-compute[73497]:   </devices>
Aug 26 23:23:37 user nova-compute[73497]: </domain>
Aug 26 23:23:37 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:23:37 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Instance destroyed successfully.
Aug 26 23:23:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:23:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:23:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] No VIF found with MAC fa:16:3e:fe:2b:69, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:23:38 user nova-compute[73497]: DEBUG nova.compute.manager [req-cb63a8ef-fb3e-44a7-85bd-ebb95aab50e4 req-688623c9-8e3c-46ea-8ef3-c26f3d3dc6f8 service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Received event network-vif-plugged-de273950-9851-448e-8ca2-ac699c12994e {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:23:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cb63a8ef-fb3e-44a7-85bd-ebb95aab50e4 req-688623c9-8e3c-46ea-8ef3-c26f3d3dc6f8 service nova] Acquiring lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:23:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cb63a8ef-fb3e-44a7-85bd-ebb95aab50e4 req-688623c9-8e3c-46ea-8ef3-c26f3d3dc6f8 service nova] Lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:23:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cb63a8ef-fb3e-44a7-85bd-ebb95aab50e4 req-688623c9-8e3c-46ea-8ef3-c26f3d3dc6f8 service nova] Lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:23:38 user nova-compute[73497]: DEBUG nova.compute.manager [req-cb63a8ef-fb3e-44a7-85bd-ebb95aab50e4 req-688623c9-8e3c-46ea-8ef3-c26f3d3dc6f8 service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] No waiting events found dispatching network-vif-plugged-de273950-9851-448e-8ca2-ac699c12994e {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:23:38 user nova-compute[73497]: WARNING nova.compute.manager [req-cb63a8ef-fb3e-44a7-85bd-ebb95aab50e4 req-688623c9-8e3c-46ea-8ef3-c26f3d3dc6f8 service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Received unexpected event network-vif-plugged-de273950-9851-448e-8ca2-ac699c12994e for instance with vm_state active and task_state rescuing.
Aug 26 23:23:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:23:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:23:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:23:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:23:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:23:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:23:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MxYQyRCX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:23:39 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:23:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:23:39 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:23:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:23:39 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:23:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cf4ae5-ef63-4b8a-8e22-f39d81e12058]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:23:39 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba4a6a7-ac88-4193-a3f4-19d0e06a02da]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8] added
Aug 26 23:23:39 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee715a7-0052-4edb-ac98-c5041f5ff06d]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce652a56-8109-467e-8cea-311122dcba77]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MxYQyRCX {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MxYQyRCX" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8133dc7a-3dce-4bb6-954f-ecbefdc2e2ca]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MxYQyRCX'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dbf9be-9309-4b4b-a15c-b23c4750a9e1]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d656e50c-7fc6-4b45-a0c6-66ca54c4f1ce]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:23:39 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:23:39 user nova-compute[73497]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)
Aug 26 23:23:39 user nova-compute[73497]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)
Aug 26 23:23:39 user nova-compute[73497]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)
Aug 26 23:23:39 user nova-compute[73497]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:23:39 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:23:39 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:23:39 user nova-compute[73497]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)
Aug 26 23:23:39 user nova-compute[73497]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)
Aug 26 23:23:39 user nova-compute[73497]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)
Aug 26 23:23:39 user nova-compute[73497]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:23:39 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6faa01b6-a6c1-40ff-a089-77fc969a4bcc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8, portal: 172.16.0.220,3260]
Aug 26 23:23:39 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8, portal: 172.16.0.220,3260] successful.
Aug 26 23:23:39 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f212595a-9836-4c4b-9539-ec2dfede9a5c]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1285b2-a15b-487a-97a0-74e79c3db74b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:23:39 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:23:39 user nova-compute[73497]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)
Aug 26 23:23:39 user nova-compute[73497]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)
Aug 26 23:23:39 user nova-compute[73497]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)
Aug 26 23:23:39 user nova-compute[73497]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:23:39 user nova-compute[73497]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8 (non-flash)
Aug 26 23:23:39 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:23:39 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:23:39 user nova-compute[73497]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)
Aug 26 23:23:39 user nova-compute[73497]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)
Aug 26 23:23:39 user nova-compute[73497]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)
Aug 26 23:23:39 user nova-compute[73497]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:23:39 user nova-compute[73497]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8 (non-flash)
Aug 26 23:23:39 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7449f7f2-97e9-4c0e-8ef4-ddefe51029d9]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:23:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MxYQyRCX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:23:40 user nova-compute[73497]: DEBUG nova.compute.manager [req-78cca940-e1ee-4ae3-9377-3114c316c766 req-cfa3fcd8-4b67-48fb-8880-78688477454a service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Received event network-vif-plugged-de273950-9851-448e-8ca2-ac699c12994e {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:23:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-78cca940-e1ee-4ae3-9377-3114c316c766 req-cfa3fcd8-4b67-48fb-8880-78688477454a service nova] Acquiring lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:23:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-78cca940-e1ee-4ae3-9377-3114c316c766 req-cfa3fcd8-4b67-48fb-8880-78688477454a service nova] Lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:23:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-78cca940-e1ee-4ae3-9377-3114c316c766 req-cfa3fcd8-4b67-48fb-8880-78688477454a service nova] Lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:23:40 user nova-compute[73497]: DEBUG nova.compute.manager [req-78cca940-e1ee-4ae3-9377-3114c316c766 req-cfa3fcd8-4b67-48fb-8880-78688477454a service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] No waiting events found dispatching network-vif-plugged-de273950-9851-448e-8ca2-ac699c12994e {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:23:40 user nova-compute[73497]: WARNING nova.compute.manager [req-78cca940-e1ee-4ae3-9377-3114c316c766 req-cfa3fcd8-4b67-48fb-8880-78688477454a service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Received unexpected event network-vif-plugged-de273950-9851-448e-8ca2-ac699c12994e for instance with vm_state active and task_state rescuing.
Aug 26 23:23:40 user nova-compute[73497]: DEBUG nova.compute.manager [req-78cca940-e1ee-4ae3-9377-3114c316c766 req-cfa3fcd8-4b67-48fb-8880-78688477454a service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Received event network-vif-plugged-de273950-9851-448e-8ca2-ac699c12994e {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:23:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-78cca940-e1ee-4ae3-9377-3114c316c766 req-cfa3fcd8-4b67-48fb-8880-78688477454a service nova] Acquiring lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:23:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-78cca940-e1ee-4ae3-9377-3114c316c766 req-cfa3fcd8-4b67-48fb-8880-78688477454a service nova] Lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:23:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-78cca940-e1ee-4ae3-9377-3114c316c766 req-cfa3fcd8-4b67-48fb-8880-78688477454a service nova] Lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:23:40 user nova-compute[73497]: DEBUG nova.compute.manager [req-78cca940-e1ee-4ae3-9377-3114c316c766 req-cfa3fcd8-4b67-48fb-8880-78688477454a service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] No waiting events found dispatching network-vif-plugged-de273950-9851-448e-8ca2-ac699c12994e {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:23:40 user nova-compute[73497]: WARNING nova.compute.manager [req-78cca940-e1ee-4ae3-9377-3114c316c766 req-cfa3fcd8-4b67-48fb-8880-78688477454a service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Received unexpected event network-vif-plugged-de273950-9851-448e-8ca2-ac699c12994e for instance with vm_state active and task_state rescuing.
Aug 26 23:23:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:23:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23634623963313461', 'path': '/dev/sde'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:23:40 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634623963313461', 'path': '/dev/sde'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:23:40 user nova-compute[73497]: DEBUG nova.objects.instance [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lazy-loading 'flavor' on Instance uuid 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:23:40 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 23:23:40 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:23:40 user nova-compute[73497]:   <source dev="/dev/sde"/>
Aug 26 23:23:40 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:23:40 user nova-compute[73497]:   <serial>c228623a-0565-45dc-9306-8ad9b191c3b8</serial>
Aug 26 23:23:40 user nova-compute[73497]: </disk>
Aug 26 23:23:40 user nova-compute[73497]:  {{(pid=73497) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 23:23:40 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Removed pending event for 043294e5-0618-4a31-bb19-1227ef1f5d39 due to event {{(pid=73497) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 23:23:40 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092220.787672, 043294e5-0618-4a31-bb19-1227ef1f5d39 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:23:40 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] VM Resumed (Lifecycle Event)
Aug 26 23:23:40 user nova-compute[73497]: DEBUG nova.compute.manager [None req-8485b6f4-fd59-4e17-8935-b40e42370546 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:23:40 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:23:40 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:23:40 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 23:23:40 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092220.7893536, 043294e5-0618-4a31-bb19-1227ef1f5d39 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:23:40 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] VM Started (Lifecycle Event)
Aug 26 23:23:40 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:23:40 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:23:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:23:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:23:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] No VIF found with MAC fa:16:3e:e4:78:43, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:23:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3ca79977-59b0-4389-bef7-2e69a7c3ddd5 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.732s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:23:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:23:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-7b243218-4749-49f4-bbfe-96cf4609fc02 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Acquiring lock "244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:23:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-7b243218-4749-49f4-bbfe-96cf4609fc02 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:23:42 user nova-compute[73497]: INFO nova.compute.manager [None req-7b243218-4749-49f4-bbfe-96cf4609fc02 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Detaching volume c228623a-0565-45dc-9306-8ad9b191c3b8
Aug 26 23:23:42 user nova-compute[73497]: INFO nova.virt.block_device [None req-7b243218-4749-49f4-bbfe-96cf4609fc02 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Attempting to driver detach volume c228623a-0565-45dc-9306-8ad9b191c3b8 from mountpoint /dev/vdb
Aug 26 23:23:42 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7b243218-4749-49f4-bbfe-96cf4609fc02 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Attempting to detach device vdb from instance 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35 from the persistent domain config. {{(pid=73497) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 23:23:42 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-7b243218-4749-49f4-bbfe-96cf4609fc02 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:23:42 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:23:42 user nova-compute[73497]:   <source dev="/dev/sde"/>
Aug 26 23:23:42 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:23:42 user nova-compute[73497]:   <serial>c228623a-0565-45dc-9306-8ad9b191c3b8</serial>
Aug 26 23:23:42 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:23:42 user nova-compute[73497]: </disk>
Aug 26 23:23:42 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:23:42 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-7b243218-4749-49f4-bbfe-96cf4609fc02 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Successfully detached device vdb from instance 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35 from the persistent domain config.
Aug 26 23:23:42 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7b243218-4749-49f4-bbfe-96cf4609fc02 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35 from the live domain config. {{(pid=73497) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 23:23:42 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-7b243218-4749-49f4-bbfe-96cf4609fc02 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:23:42 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:23:42 user nova-compute[73497]:   <source dev="/dev/sde"/>
Aug 26 23:23:42 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:23:42 user nova-compute[73497]:   <serial>c228623a-0565-45dc-9306-8ad9b191c3b8</serial>
Aug 26 23:23:42 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:23:42 user nova-compute[73497]: </disk>
Aug 26 23:23:42 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Received event <DeviceRemovedEvent: 1693092223.3669913, 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73497) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7b243218-4749-49f4-bbfe-96cf4609fc02 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35 {{(pid=73497) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 23:23:43 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-7b243218-4749-49f4-bbfe-96cf4609fc02 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Successfully detached device vdb from instance 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35 from the live domain config.
Aug 26 23:23:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b243218-4749-49f4-bbfe-96cf4609fc02 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b243218-4749-49f4-bbfe-96cf4609fc02 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MxYQyRCX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:23:43 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-7b243218-4749-49f4-bbfe-96cf4609fc02 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:23:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-7b243218-4749-49f4-bbfe-96cf4609fc02 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-7b243218-4749-49f4-bbfe-96cf4609fc02 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b243218-4749-49f4-bbfe-96cf4609fc02 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[06bcee3c-a666-475d-80b1-7accb380c70c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d269ed-95dd-46d1-a82f-5e4eb45f982d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b243218-4749-49f4-bbfe-96cf4609fc02 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:23:43 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:23:43 user nova-compute[73497]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)
Aug 26 23:23:43 user nova-compute[73497]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)
Aug 26 23:23:43 user nova-compute[73497]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)
Aug 26 23:23:43 user nova-compute[73497]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:23:43 user nova-compute[73497]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8 (non-flash)
Aug 26 23:23:43 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b243218-4749-49f4-bbfe-96cf4609fc02 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:23:43 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:23:43 user nova-compute[73497]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)
Aug 26 23:23:43 user nova-compute[73497]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)
Aug 26 23:23:43 user nova-compute[73497]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)
Aug 26 23:23:43 user nova-compute[73497]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:23:43 user nova-compute[73497]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8 (non-flash)
Aug 26 23:23:43 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b243218-4749-49f4-bbfe-96cf4609fc02 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2839aab400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8'): ({'sde'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-7b243218-4749-49f4-bbfe-96cf4609fc02 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Removing single pathed devices sde {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[633d59a0-ddf2-47b4-8317-ebe4d0600877]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a727099-1ed1-47c9-8059-2ab9a5dcd3da]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-7b243218-4749-49f4-bbfe-96cf4609fc02 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Flushing IO for device /dev/sde {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bda0275-53c2-454a-97e9-32a4e08a14b9]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-7b243218-4749-49f4-bbfe-96cf4609fc02 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.033s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[98187c98-de39-4173-ba1a-f0911ceb5778]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-7b243218-4749-49f4-bbfe-96cf4609fc02 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-7b243218-4749-49f4-bbfe-96cf4609fc02 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] SCSI volumes sde have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b243218-4749-49f4-bbfe-96cf4609fc02 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd00a855-8f41-41c0-b9db-b9d8ae4269ca]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b243218-4749-49f4-bbfe-96cf4609fc02 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[487b8b2a-ff67-4bb8-82c6-2df36cba09fd]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b243218-4749-49f4-bbfe-96cf4609fc02 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8, portal: 172.16.0.220,3260]
Aug 26 23:23:43 user nova-compute[73497]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8, portal: 172.16.0.220,3260] successful.
Aug 26 23:23:43 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c228623a-0565-45dc-9306-8ad9b191c3b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[322f4b58-16ec-4226-abf8-7708a5b126b9]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b243218-4749-49f4-bbfe-96cf4609fc02 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-7b243218-4749-49f4-bbfe-96cf4609fc02 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b243218-4749-49f4-bbfe-96cf4609fc02 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] <== disconnect_volume: return (310ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:23:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b243218-4749-49f4-bbfe-96cf4609fc02 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:23:44 user nova-compute[73497]: DEBUG nova.objects.instance [None req-7b243218-4749-49f4-bbfe-96cf4609fc02 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lazy-loading 'flavor' on Instance uuid 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:23:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-7b243218-4749-49f4-bbfe-96cf4609fc02 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.875s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:23:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:23:48 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:23:48 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Cleaning up deleted instances {{(pid=73497) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 23:23:48 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] There are 0 instances to clean {{(pid=73497) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 23:23:48 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:23:52 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:23:52 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:23:53 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:23:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:23:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:23:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:23:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:23:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:23:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:23:55 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:23:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:23:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:23:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:23:55 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:23:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:23:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:23:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:58 user nova-compute[73497]: DEBUG nova.compute.manager [req-cdb53e11-f056-4194-a348-552cc0e5822a req-5cd58e40-f65f-4a1d-b6ba-234ac2a860f6 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-changed-d114632c-d651-4419-9f82-ecaa90cd381b {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:23:58 user nova-compute[73497]: DEBUG nova.compute.manager [req-cdb53e11-f056-4194-a348-552cc0e5822a req-5cd58e40-f65f-4a1d-b6ba-234ac2a860f6 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Refreshing instance network info cache due to event network-changed-d114632c-d651-4419-9f82-ecaa90cd381b. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:23:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cdb53e11-f056-4194-a348-552cc0e5822a req-5cd58e40-f65f-4a1d-b6ba-234ac2a860f6 service nova] Acquiring lock "refresh_cache-a6c7669c-f338-4e2b-9ba7-96d8e66d10ed" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:23:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cdb53e11-f056-4194-a348-552cc0e5822a req-5cd58e40-f65f-4a1d-b6ba-234ac2a860f6 service nova] Acquired lock "refresh_cache-a6c7669c-f338-4e2b-9ba7-96d8e66d10ed" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:23:58 user nova-compute[73497]: DEBUG nova.network.neutron [req-cdb53e11-f056-4194-a348-552cc0e5822a req-5cd58e40-f65f-4a1d-b6ba-234ac2a860f6 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Refreshing network info cache for port d114632c-d651-4419-9f82-ecaa90cd381b {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:23:58 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:23:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:23:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:58 user nova-compute[73497]: DEBUG nova.network.neutron [req-cdb53e11-f056-4194-a348-552cc0e5822a req-5cd58e40-f65f-4a1d-b6ba-234ac2a860f6 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Updated VIF entry in instance network info cache for port d114632c-d651-4419-9f82-ecaa90cd381b. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:23:58 user nova-compute[73497]: DEBUG nova.network.neutron [req-cdb53e11-f056-4194-a348-552cc0e5822a req-5cd58e40-f65f-4a1d-b6ba-234ac2a860f6 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Updating instance_info_cache with network_info: [{"id": "d114632c-d651-4419-9f82-ecaa90cd381b", "address": "fa:16:3e:7a:e8:f3", "network": {"id": "d6df8ba3-c833-4cf3-8865-2e449087bead", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-54509536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd114632c-d6", "ovs_interfaceid": "d114632c-d651-4419-9f82-ecaa90cd381b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c268fbf7-6a36-44b5-8361-42160a69b1d4", "address": "fa:16:3e:e6:16:95", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc268fbf7-6a", "ovs_interfaceid": "c268fbf7-6a36-44b5-8361-42160a69b1d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "372fa1fa-b52b-479a-b228-91eebb1d3e3f", "address": "fa:16:3e:b0:c0:5e", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372fa1fa-b5", "ovs_interfaceid": "372fa1fa-b52b-479a-b228-91eebb1d3e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7c81f6a7-92b5-496b-867f-c10965da8e40", "address": "fa:16:3e:8e:33:9e", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c81f6a7-92", "ovs_interfaceid": "7c81f6a7-92b5-496b-867f-c10965da8e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "792a72cb-3624-45eb-a8f7-01cf52196f2d", "address": "fa:16:3e:73:4e:ac", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap792a72cb-36", "ovs_interfaceid": "792a72cb-3624-45eb-a8f7-01cf52196f2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "35958938-f4c5-4745-99ca-0f0761fd801c", "address": "fa:16:3e:d2:d0:65", "network": {"id": "15044bd5-0863-41a2-ad57-abbdad59baa3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1012445693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35958938-f4", "ovs_interfaceid": "35958938-f4c5-4745-99ca-0f0761fd801c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6361122d-0a82-4b1d-8ea5-dedb8984f15f", "address": "fa:16:3e:e1:fa:e3", "network": {"id": "15044bd5-0863-41a2-ad57-abbdad59baa3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1012445693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6361122d-0a", "ovs_interfaceid": "6361122d-0a82-4b1d-8ea5-dedb8984f15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:23:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cdb53e11-f056-4194-a348-552cc0e5822a req-5cd58e40-f65f-4a1d-b6ba-234ac2a860f6 service nova] Releasing lock "refresh_cache-a6c7669c-f338-4e2b-9ba7-96d8e66d10ed" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:23:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:59 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:23:59 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:23:59 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdj (vdc) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:23:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:23:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:23:59 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:23:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:01 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:24:01 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:24:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=6994MB free_disk=24.936851501464844GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Acquiring lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Acquiring lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:01 user nova-compute[73497]: INFO nova.compute.manager [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Terminating instance
Aug 26 23:24:01 user nova-compute[73497]: DEBUG nova.compute.manager [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 994093f0-e6b2-4c96-b259-c559ef2b1fbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 171985a3-358d-4b26-a66c-372b9b99b386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance aebaeda6-23d1-43a1-afc8-bdc8992067e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance ff1085db-4bfc-4c77-a9e4-39f47ffb6d43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 7c124dd9-4dce-4c6f-925c-6eda8e187d84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 4c68f140-4235-4dcb-b99d-1347bc949d15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 043294e5-0618-4a31-bb19-1227ef1f5d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance e9e5c83f-0678-48d4-a81f-1a3f959aabcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance ee6283d5-40de-432d-997c-0be52ff673ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance a6c7669c-f338-4e2b-9ba7-96d8e66d10ed actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance c601f97e-9e52-40c6-9085-45f38e709721 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG nova.compute.manager [req-63e7339c-4c51-4451-a837-fc366e8548f8 req-04b52dff-fe91-49f8-bbd5-499ce07bb630 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-unplugged-d114632c-d651-4419-9f82-ecaa90cd381b {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-63e7339c-4c51-4451-a837-fc366e8548f8 req-04b52dff-fe91-49f8-bbd5-499ce07bb630 service nova] Acquiring lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-63e7339c-4c51-4451-a837-fc366e8548f8 req-04b52dff-fe91-49f8-bbd5-499ce07bb630 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-63e7339c-4c51-4451-a837-fc366e8548f8 req-04b52dff-fe91-49f8-bbd5-499ce07bb630 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG nova.compute.manager [req-63e7339c-4c51-4451-a837-fc366e8548f8 req-04b52dff-fe91-49f8-bbd5-499ce07bb630 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] No waiting events found dispatching network-vif-unplugged-d114632c-d651-4419-9f82-ecaa90cd381b {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG nova.compute.manager [req-63e7339c-4c51-4451-a837-fc366e8548f8 req-04b52dff-fe91-49f8-bbd5-499ce07bb630 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-unplugged-d114632c-d651-4419-9f82-ecaa90cd381b for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG nova.compute.manager [req-c5cd8349-4440-4133-9bda-ad76b8baf57c req-5b81ecfb-03b3-40f0-af59-2f24a1b58700 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-unplugged-372fa1fa-b52b-479a-b228-91eebb1d3e3f {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c5cd8349-4440-4133-9bda-ad76b8baf57c req-5b81ecfb-03b3-40f0-af59-2f24a1b58700 service nova] Acquiring lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c5cd8349-4440-4133-9bda-ad76b8baf57c req-5b81ecfb-03b3-40f0-af59-2f24a1b58700 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c5cd8349-4440-4133-9bda-ad76b8baf57c req-5b81ecfb-03b3-40f0-af59-2f24a1b58700 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG nova.compute.manager [req-c5cd8349-4440-4133-9bda-ad76b8baf57c req-5b81ecfb-03b3-40f0-af59-2f24a1b58700 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] No waiting events found dispatching network-vif-unplugged-372fa1fa-b52b-479a-b228-91eebb1d3e3f {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG nova.compute.manager [req-c5cd8349-4440-4133-9bda-ad76b8baf57c req-5b81ecfb-03b3-40f0-af59-2f24a1b58700 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-unplugged-372fa1fa-b52b-479a-b228-91eebb1d3e3f for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.752s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Cleaning up deleted instances with incomplete migration  {{(pid=73497) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 23:24:01 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:24:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:02 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Instance destroyed successfully.
Aug 26 23:24:02 user nova-compute[73497]: DEBUG nova.objects.instance [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Lazy-loading 'resources' on Instance uuid a6c7669c-f338-4e2b-9ba7-96d8e66d10ed {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-205430132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-205430132',id=23,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZTGKDD5+6wKJv+qSBFC2QIq1zbuNCSkVKeLhNBhJmlu5Tah1mZHQVv045hmJBRsSlpvrVR8wYUYQpC1V8NdW/9+lYWvh37hJtGt3UxBAVXoF3/oiPeqjEaPUP5fVxK9g==',key_name='tempest-keypair-1216137119',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:22:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aff3ec8f2aad4d71b65787eabb90dd6c',ramdisk_id='',reservation_id='r-x06xli4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-661216102',owner_user_name='tempest-TaggedBootDevicesTest_v242-661216102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:22:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30c55eba7b184a4cbf56d776ae544721',uuid=a6c7669c-f338-4e2b-9ba7-96d8e66d10ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d114632c-d651-4419-9f82-ecaa90cd381b", "address": "fa:16:3e:7a:e8:f3", "network": {"id": "d6df8ba3-c833-4cf3-8865-2e449087bead", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-54509536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd114632c-d6", "ovs_interfaceid": "d114632c-d651-4419-9f82-ecaa90cd381b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converting VIF {"id": "d114632c-d651-4419-9f82-ecaa90cd381b", "address": "fa:16:3e:7a:e8:f3", "network": {"id": "d6df8ba3-c833-4cf3-8865-2e449087bead", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-54509536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd114632c-d6", "ovs_interfaceid": "d114632c-d651-4419-9f82-ecaa90cd381b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:e8:f3,bridge_name='br-int',has_traffic_filtering=True,id=d114632c-d651-4419-9f82-ecaa90cd381b,network=Network(d6df8ba3-c833-4cf3-8865-2e449087bead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd114632c-d6') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG os_vif [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:e8:f3,bridge_name='br-int',has_traffic_filtering=True,id=d114632c-d651-4419-9f82-ecaa90cd381b,network=Network(d6df8ba3-c833-4cf3-8865-2e449087bead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd114632c-d6') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd114632c-d6, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:03 user nova-compute[73497]: INFO os_vif [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:e8:f3,bridge_name='br-int',has_traffic_filtering=True,id=d114632c-d651-4419-9f82-ecaa90cd381b,network=Network(d6df8ba3-c833-4cf3-8865-2e449087bead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd114632c-d6')
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-205430132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-205430132',id=23,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZTGKDD5+6wKJv+qSBFC2QIq1zbuNCSkVKeLhNBhJmlu5Tah1mZHQVv045hmJBRsSlpvrVR8wYUYQpC1V8NdW/9+lYWvh37hJtGt3UxBAVXoF3/oiPeqjEaPUP5fVxK9g==',key_name='tempest-keypair-1216137119',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:22:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aff3ec8f2aad4d71b65787eabb90dd6c',ramdisk_id='',reservation_id='r-x06xli4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-661216102',owner_user_name='tempest-TaggedBootDevicesTest_v242-661216102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:22:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30c55eba7b184a4cbf56d776ae544721',uuid=a6c7669c-f338-4e2b-9ba7-96d8e66d10ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c268fbf7-6a36-44b5-8361-42160a69b1d4", "address": "fa:16:3e:e6:16:95", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc268fbf7-6a", "ovs_interfaceid": "c268fbf7-6a36-44b5-8361-42160a69b1d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converting VIF {"id": "c268fbf7-6a36-44b5-8361-42160a69b1d4", "address": "fa:16:3e:e6:16:95", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc268fbf7-6a", "ovs_interfaceid": "c268fbf7-6a36-44b5-8361-42160a69b1d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:16:95,bridge_name='br-int',has_traffic_filtering=True,id=c268fbf7-6a36-44b5-8361-42160a69b1d4,network=Network(1f830eee-2d57-4294-89d6-010b5322c6ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc268fbf7-6a') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG os_vif [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:16:95,bridge_name='br-int',has_traffic_filtering=True,id=c268fbf7-6a36-44b5-8361-42160a69b1d4,network=Network(1f830eee-2d57-4294-89d6-010b5322c6ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc268fbf7-6a') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc268fbf7-6a, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:03 user nova-compute[73497]: INFO os_vif [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:16:95,bridge_name='br-int',has_traffic_filtering=True,id=c268fbf7-6a36-44b5-8361-42160a69b1d4,network=Network(1f830eee-2d57-4294-89d6-010b5322c6ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc268fbf7-6a')
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-205430132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-205430132',id=23,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZTGKDD5+6wKJv+qSBFC2QIq1zbuNCSkVKeLhNBhJmlu5Tah1mZHQVv045hmJBRsSlpvrVR8wYUYQpC1V8NdW/9+lYWvh37hJtGt3UxBAVXoF3/oiPeqjEaPUP5fVxK9g==',key_name='tempest-keypair-1216137119',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:22:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aff3ec8f2aad4d71b65787eabb90dd6c',ramdisk_id='',reservation_id='r-x06xli4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-661216102',owner_user_name='tempest-TaggedBootDevicesTest_v242-661216102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:22:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30c55eba7b184a4cbf56d776ae544721',uuid=a6c7669c-f338-4e2b-9ba7-96d8e66d10ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "372fa1fa-b52b-479a-b228-91eebb1d3e3f", "address": "fa:16:3e:b0:c0:5e", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372fa1fa-b5", "ovs_interfaceid": "372fa1fa-b52b-479a-b228-91eebb1d3e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converting VIF {"id": "372fa1fa-b52b-479a-b228-91eebb1d3e3f", "address": "fa:16:3e:b0:c0:5e", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372fa1fa-b5", "ovs_interfaceid": "372fa1fa-b52b-479a-b228-91eebb1d3e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:c0:5e,bridge_name='br-int',has_traffic_filtering=True,id=372fa1fa-b52b-479a-b228-91eebb1d3e3f,network=Network(1f830eee-2d57-4294-89d6-010b5322c6ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap372fa1fa-b5') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG os_vif [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:c0:5e,bridge_name='br-int',has_traffic_filtering=True,id=372fa1fa-b52b-479a-b228-91eebb1d3e3f,network=Network(1f830eee-2d57-4294-89d6-010b5322c6ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap372fa1fa-b5') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap372fa1fa-b5, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:03 user nova-compute[73497]: INFO os_vif [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:c0:5e,bridge_name='br-int',has_traffic_filtering=True,id=372fa1fa-b52b-479a-b228-91eebb1d3e3f,network=Network(1f830eee-2d57-4294-89d6-010b5322c6ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap372fa1fa-b5')
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-205430132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-205430132',id=23,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZTGKDD5+6wKJv+qSBFC2QIq1zbuNCSkVKeLhNBhJmlu5Tah1mZHQVv045hmJBRsSlpvrVR8wYUYQpC1V8NdW/9+lYWvh37hJtGt3UxBAVXoF3/oiPeqjEaPUP5fVxK9g==',key_name='tempest-keypair-1216137119',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:22:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aff3ec8f2aad4d71b65787eabb90dd6c',ramdisk_id='',reservation_id='r-x06xli4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-661216102',owner_user_name='tempest-TaggedBootDevicesTest_v242-661216102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:22:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30c55eba7b184a4cbf56d776ae544721',uuid=a6c7669c-f338-4e2b-9ba7-96d8e66d10ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c81f6a7-92b5-496b-867f-c10965da8e40", "address": "fa:16:3e:8e:33:9e", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c81f6a7-92", "ovs_interfaceid": "7c81f6a7-92b5-496b-867f-c10965da8e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converting VIF {"id": "7c81f6a7-92b5-496b-867f-c10965da8e40", "address": "fa:16:3e:8e:33:9e", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c81f6a7-92", "ovs_interfaceid": "7c81f6a7-92b5-496b-867f-c10965da8e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:33:9e,bridge_name='br-int',has_traffic_filtering=True,id=7c81f6a7-92b5-496b-867f-c10965da8e40,network=Network(1f830eee-2d57-4294-89d6-010b5322c6ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c81f6a7-92') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG os_vif [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:33:9e,bridge_name='br-int',has_traffic_filtering=True,id=7c81f6a7-92b5-496b-867f-c10965da8e40,network=Network(1f830eee-2d57-4294-89d6-010b5322c6ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c81f6a7-92') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c81f6a7-92, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:03 user nova-compute[73497]: INFO os_vif [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:33:9e,bridge_name='br-int',has_traffic_filtering=True,id=7c81f6a7-92b5-496b-867f-c10965da8e40,network=Network(1f830eee-2d57-4294-89d6-010b5322c6ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c81f6a7-92')
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-205430132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-205430132',id=23,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZTGKDD5+6wKJv+qSBFC2QIq1zbuNCSkVKeLhNBhJmlu5Tah1mZHQVv045hmJBRsSlpvrVR8wYUYQpC1V8NdW/9+lYWvh37hJtGt3UxBAVXoF3/oiPeqjEaPUP5fVxK9g==',key_name='tempest-keypair-1216137119',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:22:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aff3ec8f2aad4d71b65787eabb90dd6c',ramdisk_id='',reservation_id='r-x06xli4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-661216102',owner_user_name='tempest-TaggedBootDevicesTest_v242-661216102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:22:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30c55eba7b184a4cbf56d776ae544721',uuid=a6c7669c-f338-4e2b-9ba7-96d8e66d10ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "792a72cb-3624-45eb-a8f7-01cf52196f2d", "address": "fa:16:3e:73:4e:ac", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap792a72cb-36", "ovs_interfaceid": "792a72cb-3624-45eb-a8f7-01cf52196f2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converting VIF {"id": "792a72cb-3624-45eb-a8f7-01cf52196f2d", "address": "fa:16:3e:73:4e:ac", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap792a72cb-36", "ovs_interfaceid": "792a72cb-3624-45eb-a8f7-01cf52196f2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:4e:ac,bridge_name='br-int',has_traffic_filtering=True,id=792a72cb-3624-45eb-a8f7-01cf52196f2d,network=Network(1f830eee-2d57-4294-89d6-010b5322c6ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap792a72cb-36') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG os_vif [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:4e:ac,bridge_name='br-int',has_traffic_filtering=True,id=792a72cb-3624-45eb-a8f7-01cf52196f2d,network=Network(1f830eee-2d57-4294-89d6-010b5322c6ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap792a72cb-36') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap792a72cb-36, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:03 user nova-compute[73497]: INFO os_vif [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:4e:ac,bridge_name='br-int',has_traffic_filtering=True,id=792a72cb-3624-45eb-a8f7-01cf52196f2d,network=Network(1f830eee-2d57-4294-89d6-010b5322c6ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap792a72cb-36')
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-205430132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-205430132',id=23,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZTGKDD5+6wKJv+qSBFC2QIq1zbuNCSkVKeLhNBhJmlu5Tah1mZHQVv045hmJBRsSlpvrVR8wYUYQpC1V8NdW/9+lYWvh37hJtGt3UxBAVXoF3/oiPeqjEaPUP5fVxK9g==',key_name='tempest-keypair-1216137119',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:22:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aff3ec8f2aad4d71b65787eabb90dd6c',ramdisk_id='',reservation_id='r-x06xli4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-661216102',owner_user_name='tempest-TaggedBootDevicesTest_v242-661216102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:22:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30c55eba7b184a4cbf56d776ae544721',uuid=a6c7669c-f338-4e2b-9ba7-96d8e66d10ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35958938-f4c5-4745-99ca-0f0761fd801c", "address": "fa:16:3e:d2:d0:65", "network": {"id": "15044bd5-0863-41a2-ad57-abbdad59baa3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1012445693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35958938-f4", "ovs_interfaceid": "35958938-f4c5-4745-99ca-0f0761fd801c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converting VIF {"id": "35958938-f4c5-4745-99ca-0f0761fd801c", "address": "fa:16:3e:d2:d0:65", "network": {"id": "15044bd5-0863-41a2-ad57-abbdad59baa3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1012445693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35958938-f4", "ovs_interfaceid": "35958938-f4c5-4745-99ca-0f0761fd801c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:d0:65,bridge_name='br-int',has_traffic_filtering=True,id=35958938-f4c5-4745-99ca-0f0761fd801c,network=Network(15044bd5-0863-41a2-ad57-abbdad59baa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35958938-f4') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG os_vif [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:d0:65,bridge_name='br-int',has_traffic_filtering=True,id=35958938-f4c5-4745-99ca-0f0761fd801c,network=Network(15044bd5-0863-41a2-ad57-abbdad59baa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35958938-f4') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35958938-f4, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:03 user nova-compute[73497]: INFO os_vif [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:d0:65,bridge_name='br-int',has_traffic_filtering=True,id=35958938-f4c5-4745-99ca-0f0761fd801c,network=Network(15044bd5-0863-41a2-ad57-abbdad59baa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35958938-f4')
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T23:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-205430132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-205430132',id=23,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZTGKDD5+6wKJv+qSBFC2QIq1zbuNCSkVKeLhNBhJmlu5Tah1mZHQVv045hmJBRsSlpvrVR8wYUYQpC1V8NdW/9+lYWvh37hJtGt3UxBAVXoF3/oiPeqjEaPUP5fVxK9g==',key_name='tempest-keypair-1216137119',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:22:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aff3ec8f2aad4d71b65787eabb90dd6c',ramdisk_id='',reservation_id='r-x06xli4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-661216102',owner_user_name='tempest-TaggedBootDevicesTest_v242-661216102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:22:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30c55eba7b184a4cbf56d776ae544721',uuid=a6c7669c-f338-4e2b-9ba7-96d8e66d10ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6361122d-0a82-4b1d-8ea5-dedb8984f15f", "address": "fa:16:3e:e1:fa:e3", "network": {"id": "15044bd5-0863-41a2-ad57-abbdad59baa3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1012445693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6361122d-0a", "ovs_interfaceid": "6361122d-0a82-4b1d-8ea5-dedb8984f15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converting VIF {"id": "6361122d-0a82-4b1d-8ea5-dedb8984f15f", "address": "fa:16:3e:e1:fa:e3", "network": {"id": "15044bd5-0863-41a2-ad57-abbdad59baa3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1012445693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6361122d-0a", "ovs_interfaceid": "6361122d-0a82-4b1d-8ea5-dedb8984f15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:fa:e3,bridge_name='br-int',has_traffic_filtering=True,id=6361122d-0a82-4b1d-8ea5-dedb8984f15f,network=Network(15044bd5-0863-41a2-ad57-abbdad59baa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6361122d-0a') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG os_vif [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:fa:e3,bridge_name='br-int',has_traffic_filtering=True,id=6361122d-0a82-4b1d-8ea5-dedb8984f15f,network=Network(15044bd5-0863-41a2-ad57-abbdad59baa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6361122d-0a') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6361122d-0a, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:24:03 user nova-compute[73497]: INFO os_vif [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:fa:e3,bridge_name='br-int',has_traffic_filtering=True,id=6361122d-0a82-4b1d-8ea5-dedb8984f15f,network=Network(15044bd5-0863-41a2-ad57-abbdad59baa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6361122d-0a')
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OUhoGXVR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:24:03 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:24:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0452b4a-60b8-4591-b14d-d162739a0738]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5de3e8-ce9b-48c4-90bf-70a5e58e613f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:24:03 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:24:03 user nova-compute[73497]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)
Aug 26 23:24:03 user nova-compute[73497]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)
Aug 26 23:24:03 user nova-compute[73497]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)
Aug 26 23:24:03 user nova-compute[73497]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:24:03 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:24:03 user nova-compute[73497]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 (non-flash)
Aug 26 23:24:03 user nova-compute[73497]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)
Aug 26 23:24:03 user nova-compute[73497]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)
Aug 26 23:24:03 user nova-compute[73497]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)
Aug 26 23:24:03 user nova-compute[73497]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:24:03 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281c35f2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912'): ({'sdb'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Removing single pathed devices sdb {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc68bb2-9763-43e7-bb67-238d6a38c28a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[002bb913-9bfb-40ca-90b8-d9fadfb1cf8b]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Flushing IO for device /dev/sdb {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bed97f-8b31-49ed-b9ad-92c2b85f448e]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5dee3d-51d6-418c-9251-c9edbb4c7a0e]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1ec4c4-4bac-4ae0-a15f-83e253b9ee8d]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f2afb9-1c5a-47cf-8ada-21bf5cd26717]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912, portal: 172.16.0.220,3260]
Aug 26 23:24:03 user nova-compute[73497]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912, portal: 172.16.0.220,3260] successful.
Aug 26 23:24:03 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a291925-0e24-48cd-bb57-40dc15ac7912 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4220a5-6e7c-4ba1-9bb7-c15c88d98e94]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] <== disconnect_volume: return (337ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pBxNojUM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:24:03 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:24:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1830029f-0d65-4927-b85d-c219467e0e85]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[121a5df5-b396-4144-bf95-291cde1f061c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:24:03 user nova-compute[73497]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)
Aug 26 23:24:03 user nova-compute[73497]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)
Aug 26 23:24:03 user nova-compute[73497]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)
Aug 26 23:24:03 user nova-compute[73497]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:24:03 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:24:03 user nova-compute[73497]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 (non-flash)
Aug 26 23:24:03 user nova-compute[73497]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)
Aug 26 23:24:03 user nova-compute[73497]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)
Aug 26 23:24:03 user nova-compute[73497]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:24:03 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281c35f2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3'): ({'sdi'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Removing single pathed devices sdi {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-plugged-d114632c-d651-4419-9f82-ecaa90cd381b {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] Acquiring lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] No waiting events found dispatching network-vif-plugged-d114632c-d651-4419-9f82-ecaa90cd381b {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:24:03 user nova-compute[73497]: WARNING nova.compute.manager [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received unexpected event network-vif-plugged-d114632c-d651-4419-9f82-ecaa90cd381b for instance with vm_state active and task_state deleting.
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-unplugged-c268fbf7-6a36-44b5-8361-42160a69b1d4 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] Acquiring lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] No waiting events found dispatching network-vif-unplugged-c268fbf7-6a36-44b5-8361-42160a69b1d4 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-unplugged-c268fbf7-6a36-44b5-8361-42160a69b1d4 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-plugged-c268fbf7-6a36-44b5-8361-42160a69b1d4 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] Acquiring lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] No waiting events found dispatching network-vif-plugged-c268fbf7-6a36-44b5-8361-42160a69b1d4 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:24:03 user nova-compute[73497]: WARNING nova.compute.manager [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received unexpected event network-vif-plugged-c268fbf7-6a36-44b5-8361-42160a69b1d4 for instance with vm_state active and task_state deleting.
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-unplugged-792a72cb-3624-45eb-a8f7-01cf52196f2d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] Acquiring lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] No waiting events found dispatching network-vif-unplugged-792a72cb-3624-45eb-a8f7-01cf52196f2d {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-unplugged-792a72cb-3624-45eb-a8f7-01cf52196f2d for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-plugged-792a72cb-3624-45eb-a8f7-01cf52196f2d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] Acquiring lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] No waiting events found dispatching network-vif-plugged-792a72cb-3624-45eb-a8f7-01cf52196f2d {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:24:03 user nova-compute[73497]: WARNING nova.compute.manager [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received unexpected event network-vif-plugged-792a72cb-3624-45eb-a8f7-01cf52196f2d for instance with vm_state active and task_state deleting.
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-unplugged-6361122d-0a82-4b1d-8ea5-dedb8984f15f {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] Acquiring lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] No waiting events found dispatching network-vif-unplugged-6361122d-0a82-4b1d-8ea5-dedb8984f15f {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-unplugged-6361122d-0a82-4b1d-8ea5-dedb8984f15f for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-plugged-6361122d-0a82-4b1d-8ea5-dedb8984f15f {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] Acquiring lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] No waiting events found dispatching network-vif-plugged-6361122d-0a82-4b1d-8ea5-dedb8984f15f {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:24:03 user nova-compute[73497]: WARNING nova.compute.manager [req-8651612a-05dd-427a-b588-2f56b09ed747 req-2204934a-5b03-4a45-851a-702328f60c80 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received unexpected event network-vif-plugged-6361122d-0a82-4b1d-8ea5-dedb8984f15f for instance with vm_state active and task_state deleting.
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3886a1eb-1bab-44ee-aceb-9d747ce4c57e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-44288bcd-5421-4dd8-a859-f219abb35c9e req-de5adb94-95ac-4d74-926e-4f671281e3b1 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-plugged-372fa1fa-b52b-479a-b228-91eebb1d3e3f {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-44288bcd-5421-4dd8-a859-f219abb35c9e req-de5adb94-95ac-4d74-926e-4f671281e3b1 service nova] Acquiring lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-44288bcd-5421-4dd8-a859-f219abb35c9e req-de5adb94-95ac-4d74-926e-4f671281e3b1 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-44288bcd-5421-4dd8-a859-f219abb35c9e req-de5adb94-95ac-4d74-926e-4f671281e3b1 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-44288bcd-5421-4dd8-a859-f219abb35c9e req-de5adb94-95ac-4d74-926e-4f671281e3b1 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] No waiting events found dispatching network-vif-plugged-372fa1fa-b52b-479a-b228-91eebb1d3e3f {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:24:03 user nova-compute[73497]: WARNING nova.compute.manager [req-44288bcd-5421-4dd8-a859-f219abb35c9e req-de5adb94-95ac-4d74-926e-4f671281e3b1 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received unexpected event network-vif-plugged-372fa1fa-b52b-479a-b228-91eebb1d3e3f for instance with vm_state active and task_state deleting.
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-44288bcd-5421-4dd8-a859-f219abb35c9e req-de5adb94-95ac-4d74-926e-4f671281e3b1 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-unplugged-7c81f6a7-92b5-496b-867f-c10965da8e40 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-44288bcd-5421-4dd8-a859-f219abb35c9e req-de5adb94-95ac-4d74-926e-4f671281e3b1 service nova] Acquiring lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-44288bcd-5421-4dd8-a859-f219abb35c9e req-de5adb94-95ac-4d74-926e-4f671281e3b1 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-44288bcd-5421-4dd8-a859-f219abb35c9e req-de5adb94-95ac-4d74-926e-4f671281e3b1 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-44288bcd-5421-4dd8-a859-f219abb35c9e req-de5adb94-95ac-4d74-926e-4f671281e3b1 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] No waiting events found dispatching network-vif-unplugged-7c81f6a7-92b5-496b-867f-c10965da8e40 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-44288bcd-5421-4dd8-a859-f219abb35c9e req-de5adb94-95ac-4d74-926e-4f671281e3b1 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-unplugged-7c81f6a7-92b5-496b-867f-c10965da8e40 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-44288bcd-5421-4dd8-a859-f219abb35c9e req-de5adb94-95ac-4d74-926e-4f671281e3b1 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-plugged-7c81f6a7-92b5-496b-867f-c10965da8e40 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-44288bcd-5421-4dd8-a859-f219abb35c9e req-de5adb94-95ac-4d74-926e-4f671281e3b1 service nova] Acquiring lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-44288bcd-5421-4dd8-a859-f219abb35c9e req-de5adb94-95ac-4d74-926e-4f671281e3b1 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-44288bcd-5421-4dd8-a859-f219abb35c9e req-de5adb94-95ac-4d74-926e-4f671281e3b1 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-44288bcd-5421-4dd8-a859-f219abb35c9e req-de5adb94-95ac-4d74-926e-4f671281e3b1 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] No waiting events found dispatching network-vif-plugged-7c81f6a7-92b5-496b-867f-c10965da8e40 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:24:03 user nova-compute[73497]: WARNING nova.compute.manager [req-44288bcd-5421-4dd8-a859-f219abb35c9e req-de5adb94-95ac-4d74-926e-4f671281e3b1 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received unexpected event network-vif-plugged-7c81f6a7-92b5-496b-867f-c10965da8e40 for instance with vm_state active and task_state deleting.
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-44288bcd-5421-4dd8-a859-f219abb35c9e req-de5adb94-95ac-4d74-926e-4f671281e3b1 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-unplugged-35958938-f4c5-4745-99ca-0f0761fd801c {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-44288bcd-5421-4dd8-a859-f219abb35c9e req-de5adb94-95ac-4d74-926e-4f671281e3b1 service nova] Acquiring lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-44288bcd-5421-4dd8-a859-f219abb35c9e req-de5adb94-95ac-4d74-926e-4f671281e3b1 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-44288bcd-5421-4dd8-a859-f219abb35c9e req-de5adb94-95ac-4d74-926e-4f671281e3b1 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-44288bcd-5421-4dd8-a859-f219abb35c9e req-de5adb94-95ac-4d74-926e-4f671281e3b1 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] No waiting events found dispatching network-vif-unplugged-35958938-f4c5-4745-99ca-0f0761fd801c {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-44288bcd-5421-4dd8-a859-f219abb35c9e req-de5adb94-95ac-4d74-926e-4f671281e3b1 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-unplugged-35958938-f4c5-4745-99ca-0f0761fd801c for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-44288bcd-5421-4dd8-a859-f219abb35c9e req-de5adb94-95ac-4d74-926e-4f671281e3b1 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-plugged-35958938-f4c5-4745-99ca-0f0761fd801c {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-44288bcd-5421-4dd8-a859-f219abb35c9e req-de5adb94-95ac-4d74-926e-4f671281e3b1 service nova] Acquiring lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-44288bcd-5421-4dd8-a859-f219abb35c9e req-de5adb94-95ac-4d74-926e-4f671281e3b1 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-44288bcd-5421-4dd8-a859-f219abb35c9e req-de5adb94-95ac-4d74-926e-4f671281e3b1 service nova] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-44288bcd-5421-4dd8-a859-f219abb35c9e req-de5adb94-95ac-4d74-926e-4f671281e3b1 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] No waiting events found dispatching network-vif-plugged-35958938-f4c5-4745-99ca-0f0761fd801c {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:24:03 user nova-compute[73497]: WARNING nova.compute.manager [req-44288bcd-5421-4dd8-a859-f219abb35c9e req-de5adb94-95ac-4d74-926e-4f671281e3b1 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received unexpected event network-vif-plugged-35958938-f4c5-4745-99ca-0f0761fd801c for instance with vm_state active and task_state deleting.
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.028s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f615c085-c085-4dbe-923e-2378c63a01ea]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Flushing IO for device /dev/sdi {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef11cdb-d2b1-4d8d-9e3a-f9fabe0aa4e4]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:24:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.055s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2133bbe-66ea-49e9-9330-3d15493e3dbf]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] SCSI volumes sdi have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc74f19-02a0-425a-bf8e-b2431ada962d]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd05fe07-4b1e-49dc-bf9f-01eaa0b95068]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3, portal: 172.16.0.220,3260]
Aug 26 23:24:04 user nova-compute[73497]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3, portal: 172.16.0.220,3260] successful.
Aug 26 23:24:04 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-ee6283d5-40de-432d-997c-0be52ff673ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-ee6283d5-40de-432d-997c-0be52ff673ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6da56445-077b-42eb-90ee-12eba93589a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f17b0c2-5847-445a-9d1d-28f8bca0a23b]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] <== disconnect_volume: return (372ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IJqErCFS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:24:04 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:24:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[735374f3-a980-4266-93ce-1ac98c67e51e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac130dc-f010-4718-bdc3-603346e292dd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:24:04 user nova-compute[73497]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)
Aug 26 23:24:04 user nova-compute[73497]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)
Aug 26 23:24:04 user nova-compute[73497]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:24:04 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:24:04 user nova-compute[73497]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d (non-flash)
Aug 26 23:24:04 user nova-compute[73497]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)
Aug 26 23:24:04 user nova-compute[73497]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:24:04 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282c0ffb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d'): ({'sdj'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Removing single pathed devices sdj {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c349c909-dfb5-49ea-bd27-222501b238c7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc08505-4d13-4fc0-b8c2-7d01d498edf3]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Flushing IO for device /dev/sdj {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8ae0f3-8f28-4445-84bc-711952662991]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.053s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8651d2cf-9286-4a62-8204-db3a31395ef5]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] SCSI volumes sdj have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9902b6-24d4-4278-bd74-6ad12c682c7f]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76b9408-8e08-4ff4-86cb-64c96269e9e0]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d, portal: 172.16.0.220,3260]
Aug 26 23:24:04 user nova-compute[73497]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d, portal: 172.16.0.220,3260] successful.
Aug 26 23:24:04 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae929108-9690-475d-a816-c0fad8ee791d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd069d45-eea7-44df-829c-2540608ee67a]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] <== disconnect_volume: return (357ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:24:04 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Deleting instance files /opt/stack/data/nova/instances/a6c7669c-f338-4e2b-9ba7-96d8e66d10ed_del
Aug 26 23:24:04 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Deletion of /opt/stack/data/nova/instances/a6c7669c-f338-4e2b-9ba7-96d8e66d10ed_del complete
Aug 26 23:24:04 user nova-compute[73497]: INFO nova.compute.manager [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Took 3.42 seconds to destroy the instance on the hypervisor.
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Updating instance_info_cache with network_info: [{"id": "61639246-9d84-4629-9666-154897feaeae", "address": "fa:16:3e:56:41:f9", "network": {"id": "108c66fb-49a3-4c69-a3ac-93d9643a1d3e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025099504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e765258a50d46dea25bfd9c72970eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61639246-9d", "ovs_interfaceid": "61639246-9d84-4629-9666-154897feaeae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-ee6283d5-40de-432d-997c-0be52ff673ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:24:04 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:24:06 user nova-compute[73497]: INFO nova.compute.manager [None req-28d21d9e-2481-4798-9486-b10bcc260f11 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Unrescuing
Aug 26 23:24:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-28d21d9e-2481-4798-9486-b10bcc260f11 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Acquiring lock "refresh_cache-7c124dd9-4dce-4c6f-925c-6eda8e187d84" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:24:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-28d21d9e-2481-4798-9486-b10bcc260f11 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Acquired lock "refresh_cache-7c124dd9-4dce-4c6f-925c-6eda8e187d84" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:24:06 user nova-compute[73497]: DEBUG nova.network.neutron [None req-28d21d9e-2481-4798-9486-b10bcc260f11 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:24:06 user nova-compute[73497]: DEBUG nova.network.neutron [None req-28d21d9e-2481-4798-9486-b10bcc260f11 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Updating instance_info_cache with network_info: [{"id": "127a3626-0dfe-4050-83d8-43658958e8df", "address": "fa:16:3e:1c:46:66", "network": {"id": "0b5f5877-f6f2-4814-878a-25181e72db29", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-155251039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19a5c1c2c4a456a86efbbadd38d94c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127a3626-0d", "ovs_interfaceid": "127a3626-0dfe-4050-83d8-43658958e8df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:24:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-28d21d9e-2481-4798-9486-b10bcc260f11 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Releasing lock "refresh_cache-7c124dd9-4dce-4c6f-925c-6eda8e187d84" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:24:06 user nova-compute[73497]: DEBUG nova.objects.instance [None req-28d21d9e-2481-4798-9486-b10bcc260f11 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lazy-loading 'flavor' on Instance uuid 7c124dd9-4dce-4c6f-925c-6eda8e187d84 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:24:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:07 user nova-compute[73497]: DEBUG nova.compute.manager [req-94deebbe-3196-493c-95bb-e764dc6ed757 req-273c73dd-193a-4f90-9402-61f686bc6764 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-deleted-6361122d-0a82-4b1d-8ea5-dedb8984f15f {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:07 user nova-compute[73497]: INFO nova.compute.manager [req-94deebbe-3196-493c-95bb-e764dc6ed757 req-273c73dd-193a-4f90-9402-61f686bc6764 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Neutron deleted interface 6361122d-0a82-4b1d-8ea5-dedb8984f15f; detaching it from the instance and deleting it from the info cache
Aug 26 23:24:07 user nova-compute[73497]: DEBUG nova.network.neutron [req-94deebbe-3196-493c-95bb-e764dc6ed757 req-273c73dd-193a-4f90-9402-61f686bc6764 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Updating instance_info_cache with network_info: [{"id": "d114632c-d651-4419-9f82-ecaa90cd381b", "address": "fa:16:3e:7a:e8:f3", "network": {"id": "d6df8ba3-c833-4cf3-8865-2e449087bead", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-54509536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd114632c-d6", "ovs_interfaceid": "d114632c-d651-4419-9f82-ecaa90cd381b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c268fbf7-6a36-44b5-8361-42160a69b1d4", "address": "fa:16:3e:e6:16:95", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc268fbf7-6a", "ovs_interfaceid": "c268fbf7-6a36-44b5-8361-42160a69b1d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "372fa1fa-b52b-479a-b228-91eebb1d3e3f", "address": "fa:16:3e:b0:c0:5e", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372fa1fa-b5", "ovs_interfaceid": "372fa1fa-b52b-479a-b228-91eebb1d3e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7c81f6a7-92b5-496b-867f-c10965da8e40", "address": "fa:16:3e:8e:33:9e", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c81f6a7-92", "ovs_interfaceid": "7c81f6a7-92b5-496b-867f-c10965da8e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "792a72cb-3624-45eb-a8f7-01cf52196f2d", "address": "fa:16:3e:73:4e:ac", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap792a72cb-36", "ovs_interfaceid": "792a72cb-3624-45eb-a8f7-01cf52196f2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "35958938-f4c5-4745-99ca-0f0761fd801c", "address": "fa:16:3e:d2:d0:65", "network": {"id": "15044bd5-0863-41a2-ad57-abbdad59baa3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1012445693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35958938-f4", "ovs_interfaceid": "35958938-f4c5-4745-99ca-0f0761fd801c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:24:07 user nova-compute[73497]: DEBUG nova.compute.manager [req-94deebbe-3196-493c-95bb-e764dc6ed757 req-273c73dd-193a-4f90-9402-61f686bc6764 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Detach interface failed, port_id=6361122d-0a82-4b1d-8ea5-dedb8984f15f, reason: Instance a6c7669c-f338-4e2b-9ba7-96d8e66d10ed could not be found. {{(pid=73497) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 23:24:07 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Instance destroyed successfully.
Aug 26 23:24:07 user nova-compute[73497]: DEBUG nova.compute.manager [req-0ec354b4-054a-4ddc-a242-0e4462a8554b req-0005952c-f3a7-4353-9401-f042c97fb474 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Received event network-changed-127a3626-0dfe-4050-83d8-43658958e8df {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:07 user nova-compute[73497]: DEBUG nova.compute.manager [req-0ec354b4-054a-4ddc-a242-0e4462a8554b req-0005952c-f3a7-4353-9401-f042c97fb474 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Refreshing instance network info cache due to event network-changed-127a3626-0dfe-4050-83d8-43658958e8df. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:24:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0ec354b4-054a-4ddc-a242-0e4462a8554b req-0005952c-f3a7-4353-9401-f042c97fb474 service nova] Acquiring lock "refresh_cache-7c124dd9-4dce-4c6f-925c-6eda8e187d84" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:24:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0ec354b4-054a-4ddc-a242-0e4462a8554b req-0005952c-f3a7-4353-9401-f042c97fb474 service nova] Acquired lock "refresh_cache-7c124dd9-4dce-4c6f-925c-6eda8e187d84" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:24:07 user nova-compute[73497]: DEBUG nova.network.neutron [req-0ec354b4-054a-4ddc-a242-0e4462a8554b req-0005952c-f3a7-4353-9401-f042c97fb474 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Refreshing network info cache for port 127a3626-0dfe-4050-83d8-43658958e8df {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:24:08 user nova-compute[73497]: DEBUG nova.network.neutron [req-0ec354b4-054a-4ddc-a242-0e4462a8554b req-0005952c-f3a7-4353-9401-f042c97fb474 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Updated VIF entry in instance network info cache for port 127a3626-0dfe-4050-83d8-43658958e8df. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:24:08 user nova-compute[73497]: DEBUG nova.network.neutron [req-0ec354b4-054a-4ddc-a242-0e4462a8554b req-0005952c-f3a7-4353-9401-f042c97fb474 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Updating instance_info_cache with network_info: [{"id": "127a3626-0dfe-4050-83d8-43658958e8df", "address": "fa:16:3e:1c:46:66", "network": {"id": "0b5f5877-f6f2-4814-878a-25181e72db29", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-155251039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19a5c1c2c4a456a86efbbadd38d94c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127a3626-0d", "ovs_interfaceid": "127a3626-0dfe-4050-83d8-43658958e8df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:24:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0ec354b4-054a-4ddc-a242-0e4462a8554b req-0005952c-f3a7-4353-9401-f042c97fb474 service nova] Releasing lock "refresh_cache-7c124dd9-4dce-4c6f-925c-6eda8e187d84" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:24:08 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:08 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:08 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:08 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:09 user nova-compute[73497]: DEBUG nova.compute.manager [req-07287871-4d54-463e-81de-8fbd82ff844f req-abdee857-b4f6-4f53-9440-f223a9a299da service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Received event network-vif-unplugged-127a3626-0dfe-4050-83d8-43658958e8df {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-07287871-4d54-463e-81de-8fbd82ff844f req-abdee857-b4f6-4f53-9440-f223a9a299da service nova] Acquiring lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-07287871-4d54-463e-81de-8fbd82ff844f req-abdee857-b4f6-4f53-9440-f223a9a299da service nova] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-07287871-4d54-463e-81de-8fbd82ff844f req-abdee857-b4f6-4f53-9440-f223a9a299da service nova] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:09 user nova-compute[73497]: DEBUG nova.compute.manager [req-07287871-4d54-463e-81de-8fbd82ff844f req-abdee857-b4f6-4f53-9440-f223a9a299da service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] No waiting events found dispatching network-vif-unplugged-127a3626-0dfe-4050-83d8-43658958e8df {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:24:09 user nova-compute[73497]: WARNING nova.compute.manager [req-07287871-4d54-463e-81de-8fbd82ff844f req-abdee857-b4f6-4f53-9440-f223a9a299da service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Received unexpected event network-vif-unplugged-127a3626-0dfe-4050-83d8-43658958e8df for instance with vm_state rescued and task_state unrescuing.
Aug 26 23:24:09 user nova-compute[73497]: DEBUG nova.compute.manager [req-07287871-4d54-463e-81de-8fbd82ff844f req-abdee857-b4f6-4f53-9440-f223a9a299da service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Received event network-vif-plugged-127a3626-0dfe-4050-83d8-43658958e8df {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-07287871-4d54-463e-81de-8fbd82ff844f req-abdee857-b4f6-4f53-9440-f223a9a299da service nova] Acquiring lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-07287871-4d54-463e-81de-8fbd82ff844f req-abdee857-b4f6-4f53-9440-f223a9a299da service nova] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-07287871-4d54-463e-81de-8fbd82ff844f req-abdee857-b4f6-4f53-9440-f223a9a299da service nova] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:09 user nova-compute[73497]: DEBUG nova.compute.manager [req-07287871-4d54-463e-81de-8fbd82ff844f req-abdee857-b4f6-4f53-9440-f223a9a299da service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] No waiting events found dispatching network-vif-plugged-127a3626-0dfe-4050-83d8-43658958e8df {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:24:09 user nova-compute[73497]: WARNING nova.compute.manager [req-07287871-4d54-463e-81de-8fbd82ff844f req-abdee857-b4f6-4f53-9440-f223a9a299da service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Received unexpected event network-vif-plugged-127a3626-0dfe-4050-83d8-43658958e8df for instance with vm_state rescued and task_state unrescuing.
Aug 26 23:24:09 user nova-compute[73497]: DEBUG nova.compute.manager [req-07287871-4d54-463e-81de-8fbd82ff844f req-abdee857-b4f6-4f53-9440-f223a9a299da service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-deleted-35958938-f4c5-4745-99ca-0f0761fd801c {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:09 user nova-compute[73497]: INFO nova.compute.manager [req-07287871-4d54-463e-81de-8fbd82ff844f req-abdee857-b4f6-4f53-9440-f223a9a299da service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Neutron deleted interface 35958938-f4c5-4745-99ca-0f0761fd801c; detaching it from the instance and deleting it from the info cache
Aug 26 23:24:09 user nova-compute[73497]: DEBUG nova.network.neutron [req-07287871-4d54-463e-81de-8fbd82ff844f req-abdee857-b4f6-4f53-9440-f223a9a299da service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Updating instance_info_cache with network_info: [{"id": "d114632c-d651-4419-9f82-ecaa90cd381b", "address": "fa:16:3e:7a:e8:f3", "network": {"id": "d6df8ba3-c833-4cf3-8865-2e449087bead", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-54509536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd114632c-d6", "ovs_interfaceid": "d114632c-d651-4419-9f82-ecaa90cd381b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c268fbf7-6a36-44b5-8361-42160a69b1d4", "address": "fa:16:3e:e6:16:95", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc268fbf7-6a", "ovs_interfaceid": "c268fbf7-6a36-44b5-8361-42160a69b1d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "372fa1fa-b52b-479a-b228-91eebb1d3e3f", "address": "fa:16:3e:b0:c0:5e", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372fa1fa-b5", "ovs_interfaceid": "372fa1fa-b52b-479a-b228-91eebb1d3e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7c81f6a7-92b5-496b-867f-c10965da8e40", "address": "fa:16:3e:8e:33:9e", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c81f6a7-92", "ovs_interfaceid": "7c81f6a7-92b5-496b-867f-c10965da8e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "792a72cb-3624-45eb-a8f7-01cf52196f2d", "address": "fa:16:3e:73:4e:ac", "network": {"id": "1f830eee-2d57-4294-89d6-010b5322c6ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025869932", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aff3ec8f2aad4d71b65787eabb90dd6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap792a72cb-36", "ovs_interfaceid": "792a72cb-3624-45eb-a8f7-01cf52196f2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:24:09 user nova-compute[73497]: DEBUG nova.compute.manager [req-07287871-4d54-463e-81de-8fbd82ff844f req-abdee857-b4f6-4f53-9440-f223a9a299da service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Detach interface failed, port_id=35958938-f4c5-4745-99ca-0f0761fd801c, reason: Instance a6c7669c-f338-4e2b-9ba7-96d8e66d10ed could not be found. {{(pid=73497) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 23:24:09 user nova-compute[73497]: DEBUG nova.compute.manager [req-695e23d0-be91-40c6-9689-83beffacc234 req-213bd2f0-8f87-48c4-a023-443e0990ff95 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Received event network-changed-127a3626-0dfe-4050-83d8-43658958e8df {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:09 user nova-compute[73497]: DEBUG nova.compute.manager [req-695e23d0-be91-40c6-9689-83beffacc234 req-213bd2f0-8f87-48c4-a023-443e0990ff95 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Refreshing instance network info cache due to event network-changed-127a3626-0dfe-4050-83d8-43658958e8df. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:24:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-695e23d0-be91-40c6-9689-83beffacc234 req-213bd2f0-8f87-48c4-a023-443e0990ff95 service nova] Acquiring lock "refresh_cache-7c124dd9-4dce-4c6f-925c-6eda8e187d84" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:24:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-695e23d0-be91-40c6-9689-83beffacc234 req-213bd2f0-8f87-48c4-a023-443e0990ff95 service nova] Acquired lock "refresh_cache-7c124dd9-4dce-4c6f-925c-6eda8e187d84" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:24:09 user nova-compute[73497]: DEBUG nova.network.neutron [req-695e23d0-be91-40c6-9689-83beffacc234 req-213bd2f0-8f87-48c4-a023-443e0990ff95 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Refreshing network info cache for port 127a3626-0dfe-4050-83d8-43658958e8df {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:24:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:10 user nova-compute[73497]: DEBUG nova.network.neutron [req-695e23d0-be91-40c6-9689-83beffacc234 req-213bd2f0-8f87-48c4-a023-443e0990ff95 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Updated VIF entry in instance network info cache for port 127a3626-0dfe-4050-83d8-43658958e8df. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:24:10 user nova-compute[73497]: DEBUG nova.network.neutron [req-695e23d0-be91-40c6-9689-83beffacc234 req-213bd2f0-8f87-48c4-a023-443e0990ff95 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Updating instance_info_cache with network_info: [{"id": "127a3626-0dfe-4050-83d8-43658958e8df", "address": "fa:16:3e:1c:46:66", "network": {"id": "0b5f5877-f6f2-4814-878a-25181e72db29", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-155251039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19a5c1c2c4a456a86efbbadd38d94c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127a3626-0d", "ovs_interfaceid": "127a3626-0dfe-4050-83d8-43658958e8df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:24:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-695e23d0-be91-40c6-9689-83beffacc234 req-213bd2f0-8f87-48c4-a023-443e0990ff95 service nova] Releasing lock "refresh_cache-7c124dd9-4dce-4c6f-925c-6eda8e187d84" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:24:10 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:24:10 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Took 5.83 seconds to deallocate network for instance.
Aug 26 23:24:11 user nova-compute[73497]: DEBUG nova.compute.manager [req-baad921c-d045-43b5-b1d8-67cf014fe4ea req-6821551e-f998-4fd1-bd90-70caa4ab47f5 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Received event network-vif-plugged-127a3626-0dfe-4050-83d8-43658958e8df {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-baad921c-d045-43b5-b1d8-67cf014fe4ea req-6821551e-f998-4fd1-bd90-70caa4ab47f5 service nova] Acquiring lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-baad921c-d045-43b5-b1d8-67cf014fe4ea req-6821551e-f998-4fd1-bd90-70caa4ab47f5 service nova] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-baad921c-d045-43b5-b1d8-67cf014fe4ea req-6821551e-f998-4fd1-bd90-70caa4ab47f5 service nova] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:11 user nova-compute[73497]: DEBUG nova.compute.manager [req-baad921c-d045-43b5-b1d8-67cf014fe4ea req-6821551e-f998-4fd1-bd90-70caa4ab47f5 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] No waiting events found dispatching network-vif-plugged-127a3626-0dfe-4050-83d8-43658958e8df {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:24:11 user nova-compute[73497]: WARNING nova.compute.manager [req-baad921c-d045-43b5-b1d8-67cf014fe4ea req-6821551e-f998-4fd1-bd90-70caa4ab47f5 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Received unexpected event network-vif-plugged-127a3626-0dfe-4050-83d8-43658958e8df for instance with vm_state rescued and task_state unrescuing.
Aug 26 23:24:11 user nova-compute[73497]: DEBUG nova.compute.manager [req-baad921c-d045-43b5-b1d8-67cf014fe4ea req-6821551e-f998-4fd1-bd90-70caa4ab47f5 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-deleted-d114632c-d651-4419-9f82-ecaa90cd381b {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:11 user nova-compute[73497]: DEBUG nova.compute.manager [req-baad921c-d045-43b5-b1d8-67cf014fe4ea req-6821551e-f998-4fd1-bd90-70caa4ab47f5 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Received event network-vif-plugged-127a3626-0dfe-4050-83d8-43658958e8df {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-baad921c-d045-43b5-b1d8-67cf014fe4ea req-6821551e-f998-4fd1-bd90-70caa4ab47f5 service nova] Acquiring lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-baad921c-d045-43b5-b1d8-67cf014fe4ea req-6821551e-f998-4fd1-bd90-70caa4ab47f5 service nova] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-baad921c-d045-43b5-b1d8-67cf014fe4ea req-6821551e-f998-4fd1-bd90-70caa4ab47f5 service nova] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:11 user nova-compute[73497]: DEBUG nova.compute.manager [req-baad921c-d045-43b5-b1d8-67cf014fe4ea req-6821551e-f998-4fd1-bd90-70caa4ab47f5 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] No waiting events found dispatching network-vif-plugged-127a3626-0dfe-4050-83d8-43658958e8df {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:24:11 user nova-compute[73497]: WARNING nova.compute.manager [req-baad921c-d045-43b5-b1d8-67cf014fe4ea req-6821551e-f998-4fd1-bd90-70caa4ab47f5 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Received unexpected event network-vif-plugged-127a3626-0dfe-4050-83d8-43658958e8df for instance with vm_state rescued and task_state unrescuing.
Aug 26 23:24:11 user nova-compute[73497]: DEBUG nova.compute.manager [req-baad921c-d045-43b5-b1d8-67cf014fe4ea req-6821551e-f998-4fd1-bd90-70caa4ab47f5 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-deleted-7c81f6a7-92b5-496b-867f-c10965da8e40 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:11 user nova-compute[73497]: DEBUG nova.compute.manager [req-baad921c-d045-43b5-b1d8-67cf014fe4ea req-6821551e-f998-4fd1-bd90-70caa4ab47f5 service nova] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Received event network-vif-deleted-792a72cb-3624-45eb-a8f7-01cf52196f2d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:11 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Removed pending event for 7c124dd9-4dce-4c6f-925c-6eda8e187d84 due to event {{(pid=73497) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 23:24:11 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092251.411903, 7c124dd9-4dce-4c6f-925c-6eda8e187d84 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:24:11 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] VM Resumed (Lifecycle Event)
Aug 26 23:24:11 user nova-compute[73497]: DEBUG nova.compute.manager [None req-28d21d9e-2481-4798-9486-b10bcc260f11 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:24:11 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:24:11 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:24:11 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 23:24:11 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092251.4130158, 7c124dd9-4dce-4c6f-925c-6eda8e187d84 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:24:11 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] VM Started (Lifecycle Event)
Aug 26 23:24:11 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:24:11 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:24:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c0c53ff5-622c-4a4d-96ec-196d3fb7e260 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "ff1085db-4bfc-4c77-a9e4-39f47ffb6d43" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c0c53ff5-622c-4a4d-96ec-196d3fb7e260 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "ff1085db-4bfc-4c77-a9e4-39f47ffb6d43" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c0c53ff5-622c-4a4d-96ec-196d3fb7e260 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "ff1085db-4bfc-4c77-a9e4-39f47ffb6d43-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c0c53ff5-622c-4a4d-96ec-196d3fb7e260 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "ff1085db-4bfc-4c77-a9e4-39f47ffb6d43-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c0c53ff5-622c-4a4d-96ec-196d3fb7e260 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "ff1085db-4bfc-4c77-a9e4-39f47ffb6d43-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:13 user nova-compute[73497]: INFO nova.compute.manager [None req-c0c53ff5-622c-4a4d-96ec-196d3fb7e260 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Terminating instance
Aug 26 23:24:13 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c0c53ff5-622c-4a4d-96ec-196d3fb7e260 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:24:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:14 user nova-compute[73497]: DEBUG nova.compute.manager [req-f0676939-b4e3-417e-b0c4-199d44561a24 req-9b072127-616f-4a57-8a79-c3a213b35ec3 service nova] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Received event network-vif-unplugged-c9d76244-be10-4ea6-84d7-86de94e58d05 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f0676939-b4e3-417e-b0c4-199d44561a24 req-9b072127-616f-4a57-8a79-c3a213b35ec3 service nova] Acquiring lock "ff1085db-4bfc-4c77-a9e4-39f47ffb6d43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f0676939-b4e3-417e-b0c4-199d44561a24 req-9b072127-616f-4a57-8a79-c3a213b35ec3 service nova] Lock "ff1085db-4bfc-4c77-a9e4-39f47ffb6d43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f0676939-b4e3-417e-b0c4-199d44561a24 req-9b072127-616f-4a57-8a79-c3a213b35ec3 service nova] Lock "ff1085db-4bfc-4c77-a9e4-39f47ffb6d43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:14 user nova-compute[73497]: DEBUG nova.compute.manager [req-f0676939-b4e3-417e-b0c4-199d44561a24 req-9b072127-616f-4a57-8a79-c3a213b35ec3 service nova] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] No waiting events found dispatching network-vif-unplugged-c9d76244-be10-4ea6-84d7-86de94e58d05 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:24:14 user nova-compute[73497]: DEBUG nova.compute.manager [req-f0676939-b4e3-417e-b0c4-199d44561a24 req-9b072127-616f-4a57-8a79-c3a213b35ec3 service nova] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Received event network-vif-unplugged-c9d76244-be10-4ea6-84d7-86de94e58d05 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:24:14 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Instance destroyed successfully.
Aug 26 23:24:14 user nova-compute[73497]: DEBUG nova.objects.instance [None req-c0c53ff5-622c-4a4d-96ec-196d3fb7e260 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lazy-loading 'resources' on Instance uuid ff1085db-4bfc-4c77-a9e4-39f47ffb6d43 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:24:14 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-c0c53ff5-622c-4a4d-96ec-196d3fb7e260 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:18:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1564774353',display_name='tempest-AttachVolumeNegativeTest-server-1564774353',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1564774353',id=16,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjq4kaAHeTyufvhSZekqtzsDAykiYvs05tP8gdlSnEvx+cyT5YaV7iz6qkFeqHygL3bm1ZgFmAKTOOU0v+dGUpYXzri5nWGUFomI2EnKgQVQpVIxTOQQkzJdNpIOf+oNQ==',key_name='tempest-keypair-1896541578',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:18:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d784b1d6c31e41d6a03fc377b0be69f5',ramdisk_id='',reservation_id='r-au4cf9sr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1095215256',owner_user_name='tempest-AttachVolumeNegativeTest-1095215256-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:18:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e38409b92a95475db83540cbc4222466',uuid=ff1085db-4bfc-4c77-a9e4-39f47ffb6d43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9d76244-be10-4ea6-84d7-86de94e58d05", "address": "fa:16:3e:15:e9:03", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d76244-be", "ovs_interfaceid": "c9d76244-be10-4ea6-84d7-86de94e58d05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:24:14 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-c0c53ff5-622c-4a4d-96ec-196d3fb7e260 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Converting VIF {"id": "c9d76244-be10-4ea6-84d7-86de94e58d05", "address": "fa:16:3e:15:e9:03", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d76244-be", "ovs_interfaceid": "c9d76244-be10-4ea6-84d7-86de94e58d05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:24:14 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-c0c53ff5-622c-4a4d-96ec-196d3fb7e260 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:e9:03,bridge_name='br-int',has_traffic_filtering=True,id=c9d76244-be10-4ea6-84d7-86de94e58d05,network=Network(7bae9729-050d-4ff3-a842-91d0ec2c08d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9d76244-be') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:24:14 user nova-compute[73497]: DEBUG os_vif [None req-c0c53ff5-622c-4a4d-96ec-196d3fb7e260 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:e9:03,bridge_name='br-int',has_traffic_filtering=True,id=c9d76244-be10-4ea6-84d7-86de94e58d05,network=Network(7bae9729-050d-4ff3-a842-91d0ec2c08d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9d76244-be') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:24:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9d76244-be, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:24:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:24:14 user nova-compute[73497]: INFO os_vif [None req-c0c53ff5-622c-4a4d-96ec-196d3fb7e260 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:e9:03,bridge_name='br-int',has_traffic_filtering=True,id=c9d76244-be10-4ea6-84d7-86de94e58d05,network=Network(7bae9729-050d-4ff3-a842-91d0ec2c08d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9d76244-be')
Aug 26 23:24:14 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-c0c53ff5-622c-4a4d-96ec-196d3fb7e260 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Deleting instance files /opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43_del
Aug 26 23:24:14 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-c0c53ff5-622c-4a4d-96ec-196d3fb7e260 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Deletion of /opt/stack/data/nova/instances/ff1085db-4bfc-4c77-a9e4-39f47ffb6d43_del complete
Aug 26 23:24:14 user nova-compute[73497]: INFO nova.compute.manager [None req-c0c53ff5-622c-4a4d-96ec-196d3fb7e260 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 26 23:24:14 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-c0c53ff5-622c-4a4d-96ec-196d3fb7e260 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:24:14 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:24:14 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:24:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:16 user nova-compute[73497]: DEBUG nova.compute.manager [req-8728790f-0e37-4703-a280-08e46689167e req-ef593137-7ce7-4ae3-8019-47ab8ac65897 service nova] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Received event network-vif-plugged-c9d76244-be10-4ea6-84d7-86de94e58d05 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8728790f-0e37-4703-a280-08e46689167e req-ef593137-7ce7-4ae3-8019-47ab8ac65897 service nova] Acquiring lock "ff1085db-4bfc-4c77-a9e4-39f47ffb6d43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8728790f-0e37-4703-a280-08e46689167e req-ef593137-7ce7-4ae3-8019-47ab8ac65897 service nova] Lock "ff1085db-4bfc-4c77-a9e4-39f47ffb6d43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8728790f-0e37-4703-a280-08e46689167e req-ef593137-7ce7-4ae3-8019-47ab8ac65897 service nova] Lock "ff1085db-4bfc-4c77-a9e4-39f47ffb6d43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:16 user nova-compute[73497]: DEBUG nova.compute.manager [req-8728790f-0e37-4703-a280-08e46689167e req-ef593137-7ce7-4ae3-8019-47ab8ac65897 service nova] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] No waiting events found dispatching network-vif-plugged-c9d76244-be10-4ea6-84d7-86de94e58d05 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:24:16 user nova-compute[73497]: WARNING nova.compute.manager [req-8728790f-0e37-4703-a280-08e46689167e req-ef593137-7ce7-4ae3-8019-47ab8ac65897 service nova] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Received unexpected event network-vif-plugged-c9d76244-be10-4ea6-84d7-86de94e58d05 for instance with vm_state active and task_state deleting.
Aug 26 23:24:16 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:24:16 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Took 1.98 seconds to deallocate network for instance.
Aug 26 23:24:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c0c53ff5-622c-4a4d-96ec-196d3fb7e260 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c0c53ff5-622c-4a4d-96ec-196d3fb7e260 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:17 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-c0c53ff5-622c-4a4d-96ec-196d3fb7e260 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:24:17 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-c0c53ff5-622c-4a4d-96ec-196d3fb7e260 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:24:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c0c53ff5-622c-4a4d-96ec-196d3fb7e260 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.495s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:17 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-c0c53ff5-622c-4a4d-96ec-196d3fb7e260 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Deleted allocations for instance ff1085db-4bfc-4c77-a9e4-39f47ffb6d43
Aug 26 23:24:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c0c53ff5-622c-4a4d-96ec-196d3fb7e260 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "ff1085db-4bfc-4c77-a9e4-39f47ffb6d43" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.651s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:17 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693092242.986134, a6c7669c-f338-4e2b-9ba7-96d8e66d10ed => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:24:17 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] VM Stopped (Lifecycle Event)
Aug 26 23:24:18 user nova-compute[73497]: DEBUG nova.compute.manager [None req-7cd43d69-e652-4cf1-9e04-2a9d602cd751 None None] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:24:18 user nova-compute[73497]: DEBUG nova.compute.manager [req-543f1db4-5b6b-4a7f-99b9-7ceb80085ae5 req-f5c9af45-566a-4ede-91d7-457bc81dca06 service nova] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Received event network-vif-deleted-c9d76244-be10-4ea6-84d7-86de94e58d05 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:20 user nova-compute[73497]: INFO nova.compute.manager [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] [instance: a6c7669c-f338-4e2b-9ba7-96d8e66d10ed] Took 10.26 seconds to detach 3 volumes for instance.
Aug 26 23:24:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:21 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:24:21 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:24:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.423s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:21 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Deleted allocations for instance a6c7669c-f338-4e2b-9ba7-96d8e66d10ed
Aug 26 23:24:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-eaa526fe-4637-4865-a50f-0a7a4f93ffa5 tempest-TaggedBootDevicesTest_v242-661216102 tempest-TaggedBootDevicesTest_v242-661216102-project-member] Lock "a6c7669c-f338-4e2b-9ba7-96d8e66d10ed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 20.180s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:25 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Acquiring lock "6df9ebc6-0b6a-4cdc-811d-d43be88958f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Lock "6df9ebc6-0b6a-4cdc-811d-d43be88958f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:27 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:24:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:27 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:24:27 user nova-compute[73497]: INFO nova.compute.claims [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Claim successful on node user
Aug 26 23:24:27 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:24:27 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:24:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:27 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:24:27 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:24:27 user nova-compute[73497]: DEBUG nova.network.neutron [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:24:27 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:24:27 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:24:27 user nova-compute[73497]: DEBUG nova.policy [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3e9b0d6ec9b34e74a5c0f1382dbc0e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987e60ebce5d45bd8abac0aad79f24c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:24:27 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:24:27 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:24:27 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Creating image(s)
Aug 26 23:24:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Acquiring lock "/opt/stack/data/nova/instances/6df9ebc6-0b6a-4cdc-811d-d43be88958f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Lock "/opt/stack/data/nova/instances/6df9ebc6-0b6a-4cdc-811d-d43be88958f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Lock "/opt/stack/data/nova/instances/6df9ebc6-0b6a-4cdc-811d-d43be88958f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.192s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.183s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/6df9ebc6-0b6a-4cdc-811d-d43be88958f7/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/6df9ebc6-0b6a-4cdc-811d-d43be88958f7/disk 1073741824" returned: 0 in 0.089s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.186s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:28 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6df9ebc6-0b6a-4cdc-811d-d43be88958f7/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:24:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df9ebc6-0b6a-4cdc-811d-d43be88958f7/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:28 user nova-compute[73497]: DEBUG nova.network.neutron [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Successfully created port: 09704f88-352c-4a21-8e61-f2b25818658d {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:24:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df9ebc6-0b6a-4cdc-811d-d43be88958f7/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:28 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Cannot resize image /opt/stack/data/nova/instances/6df9ebc6-0b6a-4cdc-811d-d43be88958f7/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:24:28 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:24:28 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Ensure instance console log exists: /opt/stack/data/nova/instances/6df9ebc6-0b6a-4cdc-811d-d43be88958f7/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:24:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:29 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693092254.6322343, ff1085db-4bfc-4c77-a9e4-39f47ffb6d43 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:24:29 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] VM Stopped (Lifecycle Event)
Aug 26 23:24:29 user nova-compute[73497]: DEBUG nova.compute.manager [None req-6f9c98b1-6977-4e17-906d-d873dd014f73 None None] [instance: ff1085db-4bfc-4c77-a9e4-39f47ffb6d43] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:24:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:30 user nova-compute[73497]: DEBUG nova.network.neutron [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Successfully updated port: 09704f88-352c-4a21-8e61-f2b25818658d {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:24:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Acquiring lock "refresh_cache-6df9ebc6-0b6a-4cdc-811d-d43be88958f7" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:24:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Acquired lock "refresh_cache-6df9ebc6-0b6a-4cdc-811d-d43be88958f7" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:24:30 user nova-compute[73497]: DEBUG nova.network.neutron [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:24:30 user nova-compute[73497]: DEBUG nova.compute.manager [req-93404abf-f721-40bf-8868-cd1cb2e5b38f req-b6f1b167-9a08-4199-ac6b-55a8562d1437 service nova] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Received event network-changed-09704f88-352c-4a21-8e61-f2b25818658d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:30 user nova-compute[73497]: DEBUG nova.compute.manager [req-93404abf-f721-40bf-8868-cd1cb2e5b38f req-b6f1b167-9a08-4199-ac6b-55a8562d1437 service nova] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Refreshing instance network info cache due to event network-changed-09704f88-352c-4a21-8e61-f2b25818658d. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:24:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-93404abf-f721-40bf-8868-cd1cb2e5b38f req-b6f1b167-9a08-4199-ac6b-55a8562d1437 service nova] Acquiring lock "refresh_cache-6df9ebc6-0b6a-4cdc-811d-d43be88958f7" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:24:30 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:30 user nova-compute[73497]: DEBUG nova.network.neutron [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:24:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:30 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:24:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:30 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:24:30 user nova-compute[73497]: INFO nova.compute.claims [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Claim successful on node user
Aug 26 23:24:30 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Refreshing inventories for resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 23:24:30 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Updating ProviderTree inventory for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 23:24:30 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Updating inventory in ProviderTree for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 23:24:30 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Refreshing aggregate associations for resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1, aggregates: None {{(pid=73497) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 23:24:30 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Refreshing trait associations for resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING {{(pid=73497) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG nova.network.neutron [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Updating instance_info_cache with network_info: [{"id": "09704f88-352c-4a21-8e61-f2b25818658d", "address": "fa:16:3e:9a:c6:81", "network": {"id": "f4d31a8d-e7ba-4eb5-95bd-6b35c83d6232", "bridge": "br-int", "label": "tempest-VolumesActionsTest-704740708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "987e60ebce5d45bd8abac0aad79f24c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09704f88-35", "ovs_interfaceid": "09704f88-352c-4a21-8e61-f2b25818658d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.603s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Releasing lock "refresh_cache-6df9ebc6-0b6a-4cdc-811d-d43be88958f7" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Instance network_info: |[{"id": "09704f88-352c-4a21-8e61-f2b25818658d", "address": "fa:16:3e:9a:c6:81", "network": {"id": "f4d31a8d-e7ba-4eb5-95bd-6b35c83d6232", "bridge": "br-int", "label": "tempest-VolumesActionsTest-704740708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "987e60ebce5d45bd8abac0aad79f24c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09704f88-35", "ovs_interfaceid": "09704f88-352c-4a21-8e61-f2b25818658d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-93404abf-f721-40bf-8868-cd1cb2e5b38f req-b6f1b167-9a08-4199-ac6b-55a8562d1437 service nova] Acquired lock "refresh_cache-6df9ebc6-0b6a-4cdc-811d-d43be88958f7" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG nova.network.neutron [req-93404abf-f721-40bf-8868-cd1cb2e5b38f req-b6f1b167-9a08-4199-ac6b-55a8562d1437 service nova] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Refreshing network info cache for port 09704f88-352c-4a21-8e61-f2b25818658d {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Start _get_guest_xml network_info=[{"id": "09704f88-352c-4a21-8e61-f2b25818658d", "address": "fa:16:3e:9a:c6:81", "network": {"id": "f4d31a8d-e7ba-4eb5-95bd-6b35c83d6232", "bridge": "br-int", "label": "tempest-VolumesActionsTest-704740708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "987e60ebce5d45bd8abac0aad79f24c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09704f88-35", "ovs_interfaceid": "09704f88-352c-4a21-8e61-f2b25818658d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:24:31 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:24:31 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:24:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:24:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1975139429',display_name='tempest-VolumesActionsTest-instance-1975139429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1975139429',id=26,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='987e60ebce5d45bd8abac0aad79f24c5',ramdisk_id='',reservation_id='r-n4nhdgfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-629841090',owner_user_name='tempest-VolumesActionsTest-629841090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:24:28Z,user_data=None,user_id='3e9b0d6ec9b34e74a5c0f1382dbc0e79',uuid=6df9ebc6-0b6a-4cdc-811d-d43be88958f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09704f88-352c-4a21-8e61-f2b25818658d", "address": "fa:16:3e:9a:c6:81", "network": {"id": "f4d31a8d-e7ba-4eb5-95bd-6b35c83d6232", "bridge": "br-int", "label": "tempest-VolumesActionsTest-704740708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "987e60ebce5d45bd8abac0aad79f24c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09704f88-35", "ovs_interfaceid": "09704f88-352c-4a21-8e61-f2b25818658d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Converting VIF {"id": "09704f88-352c-4a21-8e61-f2b25818658d", "address": "fa:16:3e:9a:c6:81", "network": {"id": "f4d31a8d-e7ba-4eb5-95bd-6b35c83d6232", "bridge": "br-int", "label": "tempest-VolumesActionsTest-704740708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "987e60ebce5d45bd8abac0aad79f24c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09704f88-35", "ovs_interfaceid": "09704f88-352c-4a21-8e61-f2b25818658d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:c6:81,bridge_name='br-int',has_traffic_filtering=True,id=09704f88-352c-4a21-8e61-f2b25818658d,network=Network(f4d31a8d-e7ba-4eb5-95bd-6b35c83d6232),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09704f88-35') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG nova.objects.instance [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Lazy-loading 'pci_devices' on Instance uuid 6df9ebc6-0b6a-4cdc-811d-d43be88958f7 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:24:31 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:24:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:24:31 user nova-compute[73497]:   <uuid>6df9ebc6-0b6a-4cdc-811d-d43be88958f7</uuid>
Aug 26 23:24:31 user nova-compute[73497]:   <name>instance-0000001a</name>
Aug 26 23:24:31 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:24:31 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:24:31 user nova-compute[73497]:   <metadata>
Aug 26 23:24:31 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:24:31 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:24:31 user nova-compute[73497]:       <nova:name>tempest-VolumesActionsTest-instance-1975139429</nova:name>
Aug 26 23:24:31 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:24:31</nova:creationTime>
Aug 26 23:24:31 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:24:31 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:24:31 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:24:31 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:24:31 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:24:31 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:24:31 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:24:31 user nova-compute[73497]:       <nova:owner>
Aug 26 23:24:31 user nova-compute[73497]:         <nova:user uuid="3e9b0d6ec9b34e74a5c0f1382dbc0e79">tempest-VolumesActionsTest-629841090-project-member</nova:user>
Aug 26 23:24:31 user nova-compute[73497]:         <nova:project uuid="987e60ebce5d45bd8abac0aad79f24c5">tempest-VolumesActionsTest-629841090</nova:project>
Aug 26 23:24:31 user nova-compute[73497]:       </nova:owner>
Aug 26 23:24:31 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:24:31 user nova-compute[73497]:       <nova:ports>
Aug 26 23:24:31 user nova-compute[73497]:         <nova:port uuid="09704f88-352c-4a21-8e61-f2b25818658d">
Aug 26 23:24:31 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 23:24:31 user nova-compute[73497]:         </nova:port>
Aug 26 23:24:31 user nova-compute[73497]:       </nova:ports>
Aug 26 23:24:31 user nova-compute[73497]:     </nova:instance>
Aug 26 23:24:31 user nova-compute[73497]:   </metadata>
Aug 26 23:24:31 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:24:31 user nova-compute[73497]:     <system>
Aug 26 23:24:31 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:24:31 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:24:31 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:24:31 user nova-compute[73497]:       <entry name="serial">6df9ebc6-0b6a-4cdc-811d-d43be88958f7</entry>
Aug 26 23:24:31 user nova-compute[73497]:       <entry name="uuid">6df9ebc6-0b6a-4cdc-811d-d43be88958f7</entry>
Aug 26 23:24:31 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:24:31 user nova-compute[73497]:     </system>
Aug 26 23:24:31 user nova-compute[73497]:   </sysinfo>
Aug 26 23:24:31 user nova-compute[73497]:   <os>
Aug 26 23:24:31 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:24:31 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:24:31 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:24:31 user nova-compute[73497]:   </os>
Aug 26 23:24:31 user nova-compute[73497]:   <features>
Aug 26 23:24:31 user nova-compute[73497]:     <acpi/>
Aug 26 23:24:31 user nova-compute[73497]:     <apic/>
Aug 26 23:24:31 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:24:31 user nova-compute[73497]:   </features>
Aug 26 23:24:31 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:24:31 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:24:31 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:24:31 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:24:31 user nova-compute[73497]:   </clock>
Aug 26 23:24:31 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:24:31 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:24:31 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:24:31 user nova-compute[73497]:   </cpu>
Aug 26 23:24:31 user nova-compute[73497]:   <devices>
Aug 26 23:24:31 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:24:31 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:24:31 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/6df9ebc6-0b6a-4cdc-811d-d43be88958f7/disk"/>
Aug 26 23:24:31 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:24:31 user nova-compute[73497]:     </disk>
Aug 26 23:24:31 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:24:31 user nova-compute[73497]:       <mac address="fa:16:3e:9a:c6:81"/>
Aug 26 23:24:31 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:24:31 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:24:31 user nova-compute[73497]:       <target dev="tap09704f88-35"/>
Aug 26 23:24:31 user nova-compute[73497]:     </interface>
Aug 26 23:24:31 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:24:31 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/6df9ebc6-0b6a-4cdc-811d-d43be88958f7/console.log" append="off"/>
Aug 26 23:24:31 user nova-compute[73497]:     </serial>
Aug 26 23:24:31 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:24:31 user nova-compute[73497]:     <video>
Aug 26 23:24:31 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:24:31 user nova-compute[73497]:     </video>
Aug 26 23:24:31 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:24:31 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:24:31 user nova-compute[73497]:     </rng>
Aug 26 23:24:31 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:24:31 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:24:31 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:24:31 user nova-compute[73497]:     </memballoon>
Aug 26 23:24:31 user nova-compute[73497]:   </devices>
Aug 26 23:24:31 user nova-compute[73497]: </domain>
Aug 26 23:24:31 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:24:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1975139429',display_name='tempest-VolumesActionsTest-instance-1975139429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1975139429',id=26,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='987e60ebce5d45bd8abac0aad79f24c5',ramdisk_id='',reservation_id='r-n4nhdgfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-629841090',owner_user_name='tempest-VolumesActionsTest-629841090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:24:28Z,user_data=None,user_id='3e9b0d6ec9b34e74a5c0f1382dbc0e79',uuid=6df9ebc6-0b6a-4cdc-811d-d43be88958f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09704f88-352c-4a21-8e61-f2b25818658d", "address": "fa:16:3e:9a:c6:81", "network": {"id": "f4d31a8d-e7ba-4eb5-95bd-6b35c83d6232", "bridge": "br-int", "label": "tempest-VolumesActionsTest-704740708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "987e60ebce5d45bd8abac0aad79f24c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09704f88-35", "ovs_interfaceid": "09704f88-352c-4a21-8e61-f2b25818658d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Converting VIF {"id": "09704f88-352c-4a21-8e61-f2b25818658d", "address": "fa:16:3e:9a:c6:81", "network": {"id": "f4d31a8d-e7ba-4eb5-95bd-6b35c83d6232", "bridge": "br-int", "label": "tempest-VolumesActionsTest-704740708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "987e60ebce5d45bd8abac0aad79f24c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09704f88-35", "ovs_interfaceid": "09704f88-352c-4a21-8e61-f2b25818658d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:c6:81,bridge_name='br-int',has_traffic_filtering=True,id=09704f88-352c-4a21-8e61-f2b25818658d,network=Network(f4d31a8d-e7ba-4eb5-95bd-6b35c83d6232),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09704f88-35') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG os_vif [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:c6:81,bridge_name='br-int',has_traffic_filtering=True,id=09704f88-352c-4a21-8e61-f2b25818658d,network=Network(f4d31a8d-e7ba-4eb5-95bd-6b35c83d6232),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09704f88-35') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09704f88-35, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap09704f88-35, col_values=(('external_ids', {'iface-id': '09704f88-352c-4a21-8e61-f2b25818658d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:c6:81', 'vm-uuid': '6df9ebc6-0b6a-4cdc-811d-d43be88958f7'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:31 user nova-compute[73497]: INFO os_vif [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:c6:81,bridge_name='br-int',has_traffic_filtering=True,id=09704f88-352c-4a21-8e61-f2b25818658d,network=Network(f4d31a8d-e7ba-4eb5-95bd-6b35c83d6232),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09704f88-35')
Aug 26 23:24:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] No VIF found with MAC fa:16:3e:9a:c6:81, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:24:31 user nova-compute[73497]: DEBUG nova.policy [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '83005131fdc2411abe7a198157910743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee8ef1c899342b38a624c1c28309d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:24:31 user nova-compute[73497]: INFO nova.virt.block_device [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Booting with volume-backed-image 0c532d88-7808-4cc1-8183-4c200f1ab99a at /dev/vda
Aug 26 23:24:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:32 user nova-compute[73497]: DEBUG nova.network.neutron [req-93404abf-f721-40bf-8868-cd1cb2e5b38f req-b6f1b167-9a08-4199-ac6b-55a8562d1437 service nova] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Updated VIF entry in instance network info cache for port 09704f88-352c-4a21-8e61-f2b25818658d. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:24:32 user nova-compute[73497]: DEBUG nova.network.neutron [req-93404abf-f721-40bf-8868-cd1cb2e5b38f req-b6f1b167-9a08-4199-ac6b-55a8562d1437 service nova] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Updating instance_info_cache with network_info: [{"id": "09704f88-352c-4a21-8e61-f2b25818658d", "address": "fa:16:3e:9a:c6:81", "network": {"id": "f4d31a8d-e7ba-4eb5-95bd-6b35c83d6232", "bridge": "br-int", "label": "tempest-VolumesActionsTest-704740708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "987e60ebce5d45bd8abac0aad79f24c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09704f88-35", "ovs_interfaceid": "09704f88-352c-4a21-8e61-f2b25818658d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:24:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-93404abf-f721-40bf-8868-cd1cb2e5b38f req-b6f1b167-9a08-4199-ac6b-55a8562d1437 service nova] Releasing lock "refresh_cache-6df9ebc6-0b6a-4cdc-811d-d43be88958f7" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:24:32 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Successfully created port: a45f0c9b-48cc-4434-90c9-875c52f402d0 {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:24:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:33 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Successfully updated port: a45f0c9b-48cc-4434-90c9-875c52f402d0 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:24:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "refresh_cache-c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:24:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquired lock "refresh_cache-c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:24:33 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:24:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-2f947481-4047-4e3a-89de-d6ab8ec62471 req-7b7f5b3c-6a5d-4f0c-bfb5-3ae2c0c3f484 service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Received event network-changed-a45f0c9b-48cc-4434-90c9-875c52f402d0 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-2f947481-4047-4e3a-89de-d6ab8ec62471 req-7b7f5b3c-6a5d-4f0c-bfb5-3ae2c0c3f484 service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Refreshing instance network info cache due to event network-changed-a45f0c9b-48cc-4434-90c9-875c52f402d0. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:24:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2f947481-4047-4e3a-89de-d6ab8ec62471 req-7b7f5b3c-6a5d-4f0c-bfb5-3ae2c0c3f484 service nova] Acquiring lock "refresh_cache-c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:24:33 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:24:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-8f5f63d8-bd98-49d2-8c95-0d0a1f41cd24 req-06e7b82c-2fb4-45d1-a5f9-946ef2197932 service nova] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Received event network-changed-efa7322e-6cca-40b1-9667-83d76383e165 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-8f5f63d8-bd98-49d2-8c95-0d0a1f41cd24 req-06e7b82c-2fb4-45d1-a5f9-946ef2197932 service nova] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Refreshing instance network info cache due to event network-changed-efa7322e-6cca-40b1-9667-83d76383e165. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:24:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8f5f63d8-bd98-49d2-8c95-0d0a1f41cd24 req-06e7b82c-2fb4-45d1-a5f9-946ef2197932 service nova] Acquiring lock "refresh_cache-244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:24:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8f5f63d8-bd98-49d2-8c95-0d0a1f41cd24 req-06e7b82c-2fb4-45d1-a5f9-946ef2197932 service nova] Acquired lock "refresh_cache-244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:24:33 user nova-compute[73497]: DEBUG nova.network.neutron [req-8f5f63d8-bd98-49d2-8c95-0d0a1f41cd24 req-06e7b82c-2fb4-45d1-a5f9-946ef2197932 service nova] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Refreshing network info cache for port efa7322e-6cca-40b1-9667-83d76383e165 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:24:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d2526f44-6f0a-43a0-8a7e-050e6b75a703 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Acquiring lock "244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d2526f44-6f0a-43a0-8a7e-050e6b75a703 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d2526f44-6f0a-43a0-8a7e-050e6b75a703 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Acquiring lock "244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d2526f44-6f0a-43a0-8a7e-050e6b75a703 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d2526f44-6f0a-43a0-8a7e-050e6b75a703 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:33 user nova-compute[73497]: INFO nova.compute.manager [None req-d2526f44-6f0a-43a0-8a7e-050e6b75a703 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Terminating instance
Aug 26 23:24:33 user nova-compute[73497]: DEBUG nova.compute.manager [None req-d2526f44-6f0a-43a0-8a7e-050e6b75a703 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:24:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:34 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Updating instance_info_cache with network_info: [{"id": "a45f0c9b-48cc-4434-90c9-875c52f402d0", "address": "fa:16:3e:87:b8:93", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa45f0c9b-48", "ovs_interfaceid": "a45f0c9b-48cc-4434-90c9-875c52f402d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:24:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Releasing lock "refresh_cache-c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:24:34 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Instance network_info: |[{"id": "a45f0c9b-48cc-4434-90c9-875c52f402d0", "address": "fa:16:3e:87:b8:93", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa45f0c9b-48", "ovs_interfaceid": "a45f0c9b-48cc-4434-90c9-875c52f402d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:24:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2f947481-4047-4e3a-89de-d6ab8ec62471 req-7b7f5b3c-6a5d-4f0c-bfb5-3ae2c0c3f484 service nova] Acquired lock "refresh_cache-c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:24:34 user nova-compute[73497]: DEBUG nova.network.neutron [req-2f947481-4047-4e3a-89de-d6ab8ec62471 req-7b7f5b3c-6a5d-4f0c-bfb5-3ae2c0c3f484 service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Refreshing network info cache for port a45f0c9b-48cc-4434-90c9-875c52f402d0 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:24:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:34 user nova-compute[73497]: DEBUG nova.network.neutron [req-8f5f63d8-bd98-49d2-8c95-0d0a1f41cd24 req-06e7b82c-2fb4-45d1-a5f9-946ef2197932 service nova] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Updated VIF entry in instance network info cache for port efa7322e-6cca-40b1-9667-83d76383e165. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:24:34 user nova-compute[73497]: DEBUG nova.network.neutron [req-8f5f63d8-bd98-49d2-8c95-0d0a1f41cd24 req-06e7b82c-2fb4-45d1-a5f9-946ef2197932 service nova] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Updating instance_info_cache with network_info: [{"id": "efa7322e-6cca-40b1-9667-83d76383e165", "address": "fa:16:3e:e4:78:43", "network": {"id": "e5209dd2-0f09-4bab-b0a6-b486792104a3", "bridge": "br-int", "label": "tempest-TestStampPattern-819945601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a539515b1f47d39d42e182bef80e63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa7322e-6c", "ovs_interfaceid": "efa7322e-6cca-40b1-9667-83d76383e165", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:24:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8f5f63d8-bd98-49d2-8c95-0d0a1f41cd24 req-06e7b82c-2fb4-45d1-a5f9-946ef2197932 service nova] Releasing lock "refresh_cache-244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:24:34 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Instance destroyed successfully.
Aug 26 23:24:34 user nova-compute[73497]: DEBUG nova.objects.instance [None req-d2526f44-6f0a-43a0-8a7e-050e6b75a703 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lazy-loading 'resources' on Instance uuid 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:24:34 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-d2526f44-6f0a-43a0-8a7e-050e6b75a703 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:21:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-699584984',display_name='tempest-TestStampPattern-server-699584984',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-699584984',id=25,image_ref='d9778fd8-4597-4905-9763-d2396509a33e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSpNmqRMbMJd2f6kUSzLECN5mko6NqxFamfd/k4MFhK1XP2WLUCDpa9g6XZBlQKoHW+wuTTi/MsaMFncPcqVt3DKC1QEzKz7chFIzuhFpmCMAj7D379vAGPFvW3AZm1hg==',key_name='tempest-TestStampPattern-584336943',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:21:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04a539515b1f47d39d42e182bef80e63',ramdisk_id='',reservation_id='r-4iwbx061',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='4c68f140-4235-4dcb-b99d-1347bc949d15',image_min_disk='1',image_min_ram='0',image_owner_id='04a539515b1f47d39d42e182bef80e63',image_owner_project_name='tempest-TestStampPattern-2000771312',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2000771312-project-member',image_user_id='0e79225b05f24fb89cb3537ec6d983d9',owner_project_name='tempest-TestStampPattern-2000771312',owner_user_name='tempest-TestStampPattern-2000771312-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:21:41Z,user_data=None,user_id='0e79225b05f24fb89cb3537ec6d983d9',uuid=244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "efa7322e-6cca-40b1-9667-83d76383e165", "address": "fa:16:3e:e4:78:43", "network": {"id": "e5209dd2-0f09-4bab-b0a6-b486792104a3", "bridge": "br-int", "label": "tempest-TestStampPattern-819945601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a539515b1f47d39d42e182bef80e63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa7322e-6c", "ovs_interfaceid": "efa7322e-6cca-40b1-9667-83d76383e165", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:24:34 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-d2526f44-6f0a-43a0-8a7e-050e6b75a703 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Converting VIF {"id": "efa7322e-6cca-40b1-9667-83d76383e165", "address": "fa:16:3e:e4:78:43", "network": {"id": "e5209dd2-0f09-4bab-b0a6-b486792104a3", "bridge": "br-int", "label": "tempest-TestStampPattern-819945601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a539515b1f47d39d42e182bef80e63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa7322e-6c", "ovs_interfaceid": "efa7322e-6cca-40b1-9667-83d76383e165", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:24:34 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-d2526f44-6f0a-43a0-8a7e-050e6b75a703 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:78:43,bridge_name='br-int',has_traffic_filtering=True,id=efa7322e-6cca-40b1-9667-83d76383e165,network=Network(e5209dd2-0f09-4bab-b0a6-b486792104a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefa7322e-6c') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:24:34 user nova-compute[73497]: DEBUG os_vif [None req-d2526f44-6f0a-43a0-8a7e-050e6b75a703 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:78:43,bridge_name='br-int',has_traffic_filtering=True,id=efa7322e-6cca-40b1-9667-83d76383e165,network=Network(e5209dd2-0f09-4bab-b0a6-b486792104a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefa7322e-6c') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:24:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapefa7322e-6c, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:24:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:24:34 user nova-compute[73497]: INFO os_vif [None req-d2526f44-6f0a-43a0-8a7e-050e6b75a703 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:78:43,bridge_name='br-int',has_traffic_filtering=True,id=efa7322e-6cca-40b1-9667-83d76383e165,network=Network(e5209dd2-0f09-4bab-b0a6-b486792104a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefa7322e-6c')
Aug 26 23:24:34 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-d2526f44-6f0a-43a0-8a7e-050e6b75a703 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Deleting instance files /opt/stack/data/nova/instances/244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35_del
Aug 26 23:24:34 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-d2526f44-6f0a-43a0-8a7e-050e6b75a703 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Deletion of /opt/stack/data/nova/instances/244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35_del complete
Aug 26 23:24:34 user nova-compute[73497]: INFO nova.compute.manager [None req-d2526f44-6f0a-43a0-8a7e-050e6b75a703 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 26 23:24:34 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-d2526f44-6f0a-43a0-8a7e-050e6b75a703 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:24:34 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:24:34 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:24:35 user nova-compute[73497]: DEBUG nova.network.neutron [req-2f947481-4047-4e3a-89de-d6ab8ec62471 req-7b7f5b3c-6a5d-4f0c-bfb5-3ae2c0c3f484 service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Updated VIF entry in instance network info cache for port a45f0c9b-48cc-4434-90c9-875c52f402d0. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:24:35 user nova-compute[73497]: DEBUG nova.network.neutron [req-2f947481-4047-4e3a-89de-d6ab8ec62471 req-7b7f5b3c-6a5d-4f0c-bfb5-3ae2c0c3f484 service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Updating instance_info_cache with network_info: [{"id": "a45f0c9b-48cc-4434-90c9-875c52f402d0", "address": "fa:16:3e:87:b8:93", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa45f0c9b-48", "ovs_interfaceid": "a45f0c9b-48cc-4434-90c9-875c52f402d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:24:35 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:24:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2f947481-4047-4e3a-89de-d6ab8ec62471 req-7b7f5b3c-6a5d-4f0c-bfb5-3ae2c0c3f484 service nova] Releasing lock "refresh_cache-c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:24:35 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Took 0.61 seconds to deallocate network for instance.
Aug 26 23:24:35 user nova-compute[73497]: DEBUG nova.compute.manager [req-f473eb2d-ef17-4e4b-a02a-fa6a86c4115b req-05c59e87-42e5-4ab9-a366-67440d71b65b service nova] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Received event network-vif-deleted-efa7322e-6cca-40b1-9667-83d76383e165 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:35 user nova-compute[73497]: INFO nova.compute.manager [req-f473eb2d-ef17-4e4b-a02a-fa6a86c4115b req-05c59e87-42e5-4ab9-a366-67440d71b65b service nova] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Neutron deleted interface efa7322e-6cca-40b1-9667-83d76383e165; detaching it from the instance and deleting it from the info cache
Aug 26 23:24:35 user nova-compute[73497]: DEBUG nova.network.neutron [req-f473eb2d-ef17-4e4b-a02a-fa6a86c4115b req-05c59e87-42e5-4ab9-a366-67440d71b65b service nova] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:24:35 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092275.317962, 6df9ebc6-0b6a-4cdc-811d-d43be88958f7 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:24:35 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] VM Resumed (Lifecycle Event)
Aug 26 23:24:35 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:24:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:24:35 user nova-compute[73497]: DEBUG nova.compute.manager [req-f473eb2d-ef17-4e4b-a02a-fa6a86c4115b req-05c59e87-42e5-4ab9-a366-67440d71b65b service nova] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Detach interface failed, port_id=efa7322e-6cca-40b1-9667-83d76383e165, reason: Instance 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35 could not be found. {{(pid=73497) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 23:24:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d2526f44-6f0a-43a0-8a7e-050e6b75a703 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d2526f44-6f0a-43a0-8a7e-050e6b75a703 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:35 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:24:35 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Instance spawned successfully.
Aug 26 23:24:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:24:35 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:24:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:24:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:24:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:24:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:24:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:24:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:24:35 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:24:35 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092275.3193154, 6df9ebc6-0b6a-4cdc-811d-d43be88958f7 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:24:35 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] VM Started (Lifecycle Event)
Aug 26 23:24:35 user nova-compute[73497]: DEBUG nova.compute.manager [req-9a5e9565-e030-4f20-9aeb-f0818c20b999 req-824a91fc-ae43-45ad-9b3f-0e36e350b581 service nova] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Received event network-vif-unplugged-efa7322e-6cca-40b1-9667-83d76383e165 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9a5e9565-e030-4f20-9aeb-f0818c20b999 req-824a91fc-ae43-45ad-9b3f-0e36e350b581 service nova] Acquiring lock "244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9a5e9565-e030-4f20-9aeb-f0818c20b999 req-824a91fc-ae43-45ad-9b3f-0e36e350b581 service nova] Lock "244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9a5e9565-e030-4f20-9aeb-f0818c20b999 req-824a91fc-ae43-45ad-9b3f-0e36e350b581 service nova] Lock "244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:35 user nova-compute[73497]: DEBUG nova.compute.manager [req-9a5e9565-e030-4f20-9aeb-f0818c20b999 req-824a91fc-ae43-45ad-9b3f-0e36e350b581 service nova] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] No waiting events found dispatching network-vif-unplugged-efa7322e-6cca-40b1-9667-83d76383e165 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:24:35 user nova-compute[73497]: WARNING nova.compute.manager [req-9a5e9565-e030-4f20-9aeb-f0818c20b999 req-824a91fc-ae43-45ad-9b3f-0e36e350b581 service nova] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Received unexpected event network-vif-unplugged-efa7322e-6cca-40b1-9667-83d76383e165 for instance with vm_state deleted and task_state None.
Aug 26 23:24:35 user nova-compute[73497]: DEBUG nova.compute.manager [req-9a5e9565-e030-4f20-9aeb-f0818c20b999 req-824a91fc-ae43-45ad-9b3f-0e36e350b581 service nova] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Received event network-vif-plugged-efa7322e-6cca-40b1-9667-83d76383e165 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9a5e9565-e030-4f20-9aeb-f0818c20b999 req-824a91fc-ae43-45ad-9b3f-0e36e350b581 service nova] Acquiring lock "244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9a5e9565-e030-4f20-9aeb-f0818c20b999 req-824a91fc-ae43-45ad-9b3f-0e36e350b581 service nova] Lock "244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9a5e9565-e030-4f20-9aeb-f0818c20b999 req-824a91fc-ae43-45ad-9b3f-0e36e350b581 service nova] Lock "244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:35 user nova-compute[73497]: DEBUG nova.compute.manager [req-9a5e9565-e030-4f20-9aeb-f0818c20b999 req-824a91fc-ae43-45ad-9b3f-0e36e350b581 service nova] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] No waiting events found dispatching network-vif-plugged-efa7322e-6cca-40b1-9667-83d76383e165 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:24:35 user nova-compute[73497]: WARNING nova.compute.manager [req-9a5e9565-e030-4f20-9aeb-f0818c20b999 req-824a91fc-ae43-45ad-9b3f-0e36e350b581 service nova] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Received unexpected event network-vif-plugged-efa7322e-6cca-40b1-9667-83d76383e165 for instance with vm_state deleted and task_state None.
Aug 26 23:24:35 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:24:35 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:24:35 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:24:35 user nova-compute[73497]: INFO nova.compute.manager [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Took 7.68 seconds to spawn the instance on the hypervisor.
Aug 26 23:24:35 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:24:35 user nova-compute[73497]: INFO nova.compute.manager [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Took 8.54 seconds to build instance.
Aug 26 23:24:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9a7c97d4-03c1-47bc-97ce-a0cd751159d9 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Lock "6df9ebc6-0b6a-4cdc-811d-d43be88958f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.642s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:35 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-d2526f44-6f0a-43a0-8a7e-050e6b75a703 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:24:35 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-d2526f44-6f0a-43a0-8a7e-050e6b75a703 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:24:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d2526f44-6f0a-43a0-8a7e-050e6b75a703 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.460s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:35 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-d2526f44-6f0a-43a0-8a7e-050e6b75a703 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Deleted allocations for instance 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35
Aug 26 23:24:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d2526f44-6f0a-43a0-8a7e-050e6b75a703 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.264s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Acquiring lock "e9a5de88-37f0-4953-92a2-6f8db0b2f02e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Lock "e9a5de88-37f0-4953-92a2-6f8db0b2f02e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:36 user nova-compute[73497]: DEBUG nova.compute.manager [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:24:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:36 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:24:36 user nova-compute[73497]: INFO nova.compute.claims [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Claim successful on node user
Aug 26 23:24:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:36 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:24:36 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:24:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.509s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:36 user nova-compute[73497]: DEBUG nova.compute.manager [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:24:37 user nova-compute[73497]: DEBUG nova.compute.manager [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:24:37 user nova-compute[73497]: DEBUG nova.network.neutron [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:24:37 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:24:37 user nova-compute[73497]: DEBUG nova.compute.manager [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:24:37 user nova-compute[73497]: DEBUG nova.policy [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39d36154f45848ecae45e455b5b150cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951ffc97c25a4d7b90efa5bb5cfd269c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:24:37 user nova-compute[73497]: DEBUG nova.compute.manager [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:24:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:24:37 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Creating image(s)
Aug 26 23:24:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Acquiring lock "/opt/stack/data/nova/instances/e9a5de88-37f0-4953-92a2-6f8db0b2f02e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Lock "/opt/stack/data/nova/instances/e9a5de88-37f0-4953-92a2-6f8db0b2f02e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Lock "/opt/stack/data/nova/instances/e9a5de88-37f0-4953-92a2-6f8db0b2f02e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:37 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:37 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.207s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:37 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:37 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.178s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:37 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/e9a5de88-37f0-4953-92a2-6f8db0b2f02e/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:37 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/e9a5de88-37f0-4953-92a2-6f8db0b2f02e/disk 1073741824" returned: 0 in 0.051s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:37 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:37 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.208s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:37 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e9a5de88-37f0-4953-92a2-6f8db0b2f02e/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:24:37 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a5de88-37f0-4953-92a2-6f8db0b2f02e/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:37 user nova-compute[73497]: DEBUG nova.network.neutron [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Successfully created port: 79673cd5-e4d0-44ac-b415-92e80db4d291 {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:24:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a5de88-37f0-4953-92a2-6f8db0b2f02e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:38 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Cannot resize image /opt/stack/data/nova/instances/e9a5de88-37f0-4953-92a2-6f8db0b2f02e/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:24:38 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:24:38 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Ensure instance console log exists: /opt/stack/data/nova/instances/e9a5de88-37f0-4953-92a2-6f8db0b2f02e/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:24:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:38 user nova-compute[73497]: DEBUG nova.compute.manager [req-04947a96-98b8-4f79-a1ec-29c15842c1eb req-85f54101-bdc4-448f-8f8b-2a227bce2bdf service nova] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Received event network-vif-plugged-09704f88-352c-4a21-8e61-f2b25818658d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-04947a96-98b8-4f79-a1ec-29c15842c1eb req-85f54101-bdc4-448f-8f8b-2a227bce2bdf service nova] Acquiring lock "6df9ebc6-0b6a-4cdc-811d-d43be88958f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-04947a96-98b8-4f79-a1ec-29c15842c1eb req-85f54101-bdc4-448f-8f8b-2a227bce2bdf service nova] Lock "6df9ebc6-0b6a-4cdc-811d-d43be88958f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-04947a96-98b8-4f79-a1ec-29c15842c1eb req-85f54101-bdc4-448f-8f8b-2a227bce2bdf service nova] Lock "6df9ebc6-0b6a-4cdc-811d-d43be88958f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:38 user nova-compute[73497]: DEBUG nova.compute.manager [req-04947a96-98b8-4f79-a1ec-29c15842c1eb req-85f54101-bdc4-448f-8f8b-2a227bce2bdf service nova] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] No waiting events found dispatching network-vif-plugged-09704f88-352c-4a21-8e61-f2b25818658d {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:24:38 user nova-compute[73497]: WARNING nova.compute.manager [req-04947a96-98b8-4f79-a1ec-29c15842c1eb req-85f54101-bdc4-448f-8f8b-2a227bce2bdf service nova] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Received unexpected event network-vif-plugged-09704f88-352c-4a21-8e61-f2b25818658d for instance with vm_state active and task_state None.
Aug 26 23:24:38 user nova-compute[73497]: DEBUG nova.network.neutron [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Successfully updated port: 79673cd5-e4d0-44ac-b415-92e80db4d291 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:24:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Acquiring lock "refresh_cache-e9a5de88-37f0-4953-92a2-6f8db0b2f02e" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:24:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Acquired lock "refresh_cache-e9a5de88-37f0-4953-92a2-6f8db0b2f02e" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:24:38 user nova-compute[73497]: DEBUG nova.network.neutron [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:24:38 user nova-compute[73497]: DEBUG nova.compute.manager [req-68fe805d-dc43-4562-8e5f-c9b6647c4ed9 req-38065e61-2a40-4514-8c5c-d041ff6ff43e service nova] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Received event network-changed-79673cd5-e4d0-44ac-b415-92e80db4d291 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:38 user nova-compute[73497]: DEBUG nova.compute.manager [req-68fe805d-dc43-4562-8e5f-c9b6647c4ed9 req-38065e61-2a40-4514-8c5c-d041ff6ff43e service nova] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Refreshing instance network info cache due to event network-changed-79673cd5-e4d0-44ac-b415-92e80db4d291. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:24:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-68fe805d-dc43-4562-8e5f-c9b6647c4ed9 req-38065e61-2a40-4514-8c5c-d041ff6ff43e service nova] Acquiring lock "refresh_cache-e9a5de88-37f0-4953-92a2-6f8db0b2f02e" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:24:38 user nova-compute[73497]: DEBUG nova.network.neutron [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG nova.network.neutron [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Updating instance_info_cache with network_info: [{"id": "79673cd5-e4d0-44ac-b415-92e80db4d291", "address": "fa:16:3e:28:8d:81", "network": {"id": "35aa126f-8000-48cf-86c1-d57dbbb8c4d2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1248937097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "951ffc97c25a4d7b90efa5bb5cfd269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79673cd5-e4", "ovs_interfaceid": "79673cd5-e4d0-44ac-b415-92e80db4d291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Releasing lock "refresh_cache-e9a5de88-37f0-4953-92a2-6f8db0b2f02e" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG nova.compute.manager [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Instance network_info: |[{"id": "79673cd5-e4d0-44ac-b415-92e80db4d291", "address": "fa:16:3e:28:8d:81", "network": {"id": "35aa126f-8000-48cf-86c1-d57dbbb8c4d2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1248937097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "951ffc97c25a4d7b90efa5bb5cfd269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79673cd5-e4", "ovs_interfaceid": "79673cd5-e4d0-44ac-b415-92e80db4d291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-68fe805d-dc43-4562-8e5f-c9b6647c4ed9 req-38065e61-2a40-4514-8c5c-d041ff6ff43e service nova] Acquired lock "refresh_cache-e9a5de88-37f0-4953-92a2-6f8db0b2f02e" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG nova.network.neutron [req-68fe805d-dc43-4562-8e5f-c9b6647c4ed9 req-38065e61-2a40-4514-8c5c-d041ff6ff43e service nova] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Refreshing network info cache for port 79673cd5-e4d0-44ac-b415-92e80db4d291 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Start _get_guest_xml network_info=[{"id": "79673cd5-e4d0-44ac-b415-92e80db4d291", "address": "fa:16:3e:28:8d:81", "network": {"id": "35aa126f-8000-48cf-86c1-d57dbbb8c4d2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1248937097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "951ffc97c25a4d7b90efa5bb5cfd269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79673cd5-e4", "ovs_interfaceid": "79673cd5-e4d0-44ac-b415-92e80db4d291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:24:39 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:24:39 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:24:39 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:24:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1218607007',display_name='tempest-VolumesActionsTest-instance-1218607007',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1218607007',id=28,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='951ffc97c25a4d7b90efa5bb5cfd269c',ramdisk_id='',reservation_id='r-bopomv0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1831950157',owner_user_name='tempest-VolumesActionsTest-1831950157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:24:37Z,user_data=None,user_id='39d36154f45848ecae45e455b5b150cd',uuid=e9a5de88-37f0-4953-92a2-6f8db0b2f02e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79673cd5-e4d0-44ac-b415-92e80db4d291", "address": "fa:16:3e:28:8d:81", "network": {"id": "35aa126f-8000-48cf-86c1-d57dbbb8c4d2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1248937097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "951ffc97c25a4d7b90efa5bb5cfd269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79673cd5-e4", "ovs_interfaceid": "79673cd5-e4d0-44ac-b415-92e80db4d291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Converting VIF {"id": "79673cd5-e4d0-44ac-b415-92e80db4d291", "address": "fa:16:3e:28:8d:81", "network": {"id": "35aa126f-8000-48cf-86c1-d57dbbb8c4d2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1248937097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "951ffc97c25a4d7b90efa5bb5cfd269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79673cd5-e4", "ovs_interfaceid": "79673cd5-e4d0-44ac-b415-92e80db4d291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:8d:81,bridge_name='br-int',has_traffic_filtering=True,id=79673cd5-e4d0-44ac-b415-92e80db4d291,network=Network(35aa126f-8000-48cf-86c1-d57dbbb8c4d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79673cd5-e4') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG nova.objects.instance [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Lazy-loading 'pci_devices' on Instance uuid e9a5de88-37f0-4953-92a2-6f8db0b2f02e {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:24:39 user nova-compute[73497]:   <uuid>e9a5de88-37f0-4953-92a2-6f8db0b2f02e</uuid>
Aug 26 23:24:39 user nova-compute[73497]:   <name>instance-0000001c</name>
Aug 26 23:24:39 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:24:39 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:24:39 user nova-compute[73497]:   <metadata>
Aug 26 23:24:39 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:24:39 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:24:39 user nova-compute[73497]:       <nova:name>tempest-VolumesActionsTest-instance-1218607007</nova:name>
Aug 26 23:24:39 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:24:39</nova:creationTime>
Aug 26 23:24:39 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:24:39 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:24:39 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:24:39 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:24:39 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:24:39 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:24:39 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:24:39 user nova-compute[73497]:       <nova:owner>
Aug 26 23:24:39 user nova-compute[73497]:         <nova:user uuid="39d36154f45848ecae45e455b5b150cd">tempest-VolumesActionsTest-1831950157-project-member</nova:user>
Aug 26 23:24:39 user nova-compute[73497]:         <nova:project uuid="951ffc97c25a4d7b90efa5bb5cfd269c">tempest-VolumesActionsTest-1831950157</nova:project>
Aug 26 23:24:39 user nova-compute[73497]:       </nova:owner>
Aug 26 23:24:39 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:24:39 user nova-compute[73497]:       <nova:ports>
Aug 26 23:24:39 user nova-compute[73497]:         <nova:port uuid="79673cd5-e4d0-44ac-b415-92e80db4d291">
Aug 26 23:24:39 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 23:24:39 user nova-compute[73497]:         </nova:port>
Aug 26 23:24:39 user nova-compute[73497]:       </nova:ports>
Aug 26 23:24:39 user nova-compute[73497]:     </nova:instance>
Aug 26 23:24:39 user nova-compute[73497]:   </metadata>
Aug 26 23:24:39 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:24:39 user nova-compute[73497]:     <system>
Aug 26 23:24:39 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:24:39 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:24:39 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:24:39 user nova-compute[73497]:       <entry name="serial">e9a5de88-37f0-4953-92a2-6f8db0b2f02e</entry>
Aug 26 23:24:39 user nova-compute[73497]:       <entry name="uuid">e9a5de88-37f0-4953-92a2-6f8db0b2f02e</entry>
Aug 26 23:24:39 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:24:39 user nova-compute[73497]:     </system>
Aug 26 23:24:39 user nova-compute[73497]:   </sysinfo>
Aug 26 23:24:39 user nova-compute[73497]:   <os>
Aug 26 23:24:39 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:24:39 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:24:39 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:24:39 user nova-compute[73497]:   </os>
Aug 26 23:24:39 user nova-compute[73497]:   <features>
Aug 26 23:24:39 user nova-compute[73497]:     <acpi/>
Aug 26 23:24:39 user nova-compute[73497]:     <apic/>
Aug 26 23:24:39 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:24:39 user nova-compute[73497]:   </features>
Aug 26 23:24:39 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:24:39 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:24:39 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:24:39 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:24:39 user nova-compute[73497]:   </clock>
Aug 26 23:24:39 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:24:39 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:24:39 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:24:39 user nova-compute[73497]:   </cpu>
Aug 26 23:24:39 user nova-compute[73497]:   <devices>
Aug 26 23:24:39 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:24:39 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:24:39 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/e9a5de88-37f0-4953-92a2-6f8db0b2f02e/disk"/>
Aug 26 23:24:39 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:24:39 user nova-compute[73497]:     </disk>
Aug 26 23:24:39 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:24:39 user nova-compute[73497]:       <mac address="fa:16:3e:28:8d:81"/>
Aug 26 23:24:39 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:24:39 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:24:39 user nova-compute[73497]:       <target dev="tap79673cd5-e4"/>
Aug 26 23:24:39 user nova-compute[73497]:     </interface>
Aug 26 23:24:39 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:24:39 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/e9a5de88-37f0-4953-92a2-6f8db0b2f02e/console.log" append="off"/>
Aug 26 23:24:39 user nova-compute[73497]:     </serial>
Aug 26 23:24:39 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:24:39 user nova-compute[73497]:     <video>
Aug 26 23:24:39 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:24:39 user nova-compute[73497]:     </video>
Aug 26 23:24:39 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:24:39 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:24:39 user nova-compute[73497]:     </rng>
Aug 26 23:24:39 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:24:39 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:24:39 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:24:39 user nova-compute[73497]:     </memballoon>
Aug 26 23:24:39 user nova-compute[73497]:   </devices>
Aug 26 23:24:39 user nova-compute[73497]: </domain>
Aug 26 23:24:39 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:24:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1218607007',display_name='tempest-VolumesActionsTest-instance-1218607007',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1218607007',id=28,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='951ffc97c25a4d7b90efa5bb5cfd269c',ramdisk_id='',reservation_id='r-bopomv0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1831950157',owner_user_name='tempest-VolumesActionsTest-1831950157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:24:37Z,user_data=None,user_id='39d36154f45848ecae45e455b5b150cd',uuid=e9a5de88-37f0-4953-92a2-6f8db0b2f02e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79673cd5-e4d0-44ac-b415-92e80db4d291", "address": "fa:16:3e:28:8d:81", "network": {"id": "35aa126f-8000-48cf-86c1-d57dbbb8c4d2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1248937097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "951ffc97c25a4d7b90efa5bb5cfd269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79673cd5-e4", "ovs_interfaceid": "79673cd5-e4d0-44ac-b415-92e80db4d291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Converting VIF {"id": "79673cd5-e4d0-44ac-b415-92e80db4d291", "address": "fa:16:3e:28:8d:81", "network": {"id": "35aa126f-8000-48cf-86c1-d57dbbb8c4d2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1248937097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "951ffc97c25a4d7b90efa5bb5cfd269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79673cd5-e4", "ovs_interfaceid": "79673cd5-e4d0-44ac-b415-92e80db4d291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:8d:81,bridge_name='br-int',has_traffic_filtering=True,id=79673cd5-e4d0-44ac-b415-92e80db4d291,network=Network(35aa126f-8000-48cf-86c1-d57dbbb8c4d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79673cd5-e4') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG os_vif [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:8d:81,bridge_name='br-int',has_traffic_filtering=True,id=79673cd5-e4d0-44ac-b415-92e80db4d291,network=Network(35aa126f-8000-48cf-86c1-d57dbbb8c4d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79673cd5-e4') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79673cd5-e4, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap79673cd5-e4, col_values=(('external_ids', {'iface-id': '79673cd5-e4d0-44ac-b415-92e80db4d291', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:8d:81', 'vm-uuid': 'e9a5de88-37f0-4953-92a2-6f8db0b2f02e'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:39 user nova-compute[73497]: INFO os_vif [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:8d:81,bridge_name='br-int',has_traffic_filtering=True,id=79673cd5-e4d0-44ac-b415-92e80db4d291,network=Network(35aa126f-8000-48cf-86c1-d57dbbb8c4d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79673cd5-e4')
Aug 26 23:24:39 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] No VIF found with MAC fa:16:3e:28:8d:81, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d13290df-b952-4112-b1fc-722782750335 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Acquiring lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d13290df-b952-4112-b1fc-722782750335 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:39 user nova-compute[73497]: INFO nova.compute.manager [None req-d13290df-b952-4112-b1fc-722782750335 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Detaching volume 00fbc86c-3cce-40a9-83b5-dbbf5bf49662
Aug 26 23:24:39 user nova-compute[73497]: INFO nova.virt.block_device [None req-d13290df-b952-4112-b1fc-722782750335 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Attempting to driver detach volume 00fbc86c-3cce-40a9-83b5-dbbf5bf49662 from mountpoint /dev/vdb
Aug 26 23:24:39 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d13290df-b952-4112-b1fc-722782750335 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Attempting to detach device vdb from instance 7c124dd9-4dce-4c6f-925c-6eda8e187d84 from the persistent domain config. {{(pid=73497) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-d13290df-b952-4112-b1fc-722782750335 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:24:39 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:24:39 user nova-compute[73497]:   <source dev="/dev/sdk"/>
Aug 26 23:24:39 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:24:39 user nova-compute[73497]:   <serial>00fbc86c-3cce-40a9-83b5-dbbf5bf49662</serial>
Aug 26 23:24:39 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:24:39 user nova-compute[73497]: </disk>
Aug 26 23:24:39 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:24:39 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-d13290df-b952-4112-b1fc-722782750335 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Successfully detached device vdb from instance 7c124dd9-4dce-4c6f-925c-6eda8e187d84 from the persistent domain config.
Aug 26 23:24:39 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d13290df-b952-4112-b1fc-722782750335 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7c124dd9-4dce-4c6f-925c-6eda8e187d84 from the live domain config. {{(pid=73497) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-d13290df-b952-4112-b1fc-722782750335 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:24:39 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:24:39 user nova-compute[73497]:   <source dev="/dev/sdk"/>
Aug 26 23:24:39 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:24:39 user nova-compute[73497]:   <serial>00fbc86c-3cce-40a9-83b5-dbbf5bf49662</serial>
Aug 26 23:24:39 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:24:39 user nova-compute[73497]: </disk>
Aug 26 23:24:39 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG nova.network.neutron [req-68fe805d-dc43-4562-8e5f-c9b6647c4ed9 req-38065e61-2a40-4514-8c5c-d041ff6ff43e service nova] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Updated VIF entry in instance network info cache for port 79673cd5-e4d0-44ac-b415-92e80db4d291. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG nova.network.neutron [req-68fe805d-dc43-4562-8e5f-c9b6647c4ed9 req-38065e61-2a40-4514-8c5c-d041ff6ff43e service nova] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Updating instance_info_cache with network_info: [{"id": "79673cd5-e4d0-44ac-b415-92e80db4d291", "address": "fa:16:3e:28:8d:81", "network": {"id": "35aa126f-8000-48cf-86c1-d57dbbb8c4d2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1248937097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "951ffc97c25a4d7b90efa5bb5cfd269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79673cd5-e4", "ovs_interfaceid": "79673cd5-e4d0-44ac-b415-92e80db4d291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:24:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-68fe805d-dc43-4562-8e5f-c9b6647c4ed9 req-38065e61-2a40-4514-8c5c-d041ff6ff43e service nova] Releasing lock "refresh_cache-e9a5de88-37f0-4953-92a2-6f8db0b2f02e" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG nova.compute.manager [req-a44157b5-9f41-4c00-8b20-123500c7bcac req-c03d1fb9-06b2-465e-bb80-70133db0c251 service nova] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Received event network-vif-plugged-09704f88-352c-4a21-8e61-f2b25818658d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a44157b5-9f41-4c00-8b20-123500c7bcac req-c03d1fb9-06b2-465e-bb80-70133db0c251 service nova] Acquiring lock "6df9ebc6-0b6a-4cdc-811d-d43be88958f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a44157b5-9f41-4c00-8b20-123500c7bcac req-c03d1fb9-06b2-465e-bb80-70133db0c251 service nova] Lock "6df9ebc6-0b6a-4cdc-811d-d43be88958f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a44157b5-9f41-4c00-8b20-123500c7bcac req-c03d1fb9-06b2-465e-bb80-70133db0c251 service nova] Lock "6df9ebc6-0b6a-4cdc-811d-d43be88958f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG nova.compute.manager [req-a44157b5-9f41-4c00-8b20-123500c7bcac req-c03d1fb9-06b2-465e-bb80-70133db0c251 service nova] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] No waiting events found dispatching network-vif-plugged-09704f88-352c-4a21-8e61-f2b25818658d {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:24:40 user nova-compute[73497]: WARNING nova.compute.manager [req-a44157b5-9f41-4c00-8b20-123500c7bcac req-c03d1fb9-06b2-465e-bb80-70133db0c251 service nova] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Received unexpected event network-vif-plugged-09704f88-352c-4a21-8e61-f2b25818658d for instance with vm_state active and task_state None.
Aug 26 23:24:40 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Received event <DeviceRemovedEvent: 1693092280.4647124, 7c124dd9-4dce-4c6f-925c-6eda8e187d84 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73497) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d13290df-b952-4112-b1fc-722782750335 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7c124dd9-4dce-4c6f-925c-6eda8e187d84 {{(pid=73497) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 23:24:40 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-d13290df-b952-4112-b1fc-722782750335 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Successfully detached device vdb from instance 7c124dd9-4dce-4c6f-925c-6eda8e187d84 from the live domain config.
Aug 26 23:24:40 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d13290df-b952-4112-b1fc-722782750335 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d13290df-b952-4112-b1fc-722782750335 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoxmeCnv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:24:40 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-d13290df-b952-4112-b1fc-722782750335 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:24:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-d13290df-b952-4112-b1fc-722782750335 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-d13290df-b952-4112-b1fc-722782750335 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d13290df-b952-4112-b1fc-722782750335 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6bedbf-56b8-4476-a844-7e7eaa205ae7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[219b0820-92c6-4870-b6c6-fb8989145591]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d13290df-b952-4112-b1fc-722782750335 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:24:40 user nova-compute[73497]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)
Aug 26 23:24:40 user nova-compute[73497]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:24:40 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d13290df-b952-4112-b1fc-722782750335 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:24:40 user nova-compute[73497]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 (non-flash)
Aug 26 23:24:40 user nova-compute[73497]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:24:40 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d13290df-b952-4112-b1fc-722782750335 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282c0e0d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662'): ({'sdk'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-d13290df-b952-4112-b1fc-722782750335 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Removing single pathed devices sdk {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[316f8cf0-124a-41c0-8931-43fdb0635008]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c42d88-600c-4d8e-9aac-c31893951127]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-d13290df-b952-4112-b1fc-722782750335 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Flushing IO for device /dev/sdk {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.013s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[368dc64e-7fab-458b-9c35-1e3ec23c3f9b]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-d13290df-b952-4112-b1fc-722782750335 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.035s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11bceb5-0847-4ce5-9e02-b3edf45a6699]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-d13290df-b952-4112-b1fc-722782750335 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-d13290df-b952-4112-b1fc-722782750335 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] SCSI volumes sdk have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d13290df-b952-4112-b1fc-722782750335 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[072a62da-9bfe-4b3b-98ad-60fa825853f0]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d13290df-b952-4112-b1fc-722782750335 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acebf6c-5d78-4277-8168-ae1038c6989a]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d13290df-b952-4112-b1fc-722782750335 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662, portal: 172.16.0.220,3260]
Aug 26 23:24:40 user nova-compute[73497]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662, portal: 172.16.0.220,3260] successful.
Aug 26 23:24:40 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc86c-3cce-40a9-83b5-dbbf5bf49662 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bd67fe-8b49-463d-830e-6e37a242db1f]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d13290df-b952-4112-b1fc-722782750335 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-d13290df-b952-4112-b1fc-722782750335 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d13290df-b952-4112-b1fc-722782750335 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] <== disconnect_volume: return (286ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:24:40 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d13290df-b952-4112-b1fc-722782750335 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:24:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:41 user nova-compute[73497]: DEBUG nova.compute.manager [req-f67187ac-0ffc-46df-929e-02a54f16ab39 req-2c9ec05b-ec59-40a6-b650-d1597d082035 service nova] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Received event network-vif-plugged-79673cd5-e4d0-44ac-b415-92e80db4d291 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f67187ac-0ffc-46df-929e-02a54f16ab39 req-2c9ec05b-ec59-40a6-b650-d1597d082035 service nova] Acquiring lock "e9a5de88-37f0-4953-92a2-6f8db0b2f02e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f67187ac-0ffc-46df-929e-02a54f16ab39 req-2c9ec05b-ec59-40a6-b650-d1597d082035 service nova] Lock "e9a5de88-37f0-4953-92a2-6f8db0b2f02e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f67187ac-0ffc-46df-929e-02a54f16ab39 req-2c9ec05b-ec59-40a6-b650-d1597d082035 service nova] Lock "e9a5de88-37f0-4953-92a2-6f8db0b2f02e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:41 user nova-compute[73497]: DEBUG nova.compute.manager [req-f67187ac-0ffc-46df-929e-02a54f16ab39 req-2c9ec05b-ec59-40a6-b650-d1597d082035 service nova] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] No waiting events found dispatching network-vif-plugged-79673cd5-e4d0-44ac-b415-92e80db4d291 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:24:41 user nova-compute[73497]: WARNING nova.compute.manager [req-f67187ac-0ffc-46df-929e-02a54f16ab39 req-2c9ec05b-ec59-40a6-b650-d1597d082035 service nova] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Received unexpected event network-vif-plugged-79673cd5-e4d0-44ac-b415-92e80db4d291 for instance with vm_state building and task_state spawning.
Aug 26 23:24:41 user nova-compute[73497]: DEBUG nova.objects.instance [None req-d13290df-b952-4112-b1fc-722782750335 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lazy-loading 'flavor' on Instance uuid 7c124dd9-4dce-4c6f-925c-6eda8e187d84 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:24:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d13290df-b952-4112-b1fc-722782750335 tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.275s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:42 user nova-compute[73497]: DEBUG os_brick.utils [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:24:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:42 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[093013f3-a23c-4d86-b7ed-7ed96540af01]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:42 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[94079095-b4d2-460d-bf9f-7a30f7bbdc7c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:42 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[22952139-43cd-4451-8a37-44375f9686aa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:42 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7af9b0-0990-4db0-bfa4-90930e07e2df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:24:42 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:24:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:24:42 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:24:42 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fd8ebd-2162-4f57-bd63-397152bad3fb]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:42 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:24:42 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:24:42 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:24:42 user nova-compute[73497]: DEBUG os_brick.utils [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:24:42 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Updating existing volume attachment record: 637b6680-de38-49fb-8e19-b102aea8b24b {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:24:43 user nova-compute[73497]: DEBUG nova.compute.manager [req-a26eea86-a870-4bd7-a53a-864dab854ee4 req-1a20db2b-f36f-4809-82c6-725327c6e782 service nova] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Received event network-vif-plugged-79673cd5-e4d0-44ac-b415-92e80db4d291 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a26eea86-a870-4bd7-a53a-864dab854ee4 req-1a20db2b-f36f-4809-82c6-725327c6e782 service nova] Acquiring lock "e9a5de88-37f0-4953-92a2-6f8db0b2f02e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a26eea86-a870-4bd7-a53a-864dab854ee4 req-1a20db2b-f36f-4809-82c6-725327c6e782 service nova] Lock "e9a5de88-37f0-4953-92a2-6f8db0b2f02e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a26eea86-a870-4bd7-a53a-864dab854ee4 req-1a20db2b-f36f-4809-82c6-725327c6e782 service nova] Lock "e9a5de88-37f0-4953-92a2-6f8db0b2f02e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:43 user nova-compute[73497]: DEBUG nova.compute.manager [req-a26eea86-a870-4bd7-a53a-864dab854ee4 req-1a20db2b-f36f-4809-82c6-725327c6e782 service nova] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] No waiting events found dispatching network-vif-plugged-79673cd5-e4d0-44ac-b415-92e80db4d291 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:24:43 user nova-compute[73497]: WARNING nova.compute.manager [req-a26eea86-a870-4bd7-a53a-864dab854ee4 req-1a20db2b-f36f-4809-82c6-725327c6e782 service nova] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Received unexpected event network-vif-plugged-79673cd5-e4d0-44ac-b415-92e80db4d291 for instance with vm_state building and task_state spawning.
Aug 26 23:24:43 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092283.612743, e9a5de88-37f0-4953-92a2-6f8db0b2f02e => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:24:43 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] VM Resumed (Lifecycle Event)
Aug 26 23:24:43 user nova-compute[73497]: DEBUG nova.compute.manager [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:24:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:24:43 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Instance spawned successfully.
Aug 26 23:24:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:24:43 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:24:43 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:24:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:24:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:24:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:24:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:24:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:24:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:24:43 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:24:43 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092283.620533, e9a5de88-37f0-4953-92a2-6f8db0b2f02e => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:24:43 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] VM Started (Lifecycle Event)
Aug 26 23:24:43 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:24:43 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:24:43 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:24:43 user nova-compute[73497]: INFO nova.compute.manager [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Took 6.57 seconds to spawn the instance on the hypervisor.
Aug 26 23:24:43 user nova-compute[73497]: DEBUG nova.compute.manager [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:24:43 user nova-compute[73497]: INFO nova.compute.manager [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Took 7.43 seconds to build instance.
Aug 26 23:24:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3f3d1a80-191a-465d-b2a4-28b01911cd82 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Lock "e9a5de88-37f0-4953-92a2-6f8db0b2f02e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.532s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:47 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "40afa348-8391-4643-977c-e67eab5c9476" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:47 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "40afa348-8391-4643-977c-e67eab5c9476" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:47 user nova-compute[73497]: DEBUG nova.compute.manager [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:24:47 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:47 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:47 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:24:47 user nova-compute[73497]: INFO nova.compute.claims [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Claim successful on node user
Aug 26 23:24:48 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:24:48 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:24:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.518s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:48 user nova-compute[73497]: DEBUG nova.compute.manager [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:24:48 user nova-compute[73497]: DEBUG nova.compute.manager [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:24:48 user nova-compute[73497]: DEBUG nova.network.neutron [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:24:48 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:24:48 user nova-compute[73497]: DEBUG nova.compute.manager [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:24:48 user nova-compute[73497]: DEBUG nova.policy [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '935b8635557949cfba9b6528b97da95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c212cbb083450ea15ec54a96f12510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:24:48 user nova-compute[73497]: INFO nova.virt.block_device [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Booting with volume b5cc4471-9aff-4907-8edf-fb34125e8c61 at /dev/vda
Aug 26 23:24:48 user nova-compute[73497]: DEBUG os_brick.utils [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:24:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:48 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[00896729-06d5-42eb-b389-94dd4c059f01]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:48 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9847a499-2332-4284-ab5d-416e966b9c69]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:48 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10f4c72-8bc4-4240-ac41-31248ca2f124]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:48 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea2c143-61c6-4ed5-8c49-0f76d5a87db0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:24:48 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:24:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:24:48 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:24:48 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f30d0f-fd3e-4012-869e-f3faa9f901cd]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:48 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:24:48 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:24:48 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:24:48 user nova-compute[73497]: DEBUG os_brick.utils [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:24:48 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Updating existing volume attachment record: f8fbfeb0-0021-4c69-9094-d16f47d42709 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:24:49 user nova-compute[73497]: DEBUG nova.network.neutron [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Successfully created port: 1839e5ce-756d-4e0c-bf8c-f8a63976cb79 {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:24:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:49 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693092274.5573497, 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:24:49 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] VM Stopped (Lifecycle Event)
Aug 26 23:24:49 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4ac069af-b910-4e55-95ee-c31e0403ccb8 None None] [instance: 244f4c8e-7db8-4f8e-82f0-b95d5d8d5c35] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:24:49 user nova-compute[73497]: DEBUG nova.network.neutron [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Successfully updated port: 1839e5ce-756d-4e0c-bf8c-f8a63976cb79 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:24:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "refresh_cache-40afa348-8391-4643-977c-e67eab5c9476" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:24:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquired lock "refresh_cache-40afa348-8391-4643-977c-e67eab5c9476" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:24:49 user nova-compute[73497]: DEBUG nova.network.neutron [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:24:50 user nova-compute[73497]: DEBUG nova.compute.manager [req-4bcaccac-61ab-4b95-86ea-0522cc88632c req-930a577f-1bd2-4f97-9d2b-944b7f0d12c1 service nova] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Received event network-changed-1839e5ce-756d-4e0c-bf8c-f8a63976cb79 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:50 user nova-compute[73497]: DEBUG nova.compute.manager [req-4bcaccac-61ab-4b95-86ea-0522cc88632c req-930a577f-1bd2-4f97-9d2b-944b7f0d12c1 service nova] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Refreshing instance network info cache due to event network-changed-1839e5ce-756d-4e0c-bf8c-f8a63976cb79. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:24:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4bcaccac-61ab-4b95-86ea-0522cc88632c req-930a577f-1bd2-4f97-9d2b-944b7f0d12c1 service nova] Acquiring lock "refresh_cache-40afa348-8391-4643-977c-e67eab5c9476" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:24:50 user nova-compute[73497]: DEBUG nova.network.neutron [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:24:50 user nova-compute[73497]: DEBUG nova.network.neutron [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Updating instance_info_cache with network_info: [{"id": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "address": "fa:16:3e:c5:a7:fc", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1839e5ce-75", "ovs_interfaceid": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:24:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Releasing lock "refresh_cache-40afa348-8391-4643-977c-e67eab5c9476" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:24:50 user nova-compute[73497]: DEBUG nova.compute.manager [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Instance network_info: |[{"id": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "address": "fa:16:3e:c5:a7:fc", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1839e5ce-75", "ovs_interfaceid": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:24:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4bcaccac-61ab-4b95-86ea-0522cc88632c req-930a577f-1bd2-4f97-9d2b-944b7f0d12c1 service nova] Acquired lock "refresh_cache-40afa348-8391-4643-977c-e67eab5c9476" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:24:50 user nova-compute[73497]: DEBUG nova.network.neutron [req-4bcaccac-61ab-4b95-86ea-0522cc88632c req-930a577f-1bd2-4f97-9d2b-944b7f0d12c1 service nova] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Refreshing network info cache for port 1839e5ce-756d-4e0c-bf8c-f8a63976cb79 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:24:50 user nova-compute[73497]: DEBUG nova.network.neutron [req-4bcaccac-61ab-4b95-86ea-0522cc88632c req-930a577f-1bd2-4f97-9d2b-944b7f0d12c1 service nova] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Updated VIF entry in instance network info cache for port 1839e5ce-756d-4e0c-bf8c-f8a63976cb79. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:24:50 user nova-compute[73497]: DEBUG nova.network.neutron [req-4bcaccac-61ab-4b95-86ea-0522cc88632c req-930a577f-1bd2-4f97-9d2b-944b7f0d12c1 service nova] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Updating instance_info_cache with network_info: [{"id": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "address": "fa:16:3e:c5:a7:fc", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1839e5ce-75", "ovs_interfaceid": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:24:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4bcaccac-61ab-4b95-86ea-0522cc88632c req-930a577f-1bd2-4f97-9d2b-944b7f0d12c1 service nova] Releasing lock "refresh_cache-40afa348-8391-4643-977c-e67eab5c9476" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:24:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:24:54 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Creating image(s)
Aug 26 23:24:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Did not create local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Ensure instance console log exists: /opt/stack/data/nova/instances/c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Start _get_guest_xml network_info=[{"id": "a45f0c9b-48cc-4434-90c9-875c52f402d0", "address": "fa:16:3e:87:b8:93", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa45f0c9b-48", "ovs_interfaceid": "a45f0c9b-48cc-4434-90c9-875c52f402d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '637b6680-de38-49fb-8e19-b102aea8b24b', 'guest_format': None, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LNBxIeFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c', 'attached_at': '', 'detached_at': '', 'volume_id': 'e051d168-f209-4421-b5b7-a94f198803e3', 'serial': 'e051d168-f209-4421-b5b7-a94f198803e3'}, 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:24:54 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:24:54 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:24:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LNBxIeFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:24:54 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:24:54 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:24:54 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:24:54 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:24:54 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2167804-edf9-423c-8130-81c28c28a775]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:24:54 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[06abd84c-795c-4989-bc4d-3ae3d261effa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3] added
Aug 26 23:24:54 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2cbb75-2230-481b-87b5-dc28f9056f67]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee70ac8-a82c-495b-83a2-8e6b6ed78cc9]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LNBxIeFo {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LNBxIeFo" returned: 0 in 0.032s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[797054a0-d2d3-4e3b-8ad6-a745e48a09ea]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LNBxIeFo'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[17401b8b-c836-40e0-9edd-66709b3d6d6a]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[df491ba0-fd6e-4174-ab70-87a9f9fa5f11]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:24:54 user nova-compute[73497]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:24:54 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:24:54 user nova-compute[73497]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:24:54 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[efea6343-71f8-49ed-be58-9aced4f8b440]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3, portal: 172.16.0.220,3260]
Aug 26 23:24:54 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3, portal: 172.16.0.220,3260] successful.
Aug 26 23:24:54 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33a294e-0e81-4b0f-b33d-72214ced8783]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[81da5fdf-ba2f-4de6-b4c7-d0fd183a1d37]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:24:54 user nova-compute[73497]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:24:54 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:24:54 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:24:54 user nova-compute[73497]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:24:54 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:24:54 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8781cca-c5f9-4657-939e-4954f3b151f0]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LNBxIeFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:24:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:55 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:24:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:55 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:24:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:24:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26639313662326666', 'path': '/dev/sdb'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:24:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639313662326666', 'path': '/dev/sdb'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:24:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:24:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1461613885',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1461613885',id=27,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ee8ef1c899342b38a624c1c28309d41',ramdisk_id='',reservation_id='r-2h2ics8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1276656289',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:24:31Z,user_data=None,user_id='83005131fdc2411abe7a198157910743',uuid=c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a45f0c9b-48cc-4434-90c9-875c52f402d0", "address": "fa:16:3e:87:b8:93", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa45f0c9b-48", "ovs_interfaceid": "a45f0c9b-48cc-4434-90c9-875c52f402d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:24:55 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Converting VIF {"id": "a45f0c9b-48cc-4434-90c9-875c52f402d0", "address": "fa:16:3e:87:b8:93", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa45f0c9b-48", "ovs_interfaceid": "a45f0c9b-48cc-4434-90c9-875c52f402d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:24:55 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:b8:93,bridge_name='br-int',has_traffic_filtering=True,id=a45f0c9b-48cc-4434-90c9-875c52f402d0,network=Network(f8ba0a6b-e4fc-4236-9df3-90ffab8824fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa45f0c9b-48') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:24:55 user nova-compute[73497]: DEBUG nova.objects.instance [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lazy-loading 'pci_devices' on Instance uuid c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:24:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:24:55 user nova-compute[73497]:   <uuid>c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c</uuid>
Aug 26 23:24:55 user nova-compute[73497]:   <name>instance-0000001b</name>
Aug 26 23:24:55 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:24:55 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:24:55 user nova-compute[73497]:   <metadata>
Aug 26 23:24:55 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:24:55 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:24:55 user nova-compute[73497]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1461613885</nova:name>
Aug 26 23:24:55 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:24:54</nova:creationTime>
Aug 26 23:24:55 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:24:55 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:24:55 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:24:55 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:24:55 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:24:55 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:24:55 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:24:55 user nova-compute[73497]:       <nova:owner>
Aug 26 23:24:55 user nova-compute[73497]:         <nova:user uuid="83005131fdc2411abe7a198157910743">tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member</nova:user>
Aug 26 23:24:55 user nova-compute[73497]:         <nova:project uuid="3ee8ef1c899342b38a624c1c28309d41">tempest-ServerBootFromVolumeStableRescueTest-1276656289</nova:project>
Aug 26 23:24:55 user nova-compute[73497]:       </nova:owner>
Aug 26 23:24:55 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:24:55 user nova-compute[73497]:       <nova:ports>
Aug 26 23:24:55 user nova-compute[73497]:         <nova:port uuid="a45f0c9b-48cc-4434-90c9-875c52f402d0">
Aug 26 23:24:55 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 23:24:55 user nova-compute[73497]:         </nova:port>
Aug 26 23:24:55 user nova-compute[73497]:       </nova:ports>
Aug 26 23:24:55 user nova-compute[73497]:     </nova:instance>
Aug 26 23:24:55 user nova-compute[73497]:   </metadata>
Aug 26 23:24:55 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:24:55 user nova-compute[73497]:     <system>
Aug 26 23:24:55 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:24:55 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:24:55 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:24:55 user nova-compute[73497]:       <entry name="serial">c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c</entry>
Aug 26 23:24:55 user nova-compute[73497]:       <entry name="uuid">c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c</entry>
Aug 26 23:24:55 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:24:55 user nova-compute[73497]:     </system>
Aug 26 23:24:55 user nova-compute[73497]:   </sysinfo>
Aug 26 23:24:55 user nova-compute[73497]:   <os>
Aug 26 23:24:55 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:24:55 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:24:55 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:24:55 user nova-compute[73497]:   </os>
Aug 26 23:24:55 user nova-compute[73497]:   <features>
Aug 26 23:24:55 user nova-compute[73497]:     <acpi/>
Aug 26 23:24:55 user nova-compute[73497]:     <apic/>
Aug 26 23:24:55 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:24:55 user nova-compute[73497]:   </features>
Aug 26 23:24:55 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:24:55 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:24:55 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:24:55 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:24:55 user nova-compute[73497]:   </clock>
Aug 26 23:24:55 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:24:55 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:24:55 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:24:55 user nova-compute[73497]:   </cpu>
Aug 26 23:24:55 user nova-compute[73497]:   <devices>
Aug 26 23:24:55 user nova-compute[73497]:     <disk type="block" device="disk">
Aug 26 23:24:55 user nova-compute[73497]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:24:55 user nova-compute[73497]:       <source dev="/dev/sdb"/>
Aug 26 23:24:55 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:24:55 user nova-compute[73497]:       <serial>e051d168-f209-4421-b5b7-a94f198803e3</serial>
Aug 26 23:24:55 user nova-compute[73497]:     </disk>
Aug 26 23:24:55 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:24:55 user nova-compute[73497]:       <mac address="fa:16:3e:87:b8:93"/>
Aug 26 23:24:55 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:24:55 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:24:55 user nova-compute[73497]:       <target dev="tapa45f0c9b-48"/>
Aug 26 23:24:55 user nova-compute[73497]:     </interface>
Aug 26 23:24:55 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:24:55 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c/console.log" append="off"/>
Aug 26 23:24:55 user nova-compute[73497]:     </serial>
Aug 26 23:24:55 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:24:55 user nova-compute[73497]:     <video>
Aug 26 23:24:55 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:24:55 user nova-compute[73497]:     </video>
Aug 26 23:24:55 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:24:55 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:24:55 user nova-compute[73497]:     </rng>
Aug 26 23:24:55 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:24:55 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:24:55 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:24:55 user nova-compute[73497]:     </memballoon>
Aug 26 23:24:55 user nova-compute[73497]:   </devices>
Aug 26 23:24:55 user nova-compute[73497]: </domain>
Aug 26 23:24:55 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:24:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:24:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1461613885',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1461613885',id=27,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ee8ef1c899342b38a624c1c28309d41',ramdisk_id='',reservation_id='r-2h2ics8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1276656289',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:24:31Z,user_data=None,user_id='83005131fdc2411abe7a198157910743',uuid=c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a45f0c9b-48cc-4434-90c9-875c52f402d0", "address": "fa:16:3e:87:b8:93", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa45f0c9b-48", "ovs_interfaceid": "a45f0c9b-48cc-4434-90c9-875c52f402d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:24:55 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Converting VIF {"id": "a45f0c9b-48cc-4434-90c9-875c52f402d0", "address": "fa:16:3e:87:b8:93", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa45f0c9b-48", "ovs_interfaceid": "a45f0c9b-48cc-4434-90c9-875c52f402d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:24:55 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:b8:93,bridge_name='br-int',has_traffic_filtering=True,id=a45f0c9b-48cc-4434-90c9-875c52f402d0,network=Network(f8ba0a6b-e4fc-4236-9df3-90ffab8824fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa45f0c9b-48') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:24:55 user nova-compute[73497]: DEBUG os_vif [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:b8:93,bridge_name='br-int',has_traffic_filtering=True,id=a45f0c9b-48cc-4434-90c9-875c52f402d0,network=Network(f8ba0a6b-e4fc-4236-9df3-90ffab8824fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa45f0c9b-48') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:24:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:24:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:24:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa45f0c9b-48, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:24:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa45f0c9b-48, col_values=(('external_ids', {'iface-id': 'a45f0c9b-48cc-4434-90c9-875c52f402d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:b8:93', 'vm-uuid': 'c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:24:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:24:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:55 user nova-compute[73497]: INFO os_vif [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:b8:93,bridge_name='br-int',has_traffic_filtering=True,id=a45f0c9b-48cc-4434-90c9-875c52f402d0,network=Network(f8ba0a6b-e4fc-4236-9df3-90ffab8824fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa45f0c9b-48')
Aug 26 23:24:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:24:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] No VIF found with MAC fa:16:3e:87:b8:93, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:24:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk.rescue --force-share --output=json" returned: 0 in 0.252s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:24:57 user nova-compute[73497]: DEBUG nova.compute.manager [req-aec23b14-2f98-4834-84bb-bb9325056678 req-28288660-442f-456a-a3fb-6ca3edd4773a service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Received event network-vif-plugged-a45f0c9b-48cc-4434-90c9-875c52f402d0 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-aec23b14-2f98-4834-84bb-bb9325056678 req-28288660-442f-456a-a3fb-6ca3edd4773a service nova] Acquiring lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-aec23b14-2f98-4834-84bb-bb9325056678 req-28288660-442f-456a-a3fb-6ca3edd4773a service nova] Lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-aec23b14-2f98-4834-84bb-bb9325056678 req-28288660-442f-456a-a3fb-6ca3edd4773a service nova] Lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:57 user nova-compute[73497]: DEBUG nova.compute.manager [req-aec23b14-2f98-4834-84bb-bb9325056678 req-28288660-442f-456a-a3fb-6ca3edd4773a service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] No waiting events found dispatching network-vif-plugged-a45f0c9b-48cc-4434-90c9-875c52f402d0 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:24:57 user nova-compute[73497]: WARNING nova.compute.manager [req-aec23b14-2f98-4834-84bb-bb9325056678 req-28288660-442f-456a-a3fb-6ca3edd4773a service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Received unexpected event network-vif-plugged-a45f0c9b-48cc-4434-90c9-875c52f402d0 for instance with vm_state building and task_state spawning.
Aug 26 23:24:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:24:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:24:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df9ebc6-0b6a-4cdc-811d-d43be88958f7/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df9ebc6-0b6a-4cdc-811d-d43be88958f7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df9ebc6-0b6a-4cdc-811d-d43be88958f7/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df9ebc6-0b6a-4cdc-811d-d43be88958f7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:59 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092299.6034975, c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:24:59 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] VM Resumed (Lifecycle Event)
Aug 26 23:24:59 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:24:59 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:24:59 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Instance spawned successfully.
Aug 26 23:24:59 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:24:59 user nova-compute[73497]: DEBUG nova.compute.manager [req-209c5c50-30f5-43f7-9e59-c3446bcb5ed3 req-648505b1-c1ac-4c92-b360-2fb5b3a90c7a service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Received event network-vif-plugged-a45f0c9b-48cc-4434-90c9-875c52f402d0 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:24:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-209c5c50-30f5-43f7-9e59-c3446bcb5ed3 req-648505b1-c1ac-4c92-b360-2fb5b3a90c7a service nova] Acquiring lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:24:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-209c5c50-30f5-43f7-9e59-c3446bcb5ed3 req-648505b1-c1ac-4c92-b360-2fb5b3a90c7a service nova] Lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:24:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-209c5c50-30f5-43f7-9e59-c3446bcb5ed3 req-648505b1-c1ac-4c92-b360-2fb5b3a90c7a service nova] Lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:59 user nova-compute[73497]: DEBUG nova.compute.manager [req-209c5c50-30f5-43f7-9e59-c3446bcb5ed3 req-648505b1-c1ac-4c92-b360-2fb5b3a90c7a service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] No waiting events found dispatching network-vif-plugged-a45f0c9b-48cc-4434-90c9-875c52f402d0 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:24:59 user nova-compute[73497]: WARNING nova.compute.manager [req-209c5c50-30f5-43f7-9e59-c3446bcb5ed3 req-648505b1-c1ac-4c92-b360-2fb5b3a90c7a service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Received unexpected event network-vif-plugged-a45f0c9b-48cc-4434-90c9-875c52f402d0 for instance with vm_state building and task_state spawning.
Aug 26 23:24:59 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:24:59 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:24:59 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:24:59 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:24:59 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:24:59 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:24:59 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:24:59 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:24:59 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:24:59 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092299.6038876, c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:24:59 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] VM Started (Lifecycle Event)
Aug 26 23:24:59 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:24:59 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:24:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:24:59 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:24:59 user nova-compute[73497]: INFO nova.compute.manager [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Took 5.50 seconds to spawn the instance on the hypervisor.
Aug 26 23:24:59 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:24:59 user nova-compute[73497]: INFO nova.compute.manager [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Took 29.31 seconds to build instance.
Aug 26 23:24:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e0b856ab-8395-41b8-a19f-6049d40a60a4 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.414s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:24:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:24:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a5de88-37f0-4953-92a2-6f8db0b2f02e/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a5de88-37f0-4953-92a2-6f8db0b2f02e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a5de88-37f0-4953-92a2-6f8db0b2f02e/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a5de88-37f0-4953-92a2-6f8db0b2f02e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:00 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:25:00 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:25:00 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=7156MB free_disk=24.924365997314453GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:25:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.compute.manager [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:25:01 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Creating image(s)
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Did not create local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Ensure instance console log exists: /opt/stack/data/nova/instances/40afa348-8391-4643-977c-e67eab5c9476/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Start _get_guest_xml network_info=[{"id": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "address": "fa:16:3e:c5:a7:fc", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1839e5ce-75", "ovs_interfaceid": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f8fbfeb0-0021-4c69-9094-d16f47d42709', 'guest_format': None, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbLpraVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '40afa348-8391-4643-977c-e67eab5c9476', 'attached_at': '', 'detached_at': '', 'volume_id': 'b5cc4471-9aff-4907-8edf-fb34125e8c61', 'serial': 'b5cc4471-9aff-4907-8edf-fb34125e8c61'}, 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 994093f0-e6b2-4c96-b259-c559ef2b1fbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 171985a3-358d-4b26-a66c-372b9b99b386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance aebaeda6-23d1-43a1-afc8-bdc8992067e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 7c124dd9-4dce-4c6f-925c-6eda8e187d84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 4c68f140-4235-4dcb-b99d-1347bc949d15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 043294e5-0618-4a31-bb19-1227ef1f5d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance e9e5c83f-0678-48d4-a81f-1a3f959aabcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance ee6283d5-40de-432d-997c-0be52ff673ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance c601f97e-9e52-40c6-9085-45f38e709721 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 6df9ebc6-0b6a-4cdc-811d-d43be88958f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance e9a5de88-37f0-4953-92a2-6f8db0b2f02e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 40afa348-8391-4643-977c-e67eab5c9476 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:25:01 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:25:01 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbLpraVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:25:01 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:25:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:25:01 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:25:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:25:01 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:25:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48da622-91da-4275-bed0-9fa7e88470b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:25:01 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a026955d-9682-4580-a057-bbe4300eb499]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61] added
Aug 26 23:25:01 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c88dfb-0864-4254-94a0-6d6212dd454f]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d064858-9e0c-4197-8bf9-4a71c0b1fcb6]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NbLpraVl {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NbLpraVl" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91527de-fac7-4caf-9cb2-513b98c1a110]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NbLpraVl'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[54012d96-2117-4bc3-bb3e-5b635fb0f423]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87ab2cc-f13e-41c6-95aa-a364703b6bf3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:25:01 user nova-compute[73497]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:25:01 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:25:01 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:25:01 user nova-compute[73497]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:25:01 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:25:01 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e5074c-ad2e-4ca3-8fc4-ac05bec4ad52]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61, portal: 172.16.0.220,3260]
Aug 26 23:25:01 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61, portal: 172.16.0.220,3260] successful.
Aug 26 23:25:01 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[81148be5-3c36-468e-ab04-c9597119b780]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3c5c66-2bcd-4417-b1e1-79f073631619]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:25:01 user nova-compute[73497]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:25:01 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:25:01 user nova-compute[73497]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:25:01 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:25:01 user nova-compute[73497]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:25:01 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:25:01 user nova-compute[73497]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:25:01 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf67b92-2961-44db-9b88-c1dffc8e9a84]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbLpraVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.624s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:25:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23936313539323664', 'path': '/dev/sde'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:25:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936313539323664', 'path': '/dev/sde'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:25:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:24:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2022799057',display_name='tempest-ServerActionsTestOtherA-server-2022799057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2022799057',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkEfHl6zG9yr5sr9jutwV2XJmeMlhN65J2njpgcQb6mCyEUk0cV6s9h2VdW+/plwoOss4vho5+nme8j0/zabYBtL74xkosuFNe1bIAfxbSswJHdqiCv1/r8WNi7pn3DAQ==',key_name='tempest-keypair-1008924037',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80c212cbb083450ea15ec54a96f12510',ramdisk_id='',reservation_id='r-8ixi3cop',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-81910947',owner_user_name='tempest-ServerActionsTestOtherA-81910947-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:24:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='935b8635557949cfba9b6528b97da95f',uuid=40afa348-8391-4643-977c-e67eab5c9476,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "address": "fa:16:3e:c5:a7:fc", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1839e5ce-75", "ovs_interfaceid": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:25:02 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Converting VIF {"id": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "address": "fa:16:3e:c5:a7:fc", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1839e5ce-75", "ovs_interfaceid": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:25:02 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:a7:fc,bridge_name='br-int',has_traffic_filtering=True,id=1839e5ce-756d-4e0c-bf8c-f8a63976cb79,network=Network(bf99a38a-faaf-4f1e-a161-736ce9089919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1839e5ce-75') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:25:02 user nova-compute[73497]: DEBUG nova.objects.instance [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lazy-loading 'pci_devices' on Instance uuid 40afa348-8391-4643-977c-e67eab5c9476 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:25:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:25:02 user nova-compute[73497]:   <uuid>40afa348-8391-4643-977c-e67eab5c9476</uuid>
Aug 26 23:25:02 user nova-compute[73497]:   <name>instance-0000001d</name>
Aug 26 23:25:02 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:25:02 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:25:02 user nova-compute[73497]:   <metadata>
Aug 26 23:25:02 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:25:02 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:25:02 user nova-compute[73497]:       <nova:name>tempest-ServerActionsTestOtherA-server-2022799057</nova:name>
Aug 26 23:25:02 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:25:01</nova:creationTime>
Aug 26 23:25:02 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:25:02 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:25:02 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:25:02 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:25:02 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:25:02 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:25:02 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:25:02 user nova-compute[73497]:       <nova:owner>
Aug 26 23:25:02 user nova-compute[73497]:         <nova:user uuid="935b8635557949cfba9b6528b97da95f">tempest-ServerActionsTestOtherA-81910947-project-member</nova:user>
Aug 26 23:25:02 user nova-compute[73497]:         <nova:project uuid="80c212cbb083450ea15ec54a96f12510">tempest-ServerActionsTestOtherA-81910947</nova:project>
Aug 26 23:25:02 user nova-compute[73497]:       </nova:owner>
Aug 26 23:25:02 user nova-compute[73497]:       <nova:ports>
Aug 26 23:25:02 user nova-compute[73497]:         <nova:port uuid="1839e5ce-756d-4e0c-bf8c-f8a63976cb79">
Aug 26 23:25:02 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 23:25:02 user nova-compute[73497]:         </nova:port>
Aug 26 23:25:02 user nova-compute[73497]:       </nova:ports>
Aug 26 23:25:02 user nova-compute[73497]:     </nova:instance>
Aug 26 23:25:02 user nova-compute[73497]:   </metadata>
Aug 26 23:25:02 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:25:02 user nova-compute[73497]:     <system>
Aug 26 23:25:02 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:25:02 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:25:02 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:25:02 user nova-compute[73497]:       <entry name="serial">40afa348-8391-4643-977c-e67eab5c9476</entry>
Aug 26 23:25:02 user nova-compute[73497]:       <entry name="uuid">40afa348-8391-4643-977c-e67eab5c9476</entry>
Aug 26 23:25:02 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:25:02 user nova-compute[73497]:     </system>
Aug 26 23:25:02 user nova-compute[73497]:   </sysinfo>
Aug 26 23:25:02 user nova-compute[73497]:   <os>
Aug 26 23:25:02 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:25:02 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:25:02 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:25:02 user nova-compute[73497]:   </os>
Aug 26 23:25:02 user nova-compute[73497]:   <features>
Aug 26 23:25:02 user nova-compute[73497]:     <acpi/>
Aug 26 23:25:02 user nova-compute[73497]:     <apic/>
Aug 26 23:25:02 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:25:02 user nova-compute[73497]:   </features>
Aug 26 23:25:02 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:25:02 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:25:02 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:25:02 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:25:02 user nova-compute[73497]:   </clock>
Aug 26 23:25:02 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:25:02 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:25:02 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:25:02 user nova-compute[73497]:   </cpu>
Aug 26 23:25:02 user nova-compute[73497]:   <devices>
Aug 26 23:25:02 user nova-compute[73497]:     <disk type="block" device="disk">
Aug 26 23:25:02 user nova-compute[73497]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:25:02 user nova-compute[73497]:       <source dev="/dev/sde"/>
Aug 26 23:25:02 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:25:02 user nova-compute[73497]:       <serial>b5cc4471-9aff-4907-8edf-fb34125e8c61</serial>
Aug 26 23:25:02 user nova-compute[73497]:     </disk>
Aug 26 23:25:02 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:25:02 user nova-compute[73497]:       <mac address="fa:16:3e:c5:a7:fc"/>
Aug 26 23:25:02 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:25:02 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:25:02 user nova-compute[73497]:       <target dev="tap1839e5ce-75"/>
Aug 26 23:25:02 user nova-compute[73497]:     </interface>
Aug 26 23:25:02 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:25:02 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/40afa348-8391-4643-977c-e67eab5c9476/console.log" append="off"/>
Aug 26 23:25:02 user nova-compute[73497]:     </serial>
Aug 26 23:25:02 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:25:02 user nova-compute[73497]:     <video>
Aug 26 23:25:02 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:25:02 user nova-compute[73497]:     </video>
Aug 26 23:25:02 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:25:02 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:25:02 user nova-compute[73497]:     </rng>
Aug 26 23:25:02 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:25:02 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:25:02 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:25:02 user nova-compute[73497]:     </memballoon>
Aug 26 23:25:02 user nova-compute[73497]:   </devices>
Aug 26 23:25:02 user nova-compute[73497]: </domain>
Aug 26 23:25:02 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:25:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:24:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2022799057',display_name='tempest-ServerActionsTestOtherA-server-2022799057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2022799057',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkEfHl6zG9yr5sr9jutwV2XJmeMlhN65J2njpgcQb6mCyEUk0cV6s9h2VdW+/plwoOss4vho5+nme8j0/zabYBtL74xkosuFNe1bIAfxbSswJHdqiCv1/r8WNi7pn3DAQ==',key_name='tempest-keypair-1008924037',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80c212cbb083450ea15ec54a96f12510',ramdisk_id='',reservation_id='r-8ixi3cop',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-81910947',owner_user_name='tempest-ServerActionsTestOtherA-81910947-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:24:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='935b8635557949cfba9b6528b97da95f',uuid=40afa348-8391-4643-977c-e67eab5c9476,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "address": "fa:16:3e:c5:a7:fc", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1839e5ce-75", "ovs_interfaceid": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:25:02 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Converting VIF {"id": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "address": "fa:16:3e:c5:a7:fc", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1839e5ce-75", "ovs_interfaceid": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:25:02 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:a7:fc,bridge_name='br-int',has_traffic_filtering=True,id=1839e5ce-756d-4e0c-bf8c-f8a63976cb79,network=Network(bf99a38a-faaf-4f1e-a161-736ce9089919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1839e5ce-75') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:25:02 user nova-compute[73497]: DEBUG os_vif [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:a7:fc,bridge_name='br-int',has_traffic_filtering=True,id=1839e5ce-756d-4e0c-bf8c-f8a63976cb79,network=Network(bf99a38a-faaf-4f1e-a161-736ce9089919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1839e5ce-75') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:25:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:25:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:25:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1839e5ce-75, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:25:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1839e5ce-75, col_values=(('external_ids', {'iface-id': '1839e5ce-756d-4e0c-bf8c-f8a63976cb79', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:a7:fc', 'vm-uuid': '40afa348-8391-4643-977c-e67eab5c9476'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:25:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:25:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:02 user nova-compute[73497]: INFO os_vif [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:a7:fc,bridge_name='br-int',has_traffic_filtering=True,id=1839e5ce-756d-4e0c-bf8c-f8a63976cb79,network=Network(bf99a38a-faaf-4f1e-a161-736ce9089919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1839e5ce-75')
Aug 26 23:25:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:25:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] No VIF found with MAC fa:16:3e:c5:a7:fc, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:25:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:04 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:25:04 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:25:04 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:25:04 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:25:04 user nova-compute[73497]: DEBUG nova.compute.manager [req-c52b1d7c-3c2b-4c1d-9a54-8d9d91a5689c req-da1a457d-ea41-4a84-93ef-29d740a1e465 service nova] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Received event network-vif-plugged-1839e5ce-756d-4e0c-bf8c-f8a63976cb79 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:25:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c52b1d7c-3c2b-4c1d-9a54-8d9d91a5689c req-da1a457d-ea41-4a84-93ef-29d740a1e465 service nova] Acquiring lock "40afa348-8391-4643-977c-e67eab5c9476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c52b1d7c-3c2b-4c1d-9a54-8d9d91a5689c req-da1a457d-ea41-4a84-93ef-29d740a1e465 service nova] Lock "40afa348-8391-4643-977c-e67eab5c9476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c52b1d7c-3c2b-4c1d-9a54-8d9d91a5689c req-da1a457d-ea41-4a84-93ef-29d740a1e465 service nova] Lock "40afa348-8391-4643-977c-e67eab5c9476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:04 user nova-compute[73497]: DEBUG nova.compute.manager [req-c52b1d7c-3c2b-4c1d-9a54-8d9d91a5689c req-da1a457d-ea41-4a84-93ef-29d740a1e465 service nova] [instance: 40afa348-8391-4643-977c-e67eab5c9476] No waiting events found dispatching network-vif-plugged-1839e5ce-756d-4e0c-bf8c-f8a63976cb79 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:25:04 user nova-compute[73497]: WARNING nova.compute.manager [req-c52b1d7c-3c2b-4c1d-9a54-8d9d91a5689c req-da1a457d-ea41-4a84-93ef-29d740a1e465 service nova] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Received unexpected event network-vif-plugged-1839e5ce-756d-4e0c-bf8c-f8a63976cb79 for instance with vm_state building and task_state spawning.
Aug 26 23:25:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-7c124dd9-4dce-4c6f-925c-6eda8e187d84" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:25:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-7c124dd9-4dce-4c6f-925c-6eda8e187d84" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:25:04 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:25:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Acquiring lock "ee6283d5-40de-432d-997c-0be52ff673ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "ee6283d5-40de-432d-997c-0be52ff673ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Acquiring lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:04 user nova-compute[73497]: INFO nova.compute.manager [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Terminating instance
Aug 26 23:25:04 user nova-compute[73497]: DEBUG nova.compute.manager [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:25:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:05 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Instance destroyed successfully.
Aug 26 23:25:05 user nova-compute[73497]: DEBUG nova.objects.instance [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lazy-loading 'resources' on Instance uuid ee6283d5-40de-432d-997c-0be52ff673ca {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:16:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-956611518',display_name='tempest-ServerActionsTestOtherB-server-956611518',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-956611518',id=13,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqify97xxdfMwMioKw2wicMrkUmyII/F1wNcYn2coMZNsxaRCqyQGjP8va1kHwD6Z9ddCdHd23iUWPYbjiNJPdJt82WzvrKCaPX0PtGf0585mA5lLDP0NEIbnQp6LuyOw==',key_name='tempest-keypair-800864699',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:22:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e765258a50d46dea25bfd9c72970eb9',ramdisk_id='',reservation_id='r-owyjaonv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-435374476',owner_user_name='tempest-ServerActionsTestOtherB-435374476-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:22:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd09339d0e1d46d4a268f6ac8651a9f5',uuid=ee6283d5-40de-432d-997c-0be52ff673ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61639246-9d84-4629-9666-154897feaeae", "address": "fa:16:3e:56:41:f9", "network": {"id": "108c66fb-49a3-4c69-a3ac-93d9643a1d3e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025099504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e765258a50d46dea25bfd9c72970eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61639246-9d", "ovs_interfaceid": "61639246-9d84-4629-9666-154897feaeae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Converting VIF {"id": "61639246-9d84-4629-9666-154897feaeae", "address": "fa:16:3e:56:41:f9", "network": {"id": "108c66fb-49a3-4c69-a3ac-93d9643a1d3e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2025099504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e765258a50d46dea25bfd9c72970eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61639246-9d", "ovs_interfaceid": "61639246-9d84-4629-9666-154897feaeae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=61639246-9d84-4629-9666-154897feaeae,network=Network(108c66fb-49a3-4c69-a3ac-93d9643a1d3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61639246-9d') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG os_vif [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=61639246-9d84-4629-9666-154897feaeae,network=Network(108c66fb-49a3-4c69-a3ac-93d9643a1d3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61639246-9d') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61639246-9d, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:25:05 user nova-compute[73497]: INFO os_vif [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=61639246-9d84-4629-9666-154897feaeae,network=Network(108c66fb-49a3-4c69-a3ac-93d9643a1d3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61639246-9d')
Aug 26 23:25:05 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbmOUkyq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:25:05 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:25:05 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Updating instance_info_cache with network_info: [{"id": "127a3626-0dfe-4050-83d8-43658958e8df", "address": "fa:16:3e:1c:46:66", "network": {"id": "0b5f5877-f6f2-4814-878a-25181e72db29", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-155251039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19a5c1c2c4a456a86efbbadd38d94c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127a3626-0d", "ovs_interfaceid": "127a3626-0dfe-4050-83d8-43658958e8df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b4891b-e576-423b-9118-3fc446b7ffc9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-7c124dd9-4dce-4c6f-925c-6eda8e187d84" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bae190-d63c-434e-82cd-a76ecbe16ba5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:25:05 user nova-compute[73497]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:25:05 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:25:05 user nova-compute[73497]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:25:05 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:25:05 user nova-compute[73497]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c (non-flash)
Aug 26 23:25:05 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:25:05 user nova-compute[73497]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:25:05 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281c41df30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c'): ({'sdd'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Removing single pathed devices sdd {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[794ce3fb-d64d-4788-9898-80d81da2c043]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1462d0c-bd56-4019-babf-9d88a87e663f]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Flushing IO for device /dev/sdd {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e86eaf-a779-48aa-bfc3-ced7e930a2d9]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:25:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:06 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd3e534-7c60-485c-8fdd-e032bfaac0ce]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:25:06 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:25:06 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] SCSI volumes sdd have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:25:06 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:25:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:06 user nova-compute[73497]: DEBUG nova.compute.manager [req-04835359-ce01-4478-b2c3-d8d7e67a4b16 req-3db67bfa-e254-4549-af02-2a348ac5e7e7 service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Received event network-vif-unplugged-61639246-9d84-4629-9666-154897feaeae {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:25:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-04835359-ce01-4478-b2c3-d8d7e67a4b16 req-3db67bfa-e254-4549-af02-2a348ac5e7e7 service nova] Acquiring lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-04835359-ce01-4478-b2c3-d8d7e67a4b16 req-3db67bfa-e254-4549-af02-2a348ac5e7e7 service nova] Lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-04835359-ce01-4478-b2c3-d8d7e67a4b16 req-3db67bfa-e254-4549-af02-2a348ac5e7e7 service nova] Lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:06 user nova-compute[73497]: DEBUG nova.compute.manager [req-04835359-ce01-4478-b2c3-d8d7e67a4b16 req-3db67bfa-e254-4549-af02-2a348ac5e7e7 service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] No waiting events found dispatching network-vif-unplugged-61639246-9d84-4629-9666-154897feaeae {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:25:06 user nova-compute[73497]: DEBUG nova.compute.manager [req-04835359-ce01-4478-b2c3-d8d7e67a4b16 req-3db67bfa-e254-4549-af02-2a348ac5e7e7 service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Received event network-vif-unplugged-61639246-9d84-4629-9666-154897feaeae for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:25:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.047s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:06 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd9663d-6403-4173-a15a-a150b31ed531]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:25:06 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:25:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:06 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e64ffb-3ce2-468a-b062-a8b1a10fc925]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:25:06 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c, portal: 172.16.0.220,3260]
Aug 26 23:25:06 user nova-compute[73497]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c, portal: 172.16.0.220,3260] successful.
Aug 26 23:25:06 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:25:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1647697-14cc-47fd-a9c1-003e0115159c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:06 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefb46e5-c061-4c82-b10f-3297ca95f37d]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:25:06 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:25:06 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:25:06 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] <== disconnect_volume: return (400ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:25:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:25:06 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Deleting instance files /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca_del
Aug 26 23:25:06 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Deletion of /opt/stack/data/nova/instances/ee6283d5-40de-432d-997c-0be52ff673ca_del complete
Aug 26 23:25:06 user nova-compute[73497]: INFO nova.compute.manager [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Took 1.43 seconds to destroy the instance on the hypervisor.
Aug 26 23:25:06 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:25:06 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:25:06 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:25:06 user nova-compute[73497]: DEBUG nova.compute.manager [req-7daa0f31-8d93-44e4-852f-b9eafb54c4d6 req-2abe6600-1156-4983-b41c-c1d86060c7a8 service nova] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Received event network-vif-plugged-1839e5ce-756d-4e0c-bf8c-f8a63976cb79 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:25:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7daa0f31-8d93-44e4-852f-b9eafb54c4d6 req-2abe6600-1156-4983-b41c-c1d86060c7a8 service nova] Acquiring lock "40afa348-8391-4643-977c-e67eab5c9476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7daa0f31-8d93-44e4-852f-b9eafb54c4d6 req-2abe6600-1156-4983-b41c-c1d86060c7a8 service nova] Lock "40afa348-8391-4643-977c-e67eab5c9476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7daa0f31-8d93-44e4-852f-b9eafb54c4d6 req-2abe6600-1156-4983-b41c-c1d86060c7a8 service nova] Lock "40afa348-8391-4643-977c-e67eab5c9476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:06 user nova-compute[73497]: DEBUG nova.compute.manager [req-7daa0f31-8d93-44e4-852f-b9eafb54c4d6 req-2abe6600-1156-4983-b41c-c1d86060c7a8 service nova] [instance: 40afa348-8391-4643-977c-e67eab5c9476] No waiting events found dispatching network-vif-plugged-1839e5ce-756d-4e0c-bf8c-f8a63976cb79 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:25:06 user nova-compute[73497]: WARNING nova.compute.manager [req-7daa0f31-8d93-44e4-852f-b9eafb54c4d6 req-2abe6600-1156-4983-b41c-c1d86060c7a8 service nova] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Received unexpected event network-vif-plugged-1839e5ce-756d-4e0c-bf8c-f8a63976cb79 for instance with vm_state building and task_state spawning.
Aug 26 23:25:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:07 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092307.032337, 40afa348-8391-4643-977c-e67eab5c9476 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:25:07 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 40afa348-8391-4643-977c-e67eab5c9476] VM Resumed (Lifecycle Event)
Aug 26 23:25:07 user nova-compute[73497]: DEBUG nova.compute.manager [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:25:07 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:25:07 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Instance spawned successfully.
Aug 26 23:25:07 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:25:07 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:25:07 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:25:07 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:25:07 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:25:07 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:25:07 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:25:07 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:25:07 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:25:07 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 40afa348-8391-4643-977c-e67eab5c9476] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:25:07 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092307.0428727, 40afa348-8391-4643-977c-e67eab5c9476 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:25:07 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 40afa348-8391-4643-977c-e67eab5c9476] VM Started (Lifecycle Event)
Aug 26 23:25:07 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:25:07 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:25:07 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 40afa348-8391-4643-977c-e67eab5c9476] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:25:07 user nova-compute[73497]: INFO nova.compute.manager [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Took 6.14 seconds to spawn the instance on the hypervisor.
Aug 26 23:25:07 user nova-compute[73497]: DEBUG nova.compute.manager [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:25:07 user nova-compute[73497]: INFO nova.compute.manager [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Took 19.82 seconds to build instance.
Aug 26 23:25:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-206d1c6c-e210-4de9-88d0-c4bf082521b0 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "40afa348-8391-4643-977c-e67eab5c9476" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.923s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:07 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:25:07 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Took 1.16 seconds to deallocate network for instance.
Aug 26 23:25:08 user nova-compute[73497]: DEBUG nova.compute.manager [req-561cfe1b-b760-405a-873e-472ef9a098d6 req-c7f5927a-c595-41fc-a5e4-f442d1d7fd4f service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Received event network-vif-plugged-61639246-9d84-4629-9666-154897feaeae {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:25:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-561cfe1b-b760-405a-873e-472ef9a098d6 req-c7f5927a-c595-41fc-a5e4-f442d1d7fd4f service nova] Acquiring lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-561cfe1b-b760-405a-873e-472ef9a098d6 req-c7f5927a-c595-41fc-a5e4-f442d1d7fd4f service nova] Lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-561cfe1b-b760-405a-873e-472ef9a098d6 req-c7f5927a-c595-41fc-a5e4-f442d1d7fd4f service nova] Lock "ee6283d5-40de-432d-997c-0be52ff673ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:08 user nova-compute[73497]: DEBUG nova.compute.manager [req-561cfe1b-b760-405a-873e-472ef9a098d6 req-c7f5927a-c595-41fc-a5e4-f442d1d7fd4f service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] No waiting events found dispatching network-vif-plugged-61639246-9d84-4629-9666-154897feaeae {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:25:08 user nova-compute[73497]: WARNING nova.compute.manager [req-561cfe1b-b760-405a-873e-472ef9a098d6 req-c7f5927a-c595-41fc-a5e4-f442d1d7fd4f service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Received unexpected event network-vif-plugged-61639246-9d84-4629-9666-154897feaeae for instance with vm_state active and task_state deleting.
Aug 26 23:25:08 user nova-compute[73497]: INFO nova.compute.manager [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Took 1.30 seconds to detach 1 volumes for instance.
Aug 26 23:25:08 user nova-compute[73497]: DEBUG nova.compute.manager [req-f40f447b-661d-4085-b582-3199ffe94691 req-be9ea39a-cb63-460d-9996-0930bbfd1e29 service nova] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Received event network-vif-deleted-61639246-9d84-4629-9666-154897feaeae {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:25:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:09 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:25:09 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:25:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.601s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:09 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Deleted allocations for instance ee6283d5-40de-432d-997c-0be52ff673ca
Aug 26 23:25:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f742aa26-c557-43b4-9002-a3416aefe46b tempest-ServerActionsTestOtherB-435374476 tempest-ServerActionsTestOtherB-435374476-project-member] Lock "ee6283d5-40de-432d-997c-0be52ff673ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.748s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "93f6eb6e-272f-4b1e-b1d5-40769bf07165" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "93f6eb6e-272f-4b1e-b1d5-40769bf07165" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:09 user nova-compute[73497]: DEBUG nova.compute.manager [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:25:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:10 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:25:10 user nova-compute[73497]: INFO nova.compute.claims [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Claim successful on node user
Aug 26 23:25:10 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:25:10 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:25:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.507s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:10 user nova-compute[73497]: DEBUG nova.compute.manager [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:25:10 user nova-compute[73497]: DEBUG nova.compute.manager [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:25:10 user nova-compute[73497]: DEBUG nova.network.neutron [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:25:10 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:25:10 user nova-compute[73497]: DEBUG nova.compute.manager [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:25:10 user nova-compute[73497]: DEBUG nova.compute.manager [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:25:10 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:25:10 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Creating image(s)
Aug 26 23:25:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "/opt/stack/data/nova/instances/93f6eb6e-272f-4b1e-b1d5-40769bf07165/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "/opt/stack/data/nova/instances/93f6eb6e-272f-4b1e-b1d5-40769bf07165/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "/opt/stack/data/nova/instances/93f6eb6e-272f-4b1e-b1d5-40769bf07165/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:10 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:10 user nova-compute[73497]: DEBUG nova.policy [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e38409b92a95475db83540cbc4222466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd784b1d6c31e41d6a03fc377b0be69f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:25:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.180s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.191s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/93f6eb6e-272f-4b1e-b1d5-40769bf07165/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/93f6eb6e-272f-4b1e-b1d5-40769bf07165/disk 1073741824" returned: 0 in 0.052s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.183s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:11 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Checking if we can resize image /opt/stack/data/nova/instances/93f6eb6e-272f-4b1e-b1d5-40769bf07165/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:25:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f6eb6e-272f-4b1e-b1d5-40769bf07165/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f6eb6e-272f-4b1e-b1d5-40769bf07165/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:11 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Cannot resize image /opt/stack/data/nova/instances/93f6eb6e-272f-4b1e-b1d5-40769bf07165/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:25:11 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:25:11 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Ensure instance console log exists: /opt/stack/data/nova/instances/93f6eb6e-272f-4b1e-b1d5-40769bf07165/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:25:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:11 user nova-compute[73497]: DEBUG nova.network.neutron [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Successfully created port: c922af50-fef8-4a98-8642-f6a4df1fae6c {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:25:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:12 user nova-compute[73497]: DEBUG nova.network.neutron [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Successfully updated port: c922af50-fef8-4a98-8642-f6a4df1fae6c {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:25:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "refresh_cache-93f6eb6e-272f-4b1e-b1d5-40769bf07165" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:25:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquired lock "refresh_cache-93f6eb6e-272f-4b1e-b1d5-40769bf07165" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:25:12 user nova-compute[73497]: DEBUG nova.network.neutron [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:25:12 user nova-compute[73497]: DEBUG nova.compute.manager [req-186c3f8c-c42d-4897-b5b0-2c867cd1c254 req-905f1484-6d80-4db8-b0df-99a29f57491f service nova] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Received event network-changed-c922af50-fef8-4a98-8642-f6a4df1fae6c {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:25:12 user nova-compute[73497]: DEBUG nova.compute.manager [req-186c3f8c-c42d-4897-b5b0-2c867cd1c254 req-905f1484-6d80-4db8-b0df-99a29f57491f service nova] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Refreshing instance network info cache due to event network-changed-c922af50-fef8-4a98-8642-f6a4df1fae6c. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:25:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-186c3f8c-c42d-4897-b5b0-2c867cd1c254 req-905f1484-6d80-4db8-b0df-99a29f57491f service nova] Acquiring lock "refresh_cache-93f6eb6e-272f-4b1e-b1d5-40769bf07165" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:25:12 user nova-compute[73497]: DEBUG nova.network.neutron [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:25:12 user nova-compute[73497]: DEBUG nova.network.neutron [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Updating instance_info_cache with network_info: [{"id": "c922af50-fef8-4a98-8642-f6a4df1fae6c", "address": "fa:16:3e:d9:19:3d", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc922af50-fe", "ovs_interfaceid": "c922af50-fef8-4a98-8642-f6a4df1fae6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:25:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Releasing lock "refresh_cache-93f6eb6e-272f-4b1e-b1d5-40769bf07165" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:25:12 user nova-compute[73497]: DEBUG nova.compute.manager [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Instance network_info: |[{"id": "c922af50-fef8-4a98-8642-f6a4df1fae6c", "address": "fa:16:3e:d9:19:3d", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc922af50-fe", "ovs_interfaceid": "c922af50-fef8-4a98-8642-f6a4df1fae6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:25:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-186c3f8c-c42d-4897-b5b0-2c867cd1c254 req-905f1484-6d80-4db8-b0df-99a29f57491f service nova] Acquired lock "refresh_cache-93f6eb6e-272f-4b1e-b1d5-40769bf07165" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:25:12 user nova-compute[73497]: DEBUG nova.network.neutron [req-186c3f8c-c42d-4897-b5b0-2c867cd1c254 req-905f1484-6d80-4db8-b0df-99a29f57491f service nova] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Refreshing network info cache for port c922af50-fef8-4a98-8642-f6a4df1fae6c {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:25:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Start _get_guest_xml network_info=[{"id": "c922af50-fef8-4a98-8642-f6a4df1fae6c", "address": "fa:16:3e:d9:19:3d", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc922af50-fe", "ovs_interfaceid": "c922af50-fef8-4a98-8642-f6a4df1fae6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:25:12 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:25:12 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:25:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:25:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:25:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:25:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:25:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:25:12 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:25:12 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:25:12 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:25:12 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:25:12 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:25:12 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:25:12 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:25:12 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:25:12 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:25:12 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:25:12 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:25:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:25:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-842605694',display_name='tempest-AttachVolumeNegativeTest-server-842605694',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-842605694',id=30,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2Zz4WI1YLvvHF9BPHORG6tZi/a8HDTCrZeDvmmRk8SgHrJ1UNTfHsXv26/j91ITHMdIUPZMlB08W/noq3+swSs0M0suoExVI5PLHTPdgGokWqYzDCB5zw6eIgP1uZAvQ==',key_name='tempest-keypair-401471657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d784b1d6c31e41d6a03fc377b0be69f5',ramdisk_id='',reservation_id='r-fcjcd0e8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1095215256',owner_user_name='tempest-AttachVolumeNegativeTest-1095215256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:25:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e38409b92a95475db83540cbc4222466',uuid=93f6eb6e-272f-4b1e-b1d5-40769bf07165,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c922af50-fef8-4a98-8642-f6a4df1fae6c", "address": "fa:16:3e:d9:19:3d", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc922af50-fe", "ovs_interfaceid": "c922af50-fef8-4a98-8642-f6a4df1fae6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:25:13 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Converting VIF {"id": "c922af50-fef8-4a98-8642-f6a4df1fae6c", "address": "fa:16:3e:d9:19:3d", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc922af50-fe", "ovs_interfaceid": "c922af50-fef8-4a98-8642-f6a4df1fae6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:25:13 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:19:3d,bridge_name='br-int',has_traffic_filtering=True,id=c922af50-fef8-4a98-8642-f6a4df1fae6c,network=Network(7bae9729-050d-4ff3-a842-91d0ec2c08d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc922af50-fe') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:25:13 user nova-compute[73497]: DEBUG nova.objects.instance [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lazy-loading 'pci_devices' on Instance uuid 93f6eb6e-272f-4b1e-b1d5-40769bf07165 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:25:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:25:13 user nova-compute[73497]:   <uuid>93f6eb6e-272f-4b1e-b1d5-40769bf07165</uuid>
Aug 26 23:25:13 user nova-compute[73497]:   <name>instance-0000001e</name>
Aug 26 23:25:13 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:25:13 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:25:13 user nova-compute[73497]:   <metadata>
Aug 26 23:25:13 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:25:13 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:25:13 user nova-compute[73497]:       <nova:name>tempest-AttachVolumeNegativeTest-server-842605694</nova:name>
Aug 26 23:25:13 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:25:12</nova:creationTime>
Aug 26 23:25:13 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:25:13 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:25:13 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:25:13 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:25:13 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:25:13 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:25:13 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:25:13 user nova-compute[73497]:       <nova:owner>
Aug 26 23:25:13 user nova-compute[73497]:         <nova:user uuid="e38409b92a95475db83540cbc4222466">tempest-AttachVolumeNegativeTest-1095215256-project-member</nova:user>
Aug 26 23:25:13 user nova-compute[73497]:         <nova:project uuid="d784b1d6c31e41d6a03fc377b0be69f5">tempest-AttachVolumeNegativeTest-1095215256</nova:project>
Aug 26 23:25:13 user nova-compute[73497]:       </nova:owner>
Aug 26 23:25:13 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:25:13 user nova-compute[73497]:       <nova:ports>
Aug 26 23:25:13 user nova-compute[73497]:         <nova:port uuid="c922af50-fef8-4a98-8642-f6a4df1fae6c">
Aug 26 23:25:13 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 23:25:13 user nova-compute[73497]:         </nova:port>
Aug 26 23:25:13 user nova-compute[73497]:       </nova:ports>
Aug 26 23:25:13 user nova-compute[73497]:     </nova:instance>
Aug 26 23:25:13 user nova-compute[73497]:   </metadata>
Aug 26 23:25:13 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:25:13 user nova-compute[73497]:     <system>
Aug 26 23:25:13 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:25:13 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:25:13 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:25:13 user nova-compute[73497]:       <entry name="serial">93f6eb6e-272f-4b1e-b1d5-40769bf07165</entry>
Aug 26 23:25:13 user nova-compute[73497]:       <entry name="uuid">93f6eb6e-272f-4b1e-b1d5-40769bf07165</entry>
Aug 26 23:25:13 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:25:13 user nova-compute[73497]:     </system>
Aug 26 23:25:13 user nova-compute[73497]:   </sysinfo>
Aug 26 23:25:13 user nova-compute[73497]:   <os>
Aug 26 23:25:13 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:25:13 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:25:13 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:25:13 user nova-compute[73497]:   </os>
Aug 26 23:25:13 user nova-compute[73497]:   <features>
Aug 26 23:25:13 user nova-compute[73497]:     <acpi/>
Aug 26 23:25:13 user nova-compute[73497]:     <apic/>
Aug 26 23:25:13 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:25:13 user nova-compute[73497]:   </features>
Aug 26 23:25:13 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:25:13 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:25:13 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:25:13 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:25:13 user nova-compute[73497]:   </clock>
Aug 26 23:25:13 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:25:13 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:25:13 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:25:13 user nova-compute[73497]:   </cpu>
Aug 26 23:25:13 user nova-compute[73497]:   <devices>
Aug 26 23:25:13 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:25:13 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:25:13 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/93f6eb6e-272f-4b1e-b1d5-40769bf07165/disk"/>
Aug 26 23:25:13 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:25:13 user nova-compute[73497]:     </disk>
Aug 26 23:25:13 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:25:13 user nova-compute[73497]:       <mac address="fa:16:3e:d9:19:3d"/>
Aug 26 23:25:13 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:25:13 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:25:13 user nova-compute[73497]:       <target dev="tapc922af50-fe"/>
Aug 26 23:25:13 user nova-compute[73497]:     </interface>
Aug 26 23:25:13 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:25:13 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/93f6eb6e-272f-4b1e-b1d5-40769bf07165/console.log" append="off"/>
Aug 26 23:25:13 user nova-compute[73497]:     </serial>
Aug 26 23:25:13 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:25:13 user nova-compute[73497]:     <video>
Aug 26 23:25:13 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:25:13 user nova-compute[73497]:     </video>
Aug 26 23:25:13 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:25:13 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:25:13 user nova-compute[73497]:     </rng>
Aug 26 23:25:13 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:25:13 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:25:13 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:25:13 user nova-compute[73497]:     </memballoon>
Aug 26 23:25:13 user nova-compute[73497]:   </devices>
Aug 26 23:25:13 user nova-compute[73497]: </domain>
Aug 26 23:25:13 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:25:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:25:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-842605694',display_name='tempest-AttachVolumeNegativeTest-server-842605694',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-842605694',id=30,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2Zz4WI1YLvvHF9BPHORG6tZi/a8HDTCrZeDvmmRk8SgHrJ1UNTfHsXv26/j91ITHMdIUPZMlB08W/noq3+swSs0M0suoExVI5PLHTPdgGokWqYzDCB5zw6eIgP1uZAvQ==',key_name='tempest-keypair-401471657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d784b1d6c31e41d6a03fc377b0be69f5',ramdisk_id='',reservation_id='r-fcjcd0e8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1095215256',owner_user_name='tempest-AttachVolumeNegativeTest-1095215256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:25:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e38409b92a95475db83540cbc4222466',uuid=93f6eb6e-272f-4b1e-b1d5-40769bf07165,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c922af50-fef8-4a98-8642-f6a4df1fae6c", "address": "fa:16:3e:d9:19:3d", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc922af50-fe", "ovs_interfaceid": "c922af50-fef8-4a98-8642-f6a4df1fae6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:25:13 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Converting VIF {"id": "c922af50-fef8-4a98-8642-f6a4df1fae6c", "address": "fa:16:3e:d9:19:3d", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc922af50-fe", "ovs_interfaceid": "c922af50-fef8-4a98-8642-f6a4df1fae6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:25:13 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:19:3d,bridge_name='br-int',has_traffic_filtering=True,id=c922af50-fef8-4a98-8642-f6a4df1fae6c,network=Network(7bae9729-050d-4ff3-a842-91d0ec2c08d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc922af50-fe') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:25:13 user nova-compute[73497]: DEBUG os_vif [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:19:3d,bridge_name='br-int',has_traffic_filtering=True,id=c922af50-fef8-4a98-8642-f6a4df1fae6c,network=Network(7bae9729-050d-4ff3-a842-91d0ec2c08d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc922af50-fe') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:25:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:25:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:25:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc922af50-fe, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:25:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc922af50-fe, col_values=(('external_ids', {'iface-id': 'c922af50-fef8-4a98-8642-f6a4df1fae6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:19:3d', 'vm-uuid': '93f6eb6e-272f-4b1e-b1d5-40769bf07165'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:25:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:25:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:13 user nova-compute[73497]: INFO os_vif [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:19:3d,bridge_name='br-int',has_traffic_filtering=True,id=c922af50-fef8-4a98-8642-f6a4df1fae6c,network=Network(7bae9729-050d-4ff3-a842-91d0ec2c08d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc922af50-fe')
Aug 26 23:25:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:25:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] No VIF found with MAC fa:16:3e:d9:19:3d, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:25:13 user nova-compute[73497]: DEBUG nova.network.neutron [req-186c3f8c-c42d-4897-b5b0-2c867cd1c254 req-905f1484-6d80-4db8-b0df-99a29f57491f service nova] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Updated VIF entry in instance network info cache for port c922af50-fef8-4a98-8642-f6a4df1fae6c. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:25:13 user nova-compute[73497]: DEBUG nova.network.neutron [req-186c3f8c-c42d-4897-b5b0-2c867cd1c254 req-905f1484-6d80-4db8-b0df-99a29f57491f service nova] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Updating instance_info_cache with network_info: [{"id": "c922af50-fef8-4a98-8642-f6a4df1fae6c", "address": "fa:16:3e:d9:19:3d", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc922af50-fe", "ovs_interfaceid": "c922af50-fef8-4a98-8642-f6a4df1fae6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:25:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-186c3f8c-c42d-4897-b5b0-2c867cd1c254 req-905f1484-6d80-4db8-b0df-99a29f57491f service nova] Releasing lock "refresh_cache-93f6eb6e-272f-4b1e-b1d5-40769bf07165" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:25:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:14 user nova-compute[73497]: DEBUG nova.compute.manager [req-fc1e4c67-a251-4778-9b45-8531d6a4271f req-847f3bdf-24be-417f-8118-38075b9e43a9 service nova] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Received event network-vif-plugged-c922af50-fef8-4a98-8642-f6a4df1fae6c {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:25:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-fc1e4c67-a251-4778-9b45-8531d6a4271f req-847f3bdf-24be-417f-8118-38075b9e43a9 service nova] Acquiring lock "93f6eb6e-272f-4b1e-b1d5-40769bf07165-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-fc1e4c67-a251-4778-9b45-8531d6a4271f req-847f3bdf-24be-417f-8118-38075b9e43a9 service nova] Lock "93f6eb6e-272f-4b1e-b1d5-40769bf07165-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-fc1e4c67-a251-4778-9b45-8531d6a4271f req-847f3bdf-24be-417f-8118-38075b9e43a9 service nova] Lock "93f6eb6e-272f-4b1e-b1d5-40769bf07165-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:14 user nova-compute[73497]: DEBUG nova.compute.manager [req-fc1e4c67-a251-4778-9b45-8531d6a4271f req-847f3bdf-24be-417f-8118-38075b9e43a9 service nova] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] No waiting events found dispatching network-vif-plugged-c922af50-fef8-4a98-8642-f6a4df1fae6c {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:25:14 user nova-compute[73497]: WARNING nova.compute.manager [req-fc1e4c67-a251-4778-9b45-8531d6a4271f req-847f3bdf-24be-417f-8118-38075b9e43a9 service nova] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Received unexpected event network-vif-plugged-c922af50-fef8-4a98-8642-f6a4df1fae6c for instance with vm_state building and task_state spawning.
Aug 26 23:25:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:16 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092316.6621966, 93f6eb6e-272f-4b1e-b1d5-40769bf07165 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:25:16 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] VM Resumed (Lifecycle Event)
Aug 26 23:25:16 user nova-compute[73497]: DEBUG nova.compute.manager [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:25:16 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:25:16 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Instance spawned successfully.
Aug 26 23:25:16 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:25:16 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:25:16 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:25:16 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:25:16 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:25:16 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:25:16 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:25:16 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:25:16 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:25:16 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:25:16 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092316.6659057, 93f6eb6e-272f-4b1e-b1d5-40769bf07165 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:25:16 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] VM Started (Lifecycle Event)
Aug 26 23:25:16 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:25:16 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:25:16 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:25:16 user nova-compute[73497]: INFO nova.compute.manager [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Took 6.03 seconds to spawn the instance on the hypervisor.
Aug 26 23:25:16 user nova-compute[73497]: DEBUG nova.compute.manager [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:25:16 user nova-compute[73497]: DEBUG nova.compute.manager [req-4be04608-6cee-42a2-a946-2edd3cd9d3d9 req-4b452d65-d712-4d0b-9f80-78261a4ece64 service nova] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Received event network-vif-plugged-c922af50-fef8-4a98-8642-f6a4df1fae6c {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:25:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4be04608-6cee-42a2-a946-2edd3cd9d3d9 req-4b452d65-d712-4d0b-9f80-78261a4ece64 service nova] Acquiring lock "93f6eb6e-272f-4b1e-b1d5-40769bf07165-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4be04608-6cee-42a2-a946-2edd3cd9d3d9 req-4b452d65-d712-4d0b-9f80-78261a4ece64 service nova] Lock "93f6eb6e-272f-4b1e-b1d5-40769bf07165-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4be04608-6cee-42a2-a946-2edd3cd9d3d9 req-4b452d65-d712-4d0b-9f80-78261a4ece64 service nova] Lock "93f6eb6e-272f-4b1e-b1d5-40769bf07165-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:16 user nova-compute[73497]: DEBUG nova.compute.manager [req-4be04608-6cee-42a2-a946-2edd3cd9d3d9 req-4b452d65-d712-4d0b-9f80-78261a4ece64 service nova] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] No waiting events found dispatching network-vif-plugged-c922af50-fef8-4a98-8642-f6a4df1fae6c {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:25:16 user nova-compute[73497]: WARNING nova.compute.manager [req-4be04608-6cee-42a2-a946-2edd3cd9d3d9 req-4b452d65-d712-4d0b-9f80-78261a4ece64 service nova] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Received unexpected event network-vif-plugged-c922af50-fef8-4a98-8642-f6a4df1fae6c for instance with vm_state building and task_state spawning.
Aug 26 23:25:16 user nova-compute[73497]: INFO nova.compute.manager [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Took 6.87 seconds to build instance.
Aug 26 23:25:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0f3504a2-3060-415f-824e-b6c52e0273d0 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "93f6eb6e-272f-4b1e-b1d5-40769bf07165" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.066s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:20 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693092305.7230396, ee6283d5-40de-432d-997c-0be52ff673ca => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:25:20 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] VM Stopped (Lifecycle Event)
Aug 26 23:25:20 user nova-compute[73497]: DEBUG nova.compute.manager [None req-f1db2ef6-b42b-47ef-b2e7-e2981ca57eb7 None None] [instance: ee6283d5-40de-432d-997c-0be52ff673ca] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:25:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:23 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:26 user nova-compute[73497]: INFO nova.compute.manager [None req-c0bf8dc4-da8b-4475-accb-06f055aedc7a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Unrescuing
Aug 26 23:25:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c0bf8dc4-da8b-4475-accb-06f055aedc7a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "refresh_cache-043294e5-0618-4a31-bb19-1227ef1f5d39" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:25:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c0bf8dc4-da8b-4475-accb-06f055aedc7a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquired lock "refresh_cache-043294e5-0618-4a31-bb19-1227ef1f5d39" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:25:26 user nova-compute[73497]: DEBUG nova.network.neutron [None req-c0bf8dc4-da8b-4475-accb-06f055aedc7a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:25:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:27 user nova-compute[73497]: DEBUG nova.network.neutron [None req-c0bf8dc4-da8b-4475-accb-06f055aedc7a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Updating instance_info_cache with network_info: [{"id": "de273950-9851-448e-8ca2-ac699c12994e", "address": "fa:16:3e:fe:2b:69", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde273950-98", "ovs_interfaceid": "de273950-9851-448e-8ca2-ac699c12994e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:25:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c0bf8dc4-da8b-4475-accb-06f055aedc7a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Releasing lock "refresh_cache-043294e5-0618-4a31-bb19-1227ef1f5d39" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:25:27 user nova-compute[73497]: DEBUG nova.objects.instance [None req-c0bf8dc4-da8b-4475-accb-06f055aedc7a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lazy-loading 'flavor' on Instance uuid 043294e5-0618-4a31-bb19-1227ef1f5d39 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:25:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:28 user nova-compute[73497]: DEBUG nova.compute.manager [req-2a10577e-bb74-4125-ab37-08060fb4ba1c req-21d4c4ae-0067-487b-904e-51fcabf46e17 service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Received event network-vif-unplugged-de273950-9851-448e-8ca2-ac699c12994e {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:25:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2a10577e-bb74-4125-ab37-08060fb4ba1c req-21d4c4ae-0067-487b-904e-51fcabf46e17 service nova] Acquiring lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2a10577e-bb74-4125-ab37-08060fb4ba1c req-21d4c4ae-0067-487b-904e-51fcabf46e17 service nova] Lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2a10577e-bb74-4125-ab37-08060fb4ba1c req-21d4c4ae-0067-487b-904e-51fcabf46e17 service nova] Lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:28 user nova-compute[73497]: DEBUG nova.compute.manager [req-2a10577e-bb74-4125-ab37-08060fb4ba1c req-21d4c4ae-0067-487b-904e-51fcabf46e17 service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] No waiting events found dispatching network-vif-unplugged-de273950-9851-448e-8ca2-ac699c12994e {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:25:28 user nova-compute[73497]: WARNING nova.compute.manager [req-2a10577e-bb74-4125-ab37-08060fb4ba1c req-21d4c4ae-0067-487b-904e-51fcabf46e17 service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Received unexpected event network-vif-unplugged-de273950-9851-448e-8ca2-ac699c12994e for instance with vm_state rescued and task_state unrescuing.
Aug 26 23:25:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:28 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Instance destroyed successfully.
Aug 26 23:25:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:30 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:30 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:30 user nova-compute[73497]: DEBUG nova.compute.manager [req-02bf68a9-ef73-4280-9580-d60fcf911c2c req-d42d23e3-fbcc-412f-8d5e-69e9933606ea service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Received event network-vif-plugged-de273950-9851-448e-8ca2-ac699c12994e {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:25:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-02bf68a9-ef73-4280-9580-d60fcf911c2c req-d42d23e3-fbcc-412f-8d5e-69e9933606ea service nova] Acquiring lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-02bf68a9-ef73-4280-9580-d60fcf911c2c req-d42d23e3-fbcc-412f-8d5e-69e9933606ea service nova] Lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-02bf68a9-ef73-4280-9580-d60fcf911c2c req-d42d23e3-fbcc-412f-8d5e-69e9933606ea service nova] Lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:30 user nova-compute[73497]: DEBUG nova.compute.manager [req-02bf68a9-ef73-4280-9580-d60fcf911c2c req-d42d23e3-fbcc-412f-8d5e-69e9933606ea service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] No waiting events found dispatching network-vif-plugged-de273950-9851-448e-8ca2-ac699c12994e {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:25:30 user nova-compute[73497]: WARNING nova.compute.manager [req-02bf68a9-ef73-4280-9580-d60fcf911c2c req-d42d23e3-fbcc-412f-8d5e-69e9933606ea service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Received unexpected event network-vif-plugged-de273950-9851-448e-8ca2-ac699c12994e for instance with vm_state rescued and task_state unrescuing.
Aug 26 23:25:30 user nova-compute[73497]: DEBUG nova.compute.manager [req-02bf68a9-ef73-4280-9580-d60fcf911c2c req-d42d23e3-fbcc-412f-8d5e-69e9933606ea service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Received event network-vif-plugged-de273950-9851-448e-8ca2-ac699c12994e {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:25:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-02bf68a9-ef73-4280-9580-d60fcf911c2c req-d42d23e3-fbcc-412f-8d5e-69e9933606ea service nova] Acquiring lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-02bf68a9-ef73-4280-9580-d60fcf911c2c req-d42d23e3-fbcc-412f-8d5e-69e9933606ea service nova] Lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-02bf68a9-ef73-4280-9580-d60fcf911c2c req-d42d23e3-fbcc-412f-8d5e-69e9933606ea service nova] Lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:30 user nova-compute[73497]: DEBUG nova.compute.manager [req-02bf68a9-ef73-4280-9580-d60fcf911c2c req-d42d23e3-fbcc-412f-8d5e-69e9933606ea service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] No waiting events found dispatching network-vif-plugged-de273950-9851-448e-8ca2-ac699c12994e {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:25:30 user nova-compute[73497]: WARNING nova.compute.manager [req-02bf68a9-ef73-4280-9580-d60fcf911c2c req-d42d23e3-fbcc-412f-8d5e-69e9933606ea service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Received unexpected event network-vif-plugged-de273950-9851-448e-8ca2-ac699c12994e for instance with vm_state rescued and task_state unrescuing.
Aug 26 23:25:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-57554b98-d8f2-47a6-8bcc-4bcbfaa76beb tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Acquiring lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-57554b98-d8f2-47a6-8bcc-4bcbfaa76beb tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-57554b98-d8f2-47a6-8bcc-4bcbfaa76beb tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Acquiring lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-57554b98-d8f2-47a6-8bcc-4bcbfaa76beb tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-57554b98-d8f2-47a6-8bcc-4bcbfaa76beb tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:30 user nova-compute[73497]: INFO nova.compute.manager [None req-57554b98-d8f2-47a6-8bcc-4bcbfaa76beb tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Terminating instance
Aug 26 23:25:30 user nova-compute[73497]: DEBUG nova.compute.manager [None req-57554b98-d8f2-47a6-8bcc-4bcbfaa76beb tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:25:30 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:30 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:30 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:30 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:30 user nova-compute[73497]: DEBUG nova.compute.manager [req-e20ce22a-50f0-4b46-ac92-64ee3fab97d0 req-851691aa-8b17-489e-8626-3d8a46116b94 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Received event network-vif-unplugged-127a3626-0dfe-4050-83d8-43658958e8df {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:25:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-e20ce22a-50f0-4b46-ac92-64ee3fab97d0 req-851691aa-8b17-489e-8626-3d8a46116b94 service nova] Acquiring lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-e20ce22a-50f0-4b46-ac92-64ee3fab97d0 req-851691aa-8b17-489e-8626-3d8a46116b94 service nova] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-e20ce22a-50f0-4b46-ac92-64ee3fab97d0 req-851691aa-8b17-489e-8626-3d8a46116b94 service nova] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:30 user nova-compute[73497]: DEBUG nova.compute.manager [req-e20ce22a-50f0-4b46-ac92-64ee3fab97d0 req-851691aa-8b17-489e-8626-3d8a46116b94 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] No waiting events found dispatching network-vif-unplugged-127a3626-0dfe-4050-83d8-43658958e8df {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:25:30 user nova-compute[73497]: DEBUG nova.compute.manager [req-e20ce22a-50f0-4b46-ac92-64ee3fab97d0 req-851691aa-8b17-489e-8626-3d8a46116b94 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Received event network-vif-unplugged-127a3626-0dfe-4050-83d8-43658958e8df for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:25:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:31 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Instance destroyed successfully.
Aug 26 23:25:31 user nova-compute[73497]: DEBUG nova.objects.instance [None req-57554b98-d8f2-47a6-8bcc-4bcbfaa76beb tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lazy-loading 'resources' on Instance uuid 7c124dd9-4dce-4c6f-925c-6eda8e187d84 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:25:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-57554b98-d8f2-47a6-8bcc-4bcbfaa76beb tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1727169761',display_name='tempest-ServerStableDeviceRescueTest-server-1727169761',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1727169761',id=17,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0c6dCTiAMo7WCdbWslqH9tRAbJDKdO8xWor1zTiSdHMPGnIJqmEvuGj4G36lWhcWYWS/KgnWVp5bD+V07b0Shoxky7106vuRftXiegNWPYOB3XSzzs7Pa+BYY/5QFS6Q==',key_name='tempest-keypair-1129487804',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:22:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d19a5c1c2c4a456a86efbbadd38d94c6',ramdisk_id='',reservation_id='r-3ltexvmi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1149676122',owner_user_name='tempest-ServerStableDeviceRescueTest-1149676122-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:24:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5745595130cb414283855ace84751a92',uuid=7c124dd9-4dce-4c6f-925c-6eda8e187d84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "127a3626-0dfe-4050-83d8-43658958e8df", "address": "fa:16:3e:1c:46:66", "network": {"id": "0b5f5877-f6f2-4814-878a-25181e72db29", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-155251039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19a5c1c2c4a456a86efbbadd38d94c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127a3626-0d", "ovs_interfaceid": "127a3626-0dfe-4050-83d8-43658958e8df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:25:31 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-57554b98-d8f2-47a6-8bcc-4bcbfaa76beb tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Converting VIF {"id": "127a3626-0dfe-4050-83d8-43658958e8df", "address": "fa:16:3e:1c:46:66", "network": {"id": "0b5f5877-f6f2-4814-878a-25181e72db29", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-155251039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19a5c1c2c4a456a86efbbadd38d94c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127a3626-0d", "ovs_interfaceid": "127a3626-0dfe-4050-83d8-43658958e8df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:25:31 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-57554b98-d8f2-47a6-8bcc-4bcbfaa76beb tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:46:66,bridge_name='br-int',has_traffic_filtering=True,id=127a3626-0dfe-4050-83d8-43658958e8df,network=Network(0b5f5877-f6f2-4814-878a-25181e72db29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap127a3626-0d') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:25:31 user nova-compute[73497]: DEBUG os_vif [None req-57554b98-d8f2-47a6-8bcc-4bcbfaa76beb tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:46:66,bridge_name='br-int',has_traffic_filtering=True,id=127a3626-0dfe-4050-83d8-43658958e8df,network=Network(0b5f5877-f6f2-4814-878a-25181e72db29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap127a3626-0d') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:25:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap127a3626-0d, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:25:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:31 user nova-compute[73497]: INFO os_vif [None req-57554b98-d8f2-47a6-8bcc-4bcbfaa76beb tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:46:66,bridge_name='br-int',has_traffic_filtering=True,id=127a3626-0dfe-4050-83d8-43658958e8df,network=Network(0b5f5877-f6f2-4814-878a-25181e72db29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap127a3626-0d')
Aug 26 23:25:31 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-57554b98-d8f2-47a6-8bcc-4bcbfaa76beb tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Deleting instance files /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84_del
Aug 26 23:25:31 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-57554b98-d8f2-47a6-8bcc-4bcbfaa76beb tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Deletion of /opt/stack/data/nova/instances/7c124dd9-4dce-4c6f-925c-6eda8e187d84_del complete
Aug 26 23:25:31 user nova-compute[73497]: INFO nova.compute.manager [None req-57554b98-d8f2-47a6-8bcc-4bcbfaa76beb tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 26 23:25:31 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-57554b98-d8f2-47a6-8bcc-4bcbfaa76beb tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:25:31 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:25:31 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:25:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:32 user nova-compute[73497]: DEBUG nova.compute.manager [req-7ec46cd7-ec31-4961-85ec-dd1b80b3caf2 req-434d5fed-fdc2-4888-bd11-7a90b4ba3c04 service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Received event network-vif-plugged-de273950-9851-448e-8ca2-ac699c12994e {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:25:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7ec46cd7-ec31-4961-85ec-dd1b80b3caf2 req-434d5fed-fdc2-4888-bd11-7a90b4ba3c04 service nova] Acquiring lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7ec46cd7-ec31-4961-85ec-dd1b80b3caf2 req-434d5fed-fdc2-4888-bd11-7a90b4ba3c04 service nova] Lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7ec46cd7-ec31-4961-85ec-dd1b80b3caf2 req-434d5fed-fdc2-4888-bd11-7a90b4ba3c04 service nova] Lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:32 user nova-compute[73497]: DEBUG nova.compute.manager [req-7ec46cd7-ec31-4961-85ec-dd1b80b3caf2 req-434d5fed-fdc2-4888-bd11-7a90b4ba3c04 service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] No waiting events found dispatching network-vif-plugged-de273950-9851-448e-8ca2-ac699c12994e {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:25:32 user nova-compute[73497]: WARNING nova.compute.manager [req-7ec46cd7-ec31-4961-85ec-dd1b80b3caf2 req-434d5fed-fdc2-4888-bd11-7a90b4ba3c04 service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Received unexpected event network-vif-plugged-de273950-9851-448e-8ca2-ac699c12994e for instance with vm_state rescued and task_state unrescuing.
Aug 26 23:25:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Removed pending event for 043294e5-0618-4a31-bb19-1227ef1f5d39 due to event {{(pid=73497) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 23:25:32 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092332.4124134, 043294e5-0618-4a31-bb19-1227ef1f5d39 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:25:32 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] VM Resumed (Lifecycle Event)
Aug 26 23:25:32 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c0bf8dc4-da8b-4475-accb-06f055aedc7a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:25:32 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:25:32 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:25:32 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 23:25:32 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092332.4152026, 043294e5-0618-4a31-bb19-1227ef1f5d39 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:25:32 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] VM Started (Lifecycle Event)
Aug 26 23:25:32 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:25:32 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:25:32 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:25:32 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Took 1.53 seconds to deallocate network for instance.
Aug 26 23:25:32 user nova-compute[73497]: DEBUG nova.compute.manager [req-a61aa9a4-ffec-4882-92e1-0b78132c2d24 req-f16e416c-66cb-4126-add0-86db01010090 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Received event network-vif-plugged-127a3626-0dfe-4050-83d8-43658958e8df {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:25:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a61aa9a4-ffec-4882-92e1-0b78132c2d24 req-f16e416c-66cb-4126-add0-86db01010090 service nova] Acquiring lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a61aa9a4-ffec-4882-92e1-0b78132c2d24 req-f16e416c-66cb-4126-add0-86db01010090 service nova] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a61aa9a4-ffec-4882-92e1-0b78132c2d24 req-f16e416c-66cb-4126-add0-86db01010090 service nova] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:32 user nova-compute[73497]: DEBUG nova.compute.manager [req-a61aa9a4-ffec-4882-92e1-0b78132c2d24 req-f16e416c-66cb-4126-add0-86db01010090 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] No waiting events found dispatching network-vif-plugged-127a3626-0dfe-4050-83d8-43658958e8df {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:25:32 user nova-compute[73497]: WARNING nova.compute.manager [req-a61aa9a4-ffec-4882-92e1-0b78132c2d24 req-f16e416c-66cb-4126-add0-86db01010090 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Received unexpected event network-vif-plugged-127a3626-0dfe-4050-83d8-43658958e8df for instance with vm_state active and task_state deleting.
Aug 26 23:25:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-57554b98-d8f2-47a6-8bcc-4bcbfaa76beb tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-57554b98-d8f2-47a6-8bcc-4bcbfaa76beb tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:33 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-57554b98-d8f2-47a6-8bcc-4bcbfaa76beb tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:25:33 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-57554b98-d8f2-47a6-8bcc-4bcbfaa76beb tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:25:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-57554b98-d8f2-47a6-8bcc-4bcbfaa76beb tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.606s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:33 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-57554b98-d8f2-47a6-8bcc-4bcbfaa76beb tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Deleted allocations for instance 7c124dd9-4dce-4c6f-925c-6eda8e187d84
Aug 26 23:25:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-57554b98-d8f2-47a6-8bcc-4bcbfaa76beb tempest-ServerStableDeviceRescueTest-1149676122 tempest-ServerStableDeviceRescueTest-1149676122-project-member] Lock "7c124dd9-4dce-4c6f-925c-6eda8e187d84" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.365s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:34 user nova-compute[73497]: DEBUG nova.compute.manager [req-9673a298-9afb-4312-958a-958cf9b63213 req-9be3753c-bd27-483b-9dab-fc360828dad5 service nova] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Received event network-vif-deleted-127a3626-0dfe-4050-83d8-43658958e8df {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:25:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:40 user nova-compute[73497]: DEBUG nova.compute.manager [req-5d057f4a-eaeb-453a-a4da-85e1b2d49f81 req-5c499e45-d042-4d5e-bda5-9efeb682b5bf service nova] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Received event network-changed-dc5326bf-72f0-4067-9fcc-420f0d1434aa {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:25:40 user nova-compute[73497]: DEBUG nova.compute.manager [req-5d057f4a-eaeb-453a-a4da-85e1b2d49f81 req-5c499e45-d042-4d5e-bda5-9efeb682b5bf service nova] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Refreshing instance network info cache due to event network-changed-dc5326bf-72f0-4067-9fcc-420f0d1434aa. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:25:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-5d057f4a-eaeb-453a-a4da-85e1b2d49f81 req-5c499e45-d042-4d5e-bda5-9efeb682b5bf service nova] Acquiring lock "refresh_cache-4c68f140-4235-4dcb-b99d-1347bc949d15" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:25:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-5d057f4a-eaeb-453a-a4da-85e1b2d49f81 req-5c499e45-d042-4d5e-bda5-9efeb682b5bf service nova] Acquired lock "refresh_cache-4c68f140-4235-4dcb-b99d-1347bc949d15" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:25:40 user nova-compute[73497]: DEBUG nova.network.neutron [req-5d057f4a-eaeb-453a-a4da-85e1b2d49f81 req-5c499e45-d042-4d5e-bda5-9efeb682b5bf service nova] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Refreshing network info cache for port dc5326bf-72f0-4067-9fcc-420f0d1434aa {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:25:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-05100674-2ac6-4355-8d38-6362fcad0b63 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Acquiring lock "4c68f140-4235-4dcb-b99d-1347bc949d15" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-05100674-2ac6-4355-8d38-6362fcad0b63 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "4c68f140-4235-4dcb-b99d-1347bc949d15" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-05100674-2ac6-4355-8d38-6362fcad0b63 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Acquiring lock "4c68f140-4235-4dcb-b99d-1347bc949d15-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-05100674-2ac6-4355-8d38-6362fcad0b63 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "4c68f140-4235-4dcb-b99d-1347bc949d15-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-05100674-2ac6-4355-8d38-6362fcad0b63 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "4c68f140-4235-4dcb-b99d-1347bc949d15-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:40 user nova-compute[73497]: INFO nova.compute.manager [None req-05100674-2ac6-4355-8d38-6362fcad0b63 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Terminating instance
Aug 26 23:25:40 user nova-compute[73497]: DEBUG nova.compute.manager [None req-05100674-2ac6-4355-8d38-6362fcad0b63 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:25:40 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:40 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:40 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:40 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:40 user nova-compute[73497]: DEBUG nova.compute.manager [req-745aeb4a-543e-4d3b-9492-f6615b3bbae3 req-90b988ae-045a-4b53-be9b-713385b35d8a service nova] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Received event network-vif-unplugged-dc5326bf-72f0-4067-9fcc-420f0d1434aa {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:25:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-745aeb4a-543e-4d3b-9492-f6615b3bbae3 req-90b988ae-045a-4b53-be9b-713385b35d8a service nova] Acquiring lock "4c68f140-4235-4dcb-b99d-1347bc949d15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-745aeb4a-543e-4d3b-9492-f6615b3bbae3 req-90b988ae-045a-4b53-be9b-713385b35d8a service nova] Lock "4c68f140-4235-4dcb-b99d-1347bc949d15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-745aeb4a-543e-4d3b-9492-f6615b3bbae3 req-90b988ae-045a-4b53-be9b-713385b35d8a service nova] Lock "4c68f140-4235-4dcb-b99d-1347bc949d15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:40 user nova-compute[73497]: DEBUG nova.compute.manager [req-745aeb4a-543e-4d3b-9492-f6615b3bbae3 req-90b988ae-045a-4b53-be9b-713385b35d8a service nova] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] No waiting events found dispatching network-vif-unplugged-dc5326bf-72f0-4067-9fcc-420f0d1434aa {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:25:40 user nova-compute[73497]: DEBUG nova.compute.manager [req-745aeb4a-543e-4d3b-9492-f6615b3bbae3 req-90b988ae-045a-4b53-be9b-713385b35d8a service nova] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Received event network-vif-unplugged-dc5326bf-72f0-4067-9fcc-420f0d1434aa for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:25:40 user nova-compute[73497]: DEBUG nova.network.neutron [req-5d057f4a-eaeb-453a-a4da-85e1b2d49f81 req-5c499e45-d042-4d5e-bda5-9efeb682b5bf service nova] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Updated VIF entry in instance network info cache for port dc5326bf-72f0-4067-9fcc-420f0d1434aa. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:25:40 user nova-compute[73497]: DEBUG nova.network.neutron [req-5d057f4a-eaeb-453a-a4da-85e1b2d49f81 req-5c499e45-d042-4d5e-bda5-9efeb682b5bf service nova] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Updating instance_info_cache with network_info: [{"id": "dc5326bf-72f0-4067-9fcc-420f0d1434aa", "address": "fa:16:3e:d0:86:2a", "network": {"id": "e5209dd2-0f09-4bab-b0a6-b486792104a3", "bridge": "br-int", "label": "tempest-TestStampPattern-819945601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a539515b1f47d39d42e182bef80e63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc5326bf-72", "ovs_interfaceid": "dc5326bf-72f0-4067-9fcc-420f0d1434aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:25:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-5d057f4a-eaeb-453a-a4da-85e1b2d49f81 req-5c499e45-d042-4d5e-bda5-9efeb682b5bf service nova] Releasing lock "refresh_cache-4c68f140-4235-4dcb-b99d-1347bc949d15" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:25:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:41 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Instance destroyed successfully.
Aug 26 23:25:41 user nova-compute[73497]: DEBUG nova.objects.instance [None req-05100674-2ac6-4355-8d38-6362fcad0b63 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lazy-loading 'resources' on Instance uuid 4c68f140-4235-4dcb-b99d-1347bc949d15 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:25:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-05100674-2ac6-4355-8d38-6362fcad0b63 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:18:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1321416268',display_name='tempest-TestStampPattern-server-1321416268',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1321416268',id=18,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSpNmqRMbMJd2f6kUSzLECN5mko6NqxFamfd/k4MFhK1XP2WLUCDpa9g6XZBlQKoHW+wuTTi/MsaMFncPcqVt3DKC1QEzKz7chFIzuhFpmCMAj7D379vAGPFvW3AZm1hg==',key_name='tempest-TestStampPattern-584336943',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:18:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04a539515b1f47d39d42e182bef80e63',ramdisk_id='',reservation_id='r-bizxvo00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-2000771312',owner_user_name='tempest-TestStampPattern-2000771312-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:21:31Z,user_data=None,user_id='0e79225b05f24fb89cb3537ec6d983d9',uuid=4c68f140-4235-4dcb-b99d-1347bc949d15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc5326bf-72f0-4067-9fcc-420f0d1434aa", "address": "fa:16:3e:d0:86:2a", "network": {"id": "e5209dd2-0f09-4bab-b0a6-b486792104a3", "bridge": "br-int", "label": "tempest-TestStampPattern-819945601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a539515b1f47d39d42e182bef80e63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc5326bf-72", "ovs_interfaceid": "dc5326bf-72f0-4067-9fcc-420f0d1434aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:25:41 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-05100674-2ac6-4355-8d38-6362fcad0b63 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Converting VIF {"id": "dc5326bf-72f0-4067-9fcc-420f0d1434aa", "address": "fa:16:3e:d0:86:2a", "network": {"id": "e5209dd2-0f09-4bab-b0a6-b486792104a3", "bridge": "br-int", "label": "tempest-TestStampPattern-819945601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a539515b1f47d39d42e182bef80e63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc5326bf-72", "ovs_interfaceid": "dc5326bf-72f0-4067-9fcc-420f0d1434aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:25:41 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-05100674-2ac6-4355-8d38-6362fcad0b63 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:86:2a,bridge_name='br-int',has_traffic_filtering=True,id=dc5326bf-72f0-4067-9fcc-420f0d1434aa,network=Network(e5209dd2-0f09-4bab-b0a6-b486792104a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc5326bf-72') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:25:41 user nova-compute[73497]: DEBUG os_vif [None req-05100674-2ac6-4355-8d38-6362fcad0b63 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:86:2a,bridge_name='br-int',has_traffic_filtering=True,id=dc5326bf-72f0-4067-9fcc-420f0d1434aa,network=Network(e5209dd2-0f09-4bab-b0a6-b486792104a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc5326bf-72') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:25:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc5326bf-72, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:25:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:25:41 user nova-compute[73497]: INFO os_vif [None req-05100674-2ac6-4355-8d38-6362fcad0b63 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:86:2a,bridge_name='br-int',has_traffic_filtering=True,id=dc5326bf-72f0-4067-9fcc-420f0d1434aa,network=Network(e5209dd2-0f09-4bab-b0a6-b486792104a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc5326bf-72')
Aug 26 23:25:41 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-05100674-2ac6-4355-8d38-6362fcad0b63 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Deleting instance files /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15_del
Aug 26 23:25:41 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-05100674-2ac6-4355-8d38-6362fcad0b63 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Deletion of /opt/stack/data/nova/instances/4c68f140-4235-4dcb-b99d-1347bc949d15_del complete
Aug 26 23:25:41 user nova-compute[73497]: INFO nova.compute.manager [None req-05100674-2ac6-4355-8d38-6362fcad0b63 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 26 23:25:41 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-05100674-2ac6-4355-8d38-6362fcad0b63 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:25:41 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:25:41 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:25:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:41 user nova-compute[73497]: DEBUG nova.compute.manager [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:25:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:42 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:25:42 user nova-compute[73497]: INFO nova.compute.claims [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Claim successful on node user
Aug 26 23:25:42 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:25:42 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Took 0.79 seconds to deallocate network for instance.
Aug 26 23:25:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-05100674-2ac6-4355-8d38-6362fcad0b63 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:42 user nova-compute[73497]: DEBUG nova.compute.manager [req-60421fb6-9ef7-480e-8717-356cb98af932 req-a3c0577c-055d-4ca4-bb5f-6f7f8ece9841 service nova] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Received event network-vif-deleted-dc5326bf-72f0-4067-9fcc-420f0d1434aa {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:25:42 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:25:42 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:25:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.502s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:42 user nova-compute[73497]: DEBUG nova.compute.manager [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:25:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-05100674-2ac6-4355-8d38-6362fcad0b63 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.217s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:42 user nova-compute[73497]: DEBUG nova.compute.manager [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:25:42 user nova-compute[73497]: DEBUG nova.network.neutron [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:25:42 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:25:42 user nova-compute[73497]: DEBUG nova.compute.manager [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:25:42 user nova-compute[73497]: DEBUG nova.policy [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6e2c1f8d06854e579ee634e33e6de920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f2d1336284b42a8dcbb05e509e9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:25:42 user nova-compute[73497]: DEBUG nova.compute.manager [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:25:42 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:25:42 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Creating image(s)
Aug 26 23:25:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "/opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "/opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "/opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:43 user nova-compute[73497]: DEBUG nova.compute.manager [req-53daf31b-732b-4814-8dcf-882db0cf94e7 req-2fd1e8df-8857-4be5-916d-dde49f8ec0d5 service nova] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Received event network-vif-plugged-dc5326bf-72f0-4067-9fcc-420f0d1434aa {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:25:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-53daf31b-732b-4814-8dcf-882db0cf94e7 req-2fd1e8df-8857-4be5-916d-dde49f8ec0d5 service nova] Acquiring lock "4c68f140-4235-4dcb-b99d-1347bc949d15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-53daf31b-732b-4814-8dcf-882db0cf94e7 req-2fd1e8df-8857-4be5-916d-dde49f8ec0d5 service nova] Lock "4c68f140-4235-4dcb-b99d-1347bc949d15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-53daf31b-732b-4814-8dcf-882db0cf94e7 req-2fd1e8df-8857-4be5-916d-dde49f8ec0d5 service nova] Lock "4c68f140-4235-4dcb-b99d-1347bc949d15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:43 user nova-compute[73497]: DEBUG nova.compute.manager [req-53daf31b-732b-4814-8dcf-882db0cf94e7 req-2fd1e8df-8857-4be5-916d-dde49f8ec0d5 service nova] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] No waiting events found dispatching network-vif-plugged-dc5326bf-72f0-4067-9fcc-420f0d1434aa {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:25:43 user nova-compute[73497]: WARNING nova.compute.manager [req-53daf31b-732b-4814-8dcf-882db0cf94e7 req-2fd1e8df-8857-4be5-916d-dde49f8ec0d5 service nova] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Received unexpected event network-vif-plugged-dc5326bf-72f0-4067-9fcc-420f0d1434aa for instance with vm_state deleted and task_state None.
Aug 26 23:25:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.201s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:43 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-05100674-2ac6-4355-8d38-6362fcad0b63 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:25:43 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-05100674-2ac6-4355-8d38-6362fcad0b63 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:25:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-05100674-2ac6-4355-8d38-6362fcad0b63 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.617s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.188s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:43 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-05100674-2ac6-4355-8d38-6362fcad0b63 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Deleted allocations for instance 4c68f140-4235-4dcb-b99d-1347bc949d15
Aug 26 23:25:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk 1073741824" returned: 0 in 0.048s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-05100674-2ac6-4355-8d38-6362fcad0b63 tempest-TestStampPattern-2000771312 tempest-TestStampPattern-2000771312-project-member] Lock "4c68f140-4235-4dcb-b99d-1347bc949d15" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.884s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.179s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:43 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:25:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:43 user nova-compute[73497]: DEBUG nova.network.neutron [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Successfully created port: 74cddf0f-c302-4ae4-8142-cee5764c7c4f {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:25:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:43 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Cannot resize image /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:25:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:25:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Ensure instance console log exists: /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:25:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG nova.network.neutron [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Successfully updated port: 74cddf0f-c302-4ae4-8142-cee5764c7c4f {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "refresh_cache-f7c83073-fadc-4e41-a4a9-df0bbe11aa28" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquired lock "refresh_cache-f7c83073-fadc-4e41-a4a9-df0bbe11aa28" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG nova.network.neutron [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG nova.network.neutron [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG nova.compute.manager [req-d56d85ce-bfb1-47cc-94ac-8e86c4c24d4e req-ed5a228a-e3d0-4448-853d-1f760aa5e237 service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Received event network-changed-74cddf0f-c302-4ae4-8142-cee5764c7c4f {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG nova.compute.manager [req-d56d85ce-bfb1-47cc-94ac-8e86c4c24d4e req-ed5a228a-e3d0-4448-853d-1f760aa5e237 service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Refreshing instance network info cache due to event network-changed-74cddf0f-c302-4ae4-8142-cee5764c7c4f. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d56d85ce-bfb1-47cc-94ac-8e86c4c24d4e req-ed5a228a-e3d0-4448-853d-1f760aa5e237 service nova] Acquiring lock "refresh_cache-f7c83073-fadc-4e41-a4a9-df0bbe11aa28" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG nova.network.neutron [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Updating instance_info_cache with network_info: [{"id": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "address": "fa:16:3e:cf:bd:9e", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74cddf0f-c3", "ovs_interfaceid": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Releasing lock "refresh_cache-f7c83073-fadc-4e41-a4a9-df0bbe11aa28" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG nova.compute.manager [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Instance network_info: |[{"id": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "address": "fa:16:3e:cf:bd:9e", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74cddf0f-c3", "ovs_interfaceid": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d56d85ce-bfb1-47cc-94ac-8e86c4c24d4e req-ed5a228a-e3d0-4448-853d-1f760aa5e237 service nova] Acquired lock "refresh_cache-f7c83073-fadc-4e41-a4a9-df0bbe11aa28" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG nova.network.neutron [req-d56d85ce-bfb1-47cc-94ac-8e86c4c24d4e req-ed5a228a-e3d0-4448-853d-1f760aa5e237 service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Refreshing network info cache for port 74cddf0f-c302-4ae4-8142-cee5764c7c4f {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Start _get_guest_xml network_info=[{"id": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "address": "fa:16:3e:cf:bd:9e", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74cddf0f-c3", "ovs_interfaceid": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:25:44 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:25:44 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:25:44 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:25:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1284261730',display_name='tempest-AttachVolumeTestJSON-server-1284261730',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1284261730',id=31,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtZgj4CGRRq60nfzAmpM6NX6cbyiNr74c5vhKfLzmguuh54ComCQsitet6gqTOyy+exSU8a+OQZBMej3fWkPoWF9yZ7g9PDakdqjlJxgeAQgaLAVOiZs3e4Hh+0HK9qHg==',key_name='tempest-keypair-1578893874',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e10f2d1336284b42a8dcbb05e509e9bd',ramdisk_id='',reservation_id='r-awwb3svr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1929388969',owner_user_name='tempest-AttachVolumeTestJSON-1929388969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:25:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e2c1f8d06854e579ee634e33e6de920',uuid=f7c83073-fadc-4e41-a4a9-df0bbe11aa28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "address": "fa:16:3e:cf:bd:9e", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74cddf0f-c3", "ovs_interfaceid": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Converting VIF {"id": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "address": "fa:16:3e:cf:bd:9e", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74cddf0f-c3", "ovs_interfaceid": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:bd:9e,bridge_name='br-int',has_traffic_filtering=True,id=74cddf0f-c302-4ae4-8142-cee5764c7c4f,network=Network(77d468df-32fe-45fb-afe7-7ebf9b6b428f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74cddf0f-c3') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG nova.objects.instance [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lazy-loading 'pci_devices' on Instance uuid f7c83073-fadc-4e41-a4a9-df0bbe11aa28 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:25:44 user nova-compute[73497]:   <uuid>f7c83073-fadc-4e41-a4a9-df0bbe11aa28</uuid>
Aug 26 23:25:44 user nova-compute[73497]:   <name>instance-0000001f</name>
Aug 26 23:25:44 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:25:44 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:25:44 user nova-compute[73497]:   <metadata>
Aug 26 23:25:44 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:25:44 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:25:44 user nova-compute[73497]:       <nova:name>tempest-AttachVolumeTestJSON-server-1284261730</nova:name>
Aug 26 23:25:44 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:25:44</nova:creationTime>
Aug 26 23:25:44 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:25:44 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:25:44 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:25:44 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:25:44 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:25:44 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:25:44 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:25:44 user nova-compute[73497]:       <nova:owner>
Aug 26 23:25:44 user nova-compute[73497]:         <nova:user uuid="6e2c1f8d06854e579ee634e33e6de920">tempest-AttachVolumeTestJSON-1929388969-project-member</nova:user>
Aug 26 23:25:44 user nova-compute[73497]:         <nova:project uuid="e10f2d1336284b42a8dcbb05e509e9bd">tempest-AttachVolumeTestJSON-1929388969</nova:project>
Aug 26 23:25:44 user nova-compute[73497]:       </nova:owner>
Aug 26 23:25:44 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:25:44 user nova-compute[73497]:       <nova:ports>
Aug 26 23:25:44 user nova-compute[73497]:         <nova:port uuid="74cddf0f-c302-4ae4-8142-cee5764c7c4f">
Aug 26 23:25:44 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 23:25:44 user nova-compute[73497]:         </nova:port>
Aug 26 23:25:44 user nova-compute[73497]:       </nova:ports>
Aug 26 23:25:44 user nova-compute[73497]:     </nova:instance>
Aug 26 23:25:44 user nova-compute[73497]:   </metadata>
Aug 26 23:25:44 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:25:44 user nova-compute[73497]:     <system>
Aug 26 23:25:44 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:25:44 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:25:44 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:25:44 user nova-compute[73497]:       <entry name="serial">f7c83073-fadc-4e41-a4a9-df0bbe11aa28</entry>
Aug 26 23:25:44 user nova-compute[73497]:       <entry name="uuid">f7c83073-fadc-4e41-a4a9-df0bbe11aa28</entry>
Aug 26 23:25:44 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:25:44 user nova-compute[73497]:     </system>
Aug 26 23:25:44 user nova-compute[73497]:   </sysinfo>
Aug 26 23:25:44 user nova-compute[73497]:   <os>
Aug 26 23:25:44 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:25:44 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:25:44 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:25:44 user nova-compute[73497]:   </os>
Aug 26 23:25:44 user nova-compute[73497]:   <features>
Aug 26 23:25:44 user nova-compute[73497]:     <acpi/>
Aug 26 23:25:44 user nova-compute[73497]:     <apic/>
Aug 26 23:25:44 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:25:44 user nova-compute[73497]:   </features>
Aug 26 23:25:44 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:25:44 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:25:44 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:25:44 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:25:44 user nova-compute[73497]:   </clock>
Aug 26 23:25:44 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:25:44 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:25:44 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:25:44 user nova-compute[73497]:   </cpu>
Aug 26 23:25:44 user nova-compute[73497]:   <devices>
Aug 26 23:25:44 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:25:44 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:25:44 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk"/>
Aug 26 23:25:44 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:25:44 user nova-compute[73497]:     </disk>
Aug 26 23:25:44 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:25:44 user nova-compute[73497]:       <mac address="fa:16:3e:cf:bd:9e"/>
Aug 26 23:25:44 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:25:44 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:25:44 user nova-compute[73497]:       <target dev="tap74cddf0f-c3"/>
Aug 26 23:25:44 user nova-compute[73497]:     </interface>
Aug 26 23:25:44 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:25:44 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/console.log" append="off"/>
Aug 26 23:25:44 user nova-compute[73497]:     </serial>
Aug 26 23:25:44 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:25:44 user nova-compute[73497]:     <video>
Aug 26 23:25:44 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:25:44 user nova-compute[73497]:     </video>
Aug 26 23:25:44 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:25:44 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:25:44 user nova-compute[73497]:     </rng>
Aug 26 23:25:44 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:25:44 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:25:44 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:25:44 user nova-compute[73497]:     </memballoon>
Aug 26 23:25:44 user nova-compute[73497]:   </devices>
Aug 26 23:25:44 user nova-compute[73497]: </domain>
Aug 26 23:25:44 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:25:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1284261730',display_name='tempest-AttachVolumeTestJSON-server-1284261730',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1284261730',id=31,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtZgj4CGRRq60nfzAmpM6NX6cbyiNr74c5vhKfLzmguuh54ComCQsitet6gqTOyy+exSU8a+OQZBMej3fWkPoWF9yZ7g9PDakdqjlJxgeAQgaLAVOiZs3e4Hh+0HK9qHg==',key_name='tempest-keypair-1578893874',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e10f2d1336284b42a8dcbb05e509e9bd',ramdisk_id='',reservation_id='r-awwb3svr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1929388969',owner_user_name='tempest-AttachVolumeTestJSON-1929388969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:25:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e2c1f8d06854e579ee634e33e6de920',uuid=f7c83073-fadc-4e41-a4a9-df0bbe11aa28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "address": "fa:16:3e:cf:bd:9e", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74cddf0f-c3", "ovs_interfaceid": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Converting VIF {"id": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "address": "fa:16:3e:cf:bd:9e", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74cddf0f-c3", "ovs_interfaceid": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:bd:9e,bridge_name='br-int',has_traffic_filtering=True,id=74cddf0f-c302-4ae4-8142-cee5764c7c4f,network=Network(77d468df-32fe-45fb-afe7-7ebf9b6b428f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74cddf0f-c3') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG os_vif [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:bd:9e,bridge_name='br-int',has_traffic_filtering=True,id=74cddf0f-c302-4ae4-8142-cee5764c7c4f,network=Network(77d468df-32fe-45fb-afe7-7ebf9b6b428f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74cddf0f-c3') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74cddf0f-c3, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap74cddf0f-c3, col_values=(('external_ids', {'iface-id': '74cddf0f-c302-4ae4-8142-cee5764c7c4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:bd:9e', 'vm-uuid': 'f7c83073-fadc-4e41-a4a9-df0bbe11aa28'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:25:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:44 user nova-compute[73497]: INFO os_vif [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:bd:9e,bridge_name='br-int',has_traffic_filtering=True,id=74cddf0f-c302-4ae4-8142-cee5764c7c4f,network=Network(77d468df-32fe-45fb-afe7-7ebf9b6b428f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74cddf0f-c3')
Aug 26 23:25:45 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:25:45 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] No VIF found with MAC fa:16:3e:cf:bd:9e, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:25:45 user nova-compute[73497]: DEBUG nova.network.neutron [req-d56d85ce-bfb1-47cc-94ac-8e86c4c24d4e req-ed5a228a-e3d0-4448-853d-1f760aa5e237 service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Updated VIF entry in instance network info cache for port 74cddf0f-c302-4ae4-8142-cee5764c7c4f. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:25:45 user nova-compute[73497]: DEBUG nova.network.neutron [req-d56d85ce-bfb1-47cc-94ac-8e86c4c24d4e req-ed5a228a-e3d0-4448-853d-1f760aa5e237 service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Updating instance_info_cache with network_info: [{"id": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "address": "fa:16:3e:cf:bd:9e", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74cddf0f-c3", "ovs_interfaceid": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:25:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d56d85ce-bfb1-47cc-94ac-8e86c4c24d4e req-ed5a228a-e3d0-4448-853d-1f760aa5e237 service nova] Releasing lock "refresh_cache-f7c83073-fadc-4e41-a4a9-df0bbe11aa28" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:25:46 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693092331.1801355, 7c124dd9-4dce-4c6f-925c-6eda8e187d84 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:25:46 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] VM Stopped (Lifecycle Event)
Aug 26 23:25:46 user nova-compute[73497]: DEBUG nova.compute.manager [None req-081f9664-5f4b-418d-939a-5edb42fe2a1f None None] [instance: 7c124dd9-4dce-4c6f-925c-6eda8e187d84] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:25:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:46 user nova-compute[73497]: DEBUG nova.compute.manager [req-3984f187-a156-4c77-8621-3b0b6dd4b434 req-1096a416-b4f6-4d40-ab0d-1a15dee72c5d service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Received event network-vif-plugged-74cddf0f-c302-4ae4-8142-cee5764c7c4f {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:25:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3984f187-a156-4c77-8621-3b0b6dd4b434 req-1096a416-b4f6-4d40-ab0d-1a15dee72c5d service nova] Acquiring lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3984f187-a156-4c77-8621-3b0b6dd4b434 req-1096a416-b4f6-4d40-ab0d-1a15dee72c5d service nova] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3984f187-a156-4c77-8621-3b0b6dd4b434 req-1096a416-b4f6-4d40-ab0d-1a15dee72c5d service nova] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:46 user nova-compute[73497]: DEBUG nova.compute.manager [req-3984f187-a156-4c77-8621-3b0b6dd4b434 req-1096a416-b4f6-4d40-ab0d-1a15dee72c5d service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] No waiting events found dispatching network-vif-plugged-74cddf0f-c302-4ae4-8142-cee5764c7c4f {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:25:46 user nova-compute[73497]: WARNING nova.compute.manager [req-3984f187-a156-4c77-8621-3b0b6dd4b434 req-1096a416-b4f6-4d40-ab0d-1a15dee72c5d service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Received unexpected event network-vif-plugged-74cddf0f-c302-4ae4-8142-cee5764c7c4f for instance with vm_state building and task_state spawning.
Aug 26 23:25:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:48 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092348.4002597, f7c83073-fadc-4e41-a4a9-df0bbe11aa28 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:25:48 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] VM Resumed (Lifecycle Event)
Aug 26 23:25:48 user nova-compute[73497]: DEBUG nova.compute.manager [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:25:48 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:25:48 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Instance spawned successfully.
Aug 26 23:25:48 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:25:48 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:25:48 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:25:48 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:25:48 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:25:48 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:25:48 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:25:48 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:25:48 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:25:48 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:25:48 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092348.4055815, f7c83073-fadc-4e41-a4a9-df0bbe11aa28 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:25:48 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] VM Started (Lifecycle Event)
Aug 26 23:25:48 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:25:48 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:25:48 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:25:48 user nova-compute[73497]: INFO nova.compute.manager [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Took 5.66 seconds to spawn the instance on the hypervisor.
Aug 26 23:25:48 user nova-compute[73497]: DEBUG nova.compute.manager [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:25:48 user nova-compute[73497]: DEBUG nova.compute.manager [req-a1e79c8e-4fed-4214-b68d-e21092d3a10f req-48fe0ba3-5d6d-4fbd-bef1-03e4c2d9b55a service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Received event network-vif-plugged-74cddf0f-c302-4ae4-8142-cee5764c7c4f {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:25:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a1e79c8e-4fed-4214-b68d-e21092d3a10f req-48fe0ba3-5d6d-4fbd-bef1-03e4c2d9b55a service nova] Acquiring lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a1e79c8e-4fed-4214-b68d-e21092d3a10f req-48fe0ba3-5d6d-4fbd-bef1-03e4c2d9b55a service nova] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a1e79c8e-4fed-4214-b68d-e21092d3a10f req-48fe0ba3-5d6d-4fbd-bef1-03e4c2d9b55a service nova] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:48 user nova-compute[73497]: DEBUG nova.compute.manager [req-a1e79c8e-4fed-4214-b68d-e21092d3a10f req-48fe0ba3-5d6d-4fbd-bef1-03e4c2d9b55a service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] No waiting events found dispatching network-vif-plugged-74cddf0f-c302-4ae4-8142-cee5764c7c4f {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:25:48 user nova-compute[73497]: WARNING nova.compute.manager [req-a1e79c8e-4fed-4214-b68d-e21092d3a10f req-48fe0ba3-5d6d-4fbd-bef1-03e4c2d9b55a service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Received unexpected event network-vif-plugged-74cddf0f-c302-4ae4-8142-cee5764c7c4f for instance with vm_state building and task_state spawning.
Aug 26 23:25:48 user nova-compute[73497]: INFO nova.compute.manager [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Took 6.53 seconds to build instance.
Aug 26 23:25:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2f2dbbc7-bbe4-4a85-a6f5-818da377f4d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.668s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:55 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:25:55 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:25:55 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:25:56 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693092341.4374948, 4c68f140-4235-4dcb-b99d-1347bc949d15 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:25:56 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] VM Stopped (Lifecycle Event)
Aug 26 23:25:56 user nova-compute[73497]: DEBUG nova.compute.manager [None req-afa305e0-488e-4109-b2df-797f6e77c994 None None] [instance: 4c68f140-4235-4dcb-b99d-1347bc949d15] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:25:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:25:57 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:25:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:25:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:25:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:25:57 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:25:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:59 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:25:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df9ebc6-0b6a-4cdc-811d-d43be88958f7/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df9ebc6-0b6a-4cdc-811d-d43be88958f7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df9ebc6-0b6a-4cdc-811d-d43be88958f7/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df9ebc6-0b6a-4cdc-811d-d43be88958f7/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f6eb6e-272f-4b1e-b1d5-40769bf07165/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f6eb6e-272f-4b1e-b1d5-40769bf07165/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:25:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f6eb6e-272f-4b1e-b1d5-40769bf07165/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:25:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f6eb6e-272f-4b1e-b1d5-40769bf07165/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:26:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a5de88-37f0-4953-92a2-6f8db0b2f02e/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a5de88-37f0-4953-92a2-6f8db0b2f02e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a5de88-37f0-4953-92a2-6f8db0b2f02e/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a5de88-37f0-4953-92a2-6f8db0b2f02e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:26:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:01 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:26:01 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:26:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=6984MB free_disk=25.131057739257812GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:26:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:26:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:26:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:02 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 994093f0-e6b2-4c96-b259-c559ef2b1fbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:26:02 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 171985a3-358d-4b26-a66c-372b9b99b386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:26:02 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance aebaeda6-23d1-43a1-afc8-bdc8992067e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:26:02 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 043294e5-0618-4a31-bb19-1227ef1f5d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:26:02 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance e9e5c83f-0678-48d4-a81f-1a3f959aabcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:26:02 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance c601f97e-9e52-40c6-9085-45f38e709721 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:26:02 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 6df9ebc6-0b6a-4cdc-811d-d43be88958f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:26:02 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:26:02 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance e9a5de88-37f0-4953-92a2-6f8db0b2f02e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:26:02 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 40afa348-8391-4643-977c-e67eab5c9476 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:26:02 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 93f6eb6e-272f-4b1e-b1d5-40769bf07165 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:26:02 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance f7c83073-fadc-4e41-a4a9-df0bbe11aa28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:26:02 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:26:02 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:26:02 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:26:02 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:26:02 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:26:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.552s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:26:03 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:26:03 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:26:03 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:26:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-043294e5-0618-4a31-bb19-1227ef1f5d39" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:26:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-043294e5-0618-4a31-bb19-1227ef1f5d39" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:26:03 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:26:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:04 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Updating instance_info_cache with network_info: [{"id": "de273950-9851-448e-8ca2-ac699c12994e", "address": "fa:16:3e:fe:2b:69", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde273950-98", "ovs_interfaceid": "de273950-9851-448e-8ca2-ac699c12994e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:26:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-043294e5-0618-4a31-bb19-1227ef1f5d39" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:26:04 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:26:04 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:26:04 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:26:04 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:26:04 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:26:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:21 user nova-compute[73497]: INFO nova.compute.manager [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Rescuing
Aug 26 23:26:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "refresh_cache-c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:26:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquired lock "refresh_cache-c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:26:21 user nova-compute[73497]: DEBUG nova.network.neutron [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:26:22 user nova-compute[73497]: DEBUG nova.network.neutron [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Updating instance_info_cache with network_info: [{"id": "a45f0c9b-48cc-4434-90c9-875c52f402d0", "address": "fa:16:3e:87:b8:93", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa45f0c9b-48", "ovs_interfaceid": "a45f0c9b-48cc-4434-90c9-875c52f402d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:26:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Releasing lock "refresh_cache-c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:26:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:22 user nova-compute[73497]: DEBUG nova.compute.manager [req-157c338b-a2e1-4320-aa2a-926f2c9a6f61 req-225be841-2a14-4c30-91e3-a6521f805916 service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Received event network-vif-unplugged-a45f0c9b-48cc-4434-90c9-875c52f402d0 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:26:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-157c338b-a2e1-4320-aa2a-926f2c9a6f61 req-225be841-2a14-4c30-91e3-a6521f805916 service nova] Acquiring lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:26:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-157c338b-a2e1-4320-aa2a-926f2c9a6f61 req-225be841-2a14-4c30-91e3-a6521f805916 service nova] Lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:26:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-157c338b-a2e1-4320-aa2a-926f2c9a6f61 req-225be841-2a14-4c30-91e3-a6521f805916 service nova] Lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:26:22 user nova-compute[73497]: DEBUG nova.compute.manager [req-157c338b-a2e1-4320-aa2a-926f2c9a6f61 req-225be841-2a14-4c30-91e3-a6521f805916 service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] No waiting events found dispatching network-vif-unplugged-a45f0c9b-48cc-4434-90c9-875c52f402d0 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:26:22 user nova-compute[73497]: WARNING nova.compute.manager [req-157c338b-a2e1-4320-aa2a-926f2c9a6f61 req-225be841-2a14-4c30-91e3-a6521f805916 service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Received unexpected event network-vif-unplugged-a45f0c9b-48cc-4434-90c9-875c52f402d0 for instance with vm_state active and task_state rescuing.
Aug 26 23:26:22 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Instance destroyed successfully.
Aug 26 23:26:22 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Attempting a stable device rescue
Aug 26 23:26:22 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73497) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 23:26:22 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Instance directory exists: not creating {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 23:26:22 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Creating image(s)
Aug 26 23:26:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "/opt/stack/data/nova/instances/c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:26:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "/opt/stack/data/nova/instances/c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:26:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "/opt/stack/data/nova/instances/c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:26:22 user nova-compute[73497]: DEBUG nova.objects.instance [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lazy-loading 'trusted_certs' on Instance uuid c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:26:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "f949bc567bec28223247d57b206a7b129fed282e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:26:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "f949bc567bec28223247d57b206a7b129fed282e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:26:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f949bc567bec28223247d57b206a7b129fed282e.part --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f949bc567bec28223247d57b206a7b129fed282e.part --force-share --output=json" returned: 0 in 0.184s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:24 user nova-compute[73497]: DEBUG nova.virt.images [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] bcfe163b-4906-4cba-a4a5-9d05338ec4c2 was qcow2, converting to raw {{(pid=73497) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 23:26:24 user nova-compute[73497]: DEBUG nova.privsep.utils [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73497) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 23:26:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f949bc567bec28223247d57b206a7b129fed282e.part /opt/stack/data/nova/instances/_base/f949bc567bec28223247d57b206a7b129fed282e.converted {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f949bc567bec28223247d57b206a7b129fed282e.part /opt/stack/data/nova/instances/_base/f949bc567bec28223247d57b206a7b129fed282e.converted" returned: 0 in 0.362s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f949bc567bec28223247d57b206a7b129fed282e.converted --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:24 user nova-compute[73497]: DEBUG nova.compute.manager [req-3afa478b-8fba-4aee-b08b-7caca698bd09 req-0d17cb82-30f6-491a-8561-2e8035dad7a6 service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Received event network-vif-plugged-a45f0c9b-48cc-4434-90c9-875c52f402d0 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:26:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3afa478b-8fba-4aee-b08b-7caca698bd09 req-0d17cb82-30f6-491a-8561-2e8035dad7a6 service nova] Acquiring lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:26:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3afa478b-8fba-4aee-b08b-7caca698bd09 req-0d17cb82-30f6-491a-8561-2e8035dad7a6 service nova] Lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:26:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3afa478b-8fba-4aee-b08b-7caca698bd09 req-0d17cb82-30f6-491a-8561-2e8035dad7a6 service nova] Lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:26:24 user nova-compute[73497]: DEBUG nova.compute.manager [req-3afa478b-8fba-4aee-b08b-7caca698bd09 req-0d17cb82-30f6-491a-8561-2e8035dad7a6 service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] No waiting events found dispatching network-vif-plugged-a45f0c9b-48cc-4434-90c9-875c52f402d0 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:26:24 user nova-compute[73497]: WARNING nova.compute.manager [req-3afa478b-8fba-4aee-b08b-7caca698bd09 req-0d17cb82-30f6-491a-8561-2e8035dad7a6 service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Received unexpected event network-vif-plugged-a45f0c9b-48cc-4434-90c9-875c52f402d0 for instance with vm_state active and task_state rescuing.
Aug 26 23:26:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f949bc567bec28223247d57b206a7b129fed282e.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "f949bc567bec28223247d57b206a7b129fed282e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.733s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:26:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "f949bc567bec28223247d57b206a7b129fed282e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:26:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "f949bc567bec28223247d57b206a7b129fed282e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:26:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f949bc567bec28223247d57b206a7b129fed282e --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f949bc567bec28223247d57b206a7b129fed282e --force-share --output=json" returned: 0 in 0.183s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f949bc567bec28223247d57b206a7b129fed282e,backing_fmt=raw /opt/stack/data/nova/instances/c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c/disk.rescue {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f949bc567bec28223247d57b206a7b129fed282e,backing_fmt=raw /opt/stack/data/nova/instances/c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c/disk.rescue" returned: 0 in 0.054s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "f949bc567bec28223247d57b206a7b129fed282e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:26:24 user nova-compute[73497]: DEBUG nova.objects.instance [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lazy-loading 'migration_context' on Instance uuid c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:26:24 user nova-compute[73497]: DEBUG nova.objects.base [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Object Instance<c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:26:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Start _get_guest_xml network_info=[{"id": "a45f0c9b-48cc-4434-90c9-875c52f402d0", "address": "fa:16:3e:87:b8:93", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "vif_mac": "fa:16:3e:87:b8:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa45f0c9b-48", "ovs_interfaceid": "a45f0c9b-48cc-4434-90c9-875c52f402d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bcfe163b-4906-4cba-a4a5-9d05338ec4c2', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '637b6680-de38-49fb-8e19-b102aea8b24b', 'guest_format': None, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LNBxIeFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c', 'attached_at': '', 'detached_at': '', 'volume_id': 'e051d168-f209-4421-b5b7-a94f198803e3', 'serial': 'e051d168-f209-4421-b5b7-a94f198803e3'}, 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG nova.objects.instance [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lazy-loading 'resources' on Instance uuid c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG nova.objects.base [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Object Instance<c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG nova.objects.instance [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lazy-loading 'numa_topology' on Instance uuid c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG nova.objects.base [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Object Instance<c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:26:25 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:26:25 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:26:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG nova.objects.instance [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lazy-loading 'vcpu_model' on Instance uuid c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG nova.objects.base [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Object Instance<c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LNBxIeFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:26:25 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:26:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:26:25 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:26:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:26:25 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:26:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[66eb328d-e0b0-4662-87a7-b777da892d6e]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = LNBxIeFo\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 26 23:26:25 user nova-compute[73497]: node.name = iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3
Aug 26 23:26:25 user nova-compute[73497]: node.tpgt = -1
Aug 26 23:26:25 user nova-compute[73497]: node.startup = automatic
Aug 26 23:26:25 user nova-compute[73497]: node.leading_login = No
Aug 26 23:26:25 user nova-compute[73497]: iface.iscsi_ifacename = default
Aug 26 23:26:25 user nova-compute[73497]: iface.net_ifacename = <empty>
Aug 26 23:26:25 user nova-compute[73497]: iface.ipaddress = <empty>
Aug 26 23:26:25 user nova-compute[73497]: iface.prefix_len = 0
Aug 26 23:26:25 user nova-compute[73497]: iface.hwaddress = <empty>
Aug 26 23:26:25 user nova-compute[73497]: iface.transport_name = tcp
Aug 26 23:26:25 user nova-compute[73497]: iface.initiatorname = <empty>
Aug 26 23:26:25 user nova-compute[73497]: iface.state = <empty>
Aug 26 23:26:25 user nova-compute[73497]: iface.vlan_id = 0
Aug 26 23:26:25 user nova-compute[73497]: iface.vlan_priority = 0
Aug 26 23:26:25 user nova-compute[73497]: iface.vlan_state = <empty>
Aug 26 23:26:25 user nova-compute[73497]: iface.iface_num = 0
Aug 26 23:26:25 user nova-compute[73497]: iface.mtu = 0
Aug 26 23:26:25 user nova-compute[73497]: iface.port = 0
Aug 26 23:26:25 user nova-compute[73497]: iface.bootproto = <empty>
Aug 26 23:26:25 user nova-compute[73497]: iface.subnet_mask = <empty>
Aug 26 23:26:25 user nova-compute[73497]: iface.gateway = <empty>
Aug 26 23:26:25 user nova-compute[73497]: iface.dhcp_alt_client_id_state = <empty>
Aug 26 23:26:25 user nova-compute[73497]: iface.dhcp_alt_client_id = <empty>
Aug 26 23:26:25 user nova-compute[73497]: iface.dhcp_dns = <empty>
Aug 26 23:26:25 user nova-compute[73497]: iface.dhcp_learn_iqn = <empty>
Aug 26 23:26:25 user nova-compute[73497]: iface.dhcp_req_vendor_id_state = <empty>
Aug 26 23:26:25 user nova-compute[73497]: iface.dhcp_vendor_id_state = <empty>
Aug 26 23:26:25 user nova-compute[73497]: iface.dhcp_vendor_id = <empty>
Aug 26 23:26:25 user nova-compute[73497]: iface.dhcp_slp_da = <empty>
Aug 26 23:26:25 user nova-compute[73497]: iface.fragmentation = <empty>
Aug 26 23:26:25 user nova-compute[73497]: iface.gratuitous_arp = <empty>
Aug 26 23:26:25 user nova-compute[73497]: iface.incoming_forwarding = <empty>
Aug 26 23:26:25 user nova-compute[73497]: iface.tos_state = <empty>
Aug 26 23:26:25 user nova-compute[73497]: iface.tos = 0
Aug 26 23:26:25 user nova-compute[73497]: iface.ttl = 0
Aug 26 23:26:25 user nova-compute[73497]: iface.delayed_ack = <empty>
Aug 26 23:26:25 user nova-compute[73497]: iface.tcp_nagle = <empty>
Aug 26 23:26:25 user nova-compute[73497]: iface.tcp_wsf_state = <empty>
Aug 26 23:26:25 user nova-compute[73497]: iface.tcp_wsf = 0
Aug 26 23:26:25 user nova-compute[73497]: iface.tcp_timer_scale = 0
Aug 26 23:26:25 user nova-compute[73497]: iface.tcp_timestamp = <empty>
Aug 26 23:26:25 user nova-compute[73497]: iface.redirect = <empty>
Aug 26 23:26:25 user nova-compute[73497]: iface.def_task_mgmt_timeout = 0
Aug 26 23:26:25 user nova-compute[73497]: iface.header_digest = <empty>
Aug 26 23:26:25 user nova-compute[73497]: iface.data_digest = <empty>
Aug 26 23:26:25 user nova-compute[73497]: iface.immediate_data = <empty>
Aug 26 23:26:25 user nova-compute[73497]: iface.initial_r2t = <empty>
Aug 26 23:26:25 user nova-compute[73497]: iface.data_seq_inorder = <empty>
Aug 26 23:26:25 user nova-compute[73497]: iface.data_pdu_inorder = <empty>
Aug 26 23:26:25 user nova-compute[73497]: iface.erl = 0
Aug 26 23:26:25 user nova-compute[73497]: iface.max_receive_data_len = 0
Aug 26 23:26:25 user nova-compute[73497]: iface.first_burst_len = 0
Aug 26 23:26:25 user nova-compute[73497]: iface.max_outstanding_r2t = 0
Aug 26 23:26:25 user nova-compute[73497]: iface.max_burst_len = 0
Aug 26 23:26:25 user nova-compute[73497]: iface.chap_auth = <empty>
Aug 26 23:26:25 user nova-compute[73497]: iface.bidi_chap = <empty>
Aug 26 23:26:25 user nova-compute[73497]: iface.strict_login_compliance = <empty>
Aug 26 23:26:25 user nova-compute[73497]: iface.discovery_auth = <empty>
Aug 26 23:26:25 user nova-compute[73497]: iface.discovery_logout = <empty>
Aug 26 23:26:25 user nova-compute[73497]: node.discovery_address = <empty>
Aug 26 23:26:25 user nova-compute[73497]: node.discovery_port = 0
Aug 26 23:26:25 user nova-compute[73497]: node.discovery_type = static
Aug 26 23:26:25 user nova-compute[73497]: node.session.initial_cmdsn = 0
Aug 26 23:26:25 user nova-compute[73497]: node.session.initial_login_retry_max = 8
Aug 26 23:26:25 user nova-compute[73497]: node.session.xmit_thread_priority = -20
Aug 26 23:26:25 user nova-compute[73497]: node.session.cmds_max = 128
Aug 26 23:26:25 user nova-compute[73497]: node.session.queue_depth = 32
Aug 26 23:26:25 user nova-compute[73497]: node.session.nr_sessions = 1
Aug 26 23:26:25 user nova-compute[73497]: node.session.auth.authmethod = CHAP
Aug 26 23:26:25 user nova-compute[73497]: node.session.auth.username = LNBxIeFo
Aug 26 23:26:25 user nova-compute[73497]: node.session.auth.password = ***
Aug 26 23:26:25 user nova-compute[73497]: node.session.auth.username_in = <empty>
Aug 26 23:26:25 user nova-compute[73497]: node.session.auth.password_in = <empty>
Aug 26 23:26:25 user nova-compute[73497]: node.session.auth.chap_algs = MD5
Aug 26 23:26:25 user nova-compute[73497]: node.session.timeo.replacement_timeout = 120
Aug 26 23:26:25 user nova-compute[73497]: node.session.err_timeo.abort_timeout = 15
Aug 26 23:26:25 user nova-compute[73497]: node.session.err_timeo.lu_reset_timeout = 30
Aug 26 23:26:25 user nova-compute[73497]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 26 23:26:25 user nova-compute[73497]: node.session.err_timeo.host_reset_timeout = 60
Aug 26 23:26:25 user nova-compute[73497]: node.session.iscsi.FastAbort = Yes
Aug 26 23:26:25 user nova-compute[73497]: node.session.iscsi.InitialR2T = No
Aug 26 23:26:25 user nova-compute[73497]: node.session.iscsi.ImmediateData = Yes
Aug 26 23:26:25 user nova-compute[73497]: node.session.iscsi.FirstBurstLength = 262144
Aug 26 23:26:25 user nova-compute[73497]: node.session.iscsi.MaxBurstLength = 16776192
Aug 26 23:26:25 user nova-compute[73497]: node.session.iscsi.DefaultTime2Retain = 0
Aug 26 23:26:25 user nova-compute[73497]: node.session.iscsi.DefaultTime2Wait = 2
Aug 26 23:26:25 user nova-compute[73497]: node.session.iscsi.MaxConnections = 1
Aug 26 23:26:25 user nova-compute[73497]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 26 23:26:25 user nova-compute[73497]: node.session.iscsi.ERL = 0
Aug 26 23:26:25 user nova-compute[73497]: node.session.scan = manual
Aug 26 23:26:25 user nova-compute[73497]: node.session.reopen_max = 0
Aug 26 23:26:25 user nova-compute[73497]: node.conn[0].address = 172.16.0.220
Aug 26 23:26:25 user nova-compute[73497]: node.conn[0].port = 3260
Aug 26 23:26:25 user nova-compute[73497]: node.conn[0].startup = manual
Aug 26 23:26:25 user nova-compute[73497]: node.conn[0].tcp.window_size = 524288
Aug 26 23:26:25 user nova-compute[73497]: node.conn[0].tcp.type_of_service = 0
Aug 26 23:26:25 user nova-compute[73497]: node.conn[0].timeo.logout_timeout = 15
Aug 26 23:26:25 user nova-compute[73497]: node.conn[0].timeo.login_timeout = 15
Aug 26 23:26:25 user nova-compute[73497]: node.conn[0].timeo.auth_timeout = 45
Aug 26 23:26:25 user nova-compute[73497]: node.conn[0].timeo.noop_out_interval = 5
Aug 26 23:26:25 user nova-compute[73497]: node.conn[0].timeo.noop_out_timeout = 5
Aug 26 23:26:25 user nova-compute[73497]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 26 23:26:25 user nova-compute[73497]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 26 23:26:25 user nova-compute[73497]: node.conn[0].iscsi.HeaderDigest = None
Aug 26 23:26:25 user nova-compute[73497]: node.conn[0].iscsi.DataDigest = None
Aug 26 23:26:25 user nova-compute[73497]: node.conn[0].iscsi.IFMarker = No
Aug 26 23:26:25 user nova-compute[73497]: node.conn[0].iscsi.OFMarker = No
Aug 26 23:26:25 user nova-compute[73497]: # END RECORD
Aug 26 23:26:25 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7490d343-f053-4b3d-8052-e75e25a01f12]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7195be54-fea4-4f15-8615-5eda8b753f08]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LNBxIeFo {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LNBxIeFo" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cc1716-51bc-4bc0-a2dd-e074a0ae8618]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LNBxIeFo'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac5e10a-ee8f-4291-92b2-92657cd5fe75]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[78206660-d44e-43ca-af1f-96b241761e9e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:26:25 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:26:25 user nova-compute[73497]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:26:25 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:26:25 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:26:25 user nova-compute[73497]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:26:25 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.140s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] HCTL ('33', '0', '0', 0) found on session 29 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f909ac1-f5e3-4a03-8557-be3fbd6937ba]: (4, ('0 0 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Searching for a device in session 29 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LNBxIeFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.166s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] <== connect_volume: return (168ms) {'type': 'block', 'scsi_wwn': '26639313662326666', 'path': '/dev/sdb'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639313662326666', 'path': '/dev/sdb'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:24:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1461613885',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1461613885',id=27,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:24:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ee8ef1c899342b38a624c1c28309d41',ramdisk_id='',reservation_id='r-2h2ics8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1276656289',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:25:00Z,user_data=None,user_id='83005131fdc2411abe7a198157910743',uuid=c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a45f0c9b-48cc-4434-90c9-875c52f402d0", "address": "fa:16:3e:87:b8:93", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "vif_mac": "fa:16:3e:87:b8:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa45f0c9b-48", "ovs_interfaceid": "a45f0c9b-48cc-4434-90c9-875c52f402d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Converting VIF {"id": "a45f0c9b-48cc-4434-90c9-875c52f402d0", "address": "fa:16:3e:87:b8:93", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "vif_mac": "fa:16:3e:87:b8:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa45f0c9b-48", "ovs_interfaceid": "a45f0c9b-48cc-4434-90c9-875c52f402d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:b8:93,bridge_name='br-int',has_traffic_filtering=True,id=a45f0c9b-48cc-4434-90c9-875c52f402d0,network=Network(f8ba0a6b-e4fc-4236-9df3-90ffab8824fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa45f0c9b-48') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG nova.objects.instance [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lazy-loading 'pci_devices' on Instance uuid c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG nova.objects.base [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Object Instance<c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:26:25 user nova-compute[73497]:   <uuid>c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c</uuid>
Aug 26 23:26:25 user nova-compute[73497]:   <name>instance-0000001b</name>
Aug 26 23:26:25 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:26:25 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:26:25 user nova-compute[73497]:   <metadata>
Aug 26 23:26:25 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:26:25 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:26:25 user nova-compute[73497]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1461613885</nova:name>
Aug 26 23:26:25 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:26:25</nova:creationTime>
Aug 26 23:26:25 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:26:25 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:26:25 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:26:25 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:26:25 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:26:25 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:26:25 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:26:25 user nova-compute[73497]:       <nova:owner>
Aug 26 23:26:25 user nova-compute[73497]:         <nova:user uuid="83005131fdc2411abe7a198157910743">tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member</nova:user>
Aug 26 23:26:25 user nova-compute[73497]:         <nova:project uuid="3ee8ef1c899342b38a624c1c28309d41">tempest-ServerBootFromVolumeStableRescueTest-1276656289</nova:project>
Aug 26 23:26:25 user nova-compute[73497]:       </nova:owner>
Aug 26 23:26:25 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:26:25 user nova-compute[73497]:       <nova:ports>
Aug 26 23:26:25 user nova-compute[73497]:         <nova:port uuid="a45f0c9b-48cc-4434-90c9-875c52f402d0">
Aug 26 23:26:25 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 23:26:25 user nova-compute[73497]:         </nova:port>
Aug 26 23:26:25 user nova-compute[73497]:       </nova:ports>
Aug 26 23:26:25 user nova-compute[73497]:     </nova:instance>
Aug 26 23:26:25 user nova-compute[73497]:   </metadata>
Aug 26 23:26:25 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:26:25 user nova-compute[73497]:     <system>
Aug 26 23:26:25 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:26:25 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:26:25 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:26:25 user nova-compute[73497]:       <entry name="serial">c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c</entry>
Aug 26 23:26:25 user nova-compute[73497]:       <entry name="uuid">c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c</entry>
Aug 26 23:26:25 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:26:25 user nova-compute[73497]:     </system>
Aug 26 23:26:25 user nova-compute[73497]:   </sysinfo>
Aug 26 23:26:25 user nova-compute[73497]:   <os>
Aug 26 23:26:25 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:26:25 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:26:25 user nova-compute[73497]:   </os>
Aug 26 23:26:25 user nova-compute[73497]:   <features>
Aug 26 23:26:25 user nova-compute[73497]:     <acpi/>
Aug 26 23:26:25 user nova-compute[73497]:     <apic/>
Aug 26 23:26:25 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:26:25 user nova-compute[73497]:   </features>
Aug 26 23:26:25 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:26:25 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:26:25 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:26:25 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:26:25 user nova-compute[73497]:   </clock>
Aug 26 23:26:25 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:26:25 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:26:25 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:26:25 user nova-compute[73497]:   </cpu>
Aug 26 23:26:25 user nova-compute[73497]:   <devices>
Aug 26 23:26:25 user nova-compute[73497]:     <disk type="block" device="disk">
Aug 26 23:26:25 user nova-compute[73497]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:26:25 user nova-compute[73497]:       <source dev="/dev/sdb"/>
Aug 26 23:26:25 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:26:25 user nova-compute[73497]:       <serial>e051d168-f209-4421-b5b7-a94f198803e3</serial>
Aug 26 23:26:25 user nova-compute[73497]:     </disk>
Aug 26 23:26:25 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:26:25 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:26:25 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c/disk.rescue"/>
Aug 26 23:26:25 user nova-compute[73497]:       <target dev="vdb" bus="virtio"/>
Aug 26 23:26:25 user nova-compute[73497]:       <boot order="1"/>
Aug 26 23:26:25 user nova-compute[73497]:     </disk>
Aug 26 23:26:25 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:26:25 user nova-compute[73497]:       <mac address="fa:16:3e:87:b8:93"/>
Aug 26 23:26:25 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:26:25 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:26:25 user nova-compute[73497]:       <target dev="tapa45f0c9b-48"/>
Aug 26 23:26:25 user nova-compute[73497]:     </interface>
Aug 26 23:26:25 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:26:25 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c/console.log" append="off"/>
Aug 26 23:26:25 user nova-compute[73497]:     </serial>
Aug 26 23:26:25 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:26:25 user nova-compute[73497]:     <video>
Aug 26 23:26:25 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:26:25 user nova-compute[73497]:     </video>
Aug 26 23:26:25 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:26:25 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:26:25 user nova-compute[73497]:     </rng>
Aug 26 23:26:25 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:26:25 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:26:25 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:26:25 user nova-compute[73497]:     </memballoon>
Aug 26 23:26:25 user nova-compute[73497]:   </devices>
Aug 26 23:26:25 user nova-compute[73497]: </domain>
Aug 26 23:26:25 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:26:25 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Instance destroyed successfully.
Aug 26 23:26:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:26:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] No VIF found with MAC fa:16:3e:87:b8:93, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:26:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1f0c4810-d9dd-4d40-910b-951569559ff7 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Acquiring lock "e9a5de88-37f0-4953-92a2-6f8db0b2f02e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:26:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1f0c4810-d9dd-4d40-910b-951569559ff7 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Lock "e9a5de88-37f0-4953-92a2-6f8db0b2f02e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:26:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1f0c4810-d9dd-4d40-910b-951569559ff7 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Acquiring lock "e9a5de88-37f0-4953-92a2-6f8db0b2f02e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:26:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1f0c4810-d9dd-4d40-910b-951569559ff7 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Lock "e9a5de88-37f0-4953-92a2-6f8db0b2f02e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:26:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1f0c4810-d9dd-4d40-910b-951569559ff7 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Lock "e9a5de88-37f0-4953-92a2-6f8db0b2f02e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:26:26 user nova-compute[73497]: INFO nova.compute.manager [None req-1f0c4810-d9dd-4d40-910b-951569559ff7 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Terminating instance
Aug 26 23:26:26 user nova-compute[73497]: DEBUG nova.compute.manager [None req-1f0c4810-d9dd-4d40-910b-951569559ff7 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:26:26 user nova-compute[73497]: DEBUG nova.compute.manager [req-da49c084-9561-4171-9c2b-0c5621d2879a req-ee26ad45-db0b-402b-a28e-c15e2f8ea7b2 service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Received event network-vif-plugged-a45f0c9b-48cc-4434-90c9-875c52f402d0 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:26:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-da49c084-9561-4171-9c2b-0c5621d2879a req-ee26ad45-db0b-402b-a28e-c15e2f8ea7b2 service nova] Acquiring lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:26:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-da49c084-9561-4171-9c2b-0c5621d2879a req-ee26ad45-db0b-402b-a28e-c15e2f8ea7b2 service nova] Lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:26:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-da49c084-9561-4171-9c2b-0c5621d2879a req-ee26ad45-db0b-402b-a28e-c15e2f8ea7b2 service nova] Lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:26:26 user nova-compute[73497]: DEBUG nova.compute.manager [req-da49c084-9561-4171-9c2b-0c5621d2879a req-ee26ad45-db0b-402b-a28e-c15e2f8ea7b2 service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] No waiting events found dispatching network-vif-plugged-a45f0c9b-48cc-4434-90c9-875c52f402d0 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:26:26 user nova-compute[73497]: WARNING nova.compute.manager [req-da49c084-9561-4171-9c2b-0c5621d2879a req-ee26ad45-db0b-402b-a28e-c15e2f8ea7b2 service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Received unexpected event network-vif-plugged-a45f0c9b-48cc-4434-90c9-875c52f402d0 for instance with vm_state active and task_state rescuing.
Aug 26 23:26:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:27 user nova-compute[73497]: DEBUG nova.compute.manager [req-e7a56998-3c79-4f5d-a9ca-e65a166967de req-e2000aae-f462-451f-ad43-9d532a3876fb service nova] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Received event network-vif-unplugged-79673cd5-e4d0-44ac-b415-92e80db4d291 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:26:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-e7a56998-3c79-4f5d-a9ca-e65a166967de req-e2000aae-f462-451f-ad43-9d532a3876fb service nova] Acquiring lock "e9a5de88-37f0-4953-92a2-6f8db0b2f02e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:26:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-e7a56998-3c79-4f5d-a9ca-e65a166967de req-e2000aae-f462-451f-ad43-9d532a3876fb service nova] Lock "e9a5de88-37f0-4953-92a2-6f8db0b2f02e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:26:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-e7a56998-3c79-4f5d-a9ca-e65a166967de req-e2000aae-f462-451f-ad43-9d532a3876fb service nova] Lock "e9a5de88-37f0-4953-92a2-6f8db0b2f02e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:26:27 user nova-compute[73497]: DEBUG nova.compute.manager [req-e7a56998-3c79-4f5d-a9ca-e65a166967de req-e2000aae-f462-451f-ad43-9d532a3876fb service nova] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] No waiting events found dispatching network-vif-unplugged-79673cd5-e4d0-44ac-b415-92e80db4d291 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:26:27 user nova-compute[73497]: DEBUG nova.compute.manager [req-e7a56998-3c79-4f5d-a9ca-e65a166967de req-e2000aae-f462-451f-ad43-9d532a3876fb service nova] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Received event network-vif-unplugged-79673cd5-e4d0-44ac-b415-92e80db4d291 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:26:27 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Instance destroyed successfully.
Aug 26 23:26:27 user nova-compute[73497]: DEBUG nova.objects.instance [None req-1f0c4810-d9dd-4d40-910b-951569559ff7 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Lazy-loading 'resources' on Instance uuid e9a5de88-37f0-4953-92a2-6f8db0b2f02e {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:26:27 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-1f0c4810-d9dd-4d40-910b-951569559ff7 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:24:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1218607007',display_name='tempest-VolumesActionsTest-instance-1218607007',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1218607007',id=28,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:24:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='951ffc97c25a4d7b90efa5bb5cfd269c',ramdisk_id='',reservation_id='r-bopomv0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1831950157',owner_user_name='tempest-VolumesActionsTest-1831950157-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:24:44Z,user_data=None,user_id='39d36154f45848ecae45e455b5b150cd',uuid=e9a5de88-37f0-4953-92a2-6f8db0b2f02e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79673cd5-e4d0-44ac-b415-92e80db4d291", "address": "fa:16:3e:28:8d:81", "network": {"id": "35aa126f-8000-48cf-86c1-d57dbbb8c4d2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1248937097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "951ffc97c25a4d7b90efa5bb5cfd269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79673cd5-e4", "ovs_interfaceid": "79673cd5-e4d0-44ac-b415-92e80db4d291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:26:27 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-1f0c4810-d9dd-4d40-910b-951569559ff7 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Converting VIF {"id": "79673cd5-e4d0-44ac-b415-92e80db4d291", "address": "fa:16:3e:28:8d:81", "network": {"id": "35aa126f-8000-48cf-86c1-d57dbbb8c4d2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1248937097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "951ffc97c25a4d7b90efa5bb5cfd269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79673cd5-e4", "ovs_interfaceid": "79673cd5-e4d0-44ac-b415-92e80db4d291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:26:27 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-1f0c4810-d9dd-4d40-910b-951569559ff7 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:8d:81,bridge_name='br-int',has_traffic_filtering=True,id=79673cd5-e4d0-44ac-b415-92e80db4d291,network=Network(35aa126f-8000-48cf-86c1-d57dbbb8c4d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79673cd5-e4') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:26:27 user nova-compute[73497]: DEBUG os_vif [None req-1f0c4810-d9dd-4d40-910b-951569559ff7 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:8d:81,bridge_name='br-int',has_traffic_filtering=True,id=79673cd5-e4d0-44ac-b415-92e80db4d291,network=Network(35aa126f-8000-48cf-86c1-d57dbbb8c4d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79673cd5-e4') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:26:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79673cd5-e4, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:26:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:27 user nova-compute[73497]: INFO os_vif [None req-1f0c4810-d9dd-4d40-910b-951569559ff7 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:8d:81,bridge_name='br-int',has_traffic_filtering=True,id=79673cd5-e4d0-44ac-b415-92e80db4d291,network=Network(35aa126f-8000-48cf-86c1-d57dbbb8c4d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79673cd5-e4')
Aug 26 23:26:27 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-1f0c4810-d9dd-4d40-910b-951569559ff7 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Deleting instance files /opt/stack/data/nova/instances/e9a5de88-37f0-4953-92a2-6f8db0b2f02e_del
Aug 26 23:26:27 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-1f0c4810-d9dd-4d40-910b-951569559ff7 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Deletion of /opt/stack/data/nova/instances/e9a5de88-37f0-4953-92a2-6f8db0b2f02e_del complete
Aug 26 23:26:27 user nova-compute[73497]: INFO nova.compute.manager [None req-1f0c4810-d9dd-4d40-910b-951569559ff7 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 26 23:26:27 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-1f0c4810-d9dd-4d40-910b-951569559ff7 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:26:27 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:26:27 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:26:28 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:26:28 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Took 0.97 seconds to deallocate network for instance.
Aug 26 23:26:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1f0c4810-d9dd-4d40-910b-951569559ff7 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:26:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1f0c4810-d9dd-4d40-910b-951569559ff7 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:26:29 user nova-compute[73497]: DEBUG nova.compute.manager [req-2c8294a8-de3f-4d81-bc1b-10fd09b97f40 req-51730da5-5909-4b7e-ab56-ab7eb6903342 service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Received event network-vif-plugged-a45f0c9b-48cc-4434-90c9-875c52f402d0 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:26:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2c8294a8-de3f-4d81-bc1b-10fd09b97f40 req-51730da5-5909-4b7e-ab56-ab7eb6903342 service nova] Acquiring lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:26:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2c8294a8-de3f-4d81-bc1b-10fd09b97f40 req-51730da5-5909-4b7e-ab56-ab7eb6903342 service nova] Lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:26:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2c8294a8-de3f-4d81-bc1b-10fd09b97f40 req-51730da5-5909-4b7e-ab56-ab7eb6903342 service nova] Lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:26:29 user nova-compute[73497]: DEBUG nova.compute.manager [req-2c8294a8-de3f-4d81-bc1b-10fd09b97f40 req-51730da5-5909-4b7e-ab56-ab7eb6903342 service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] No waiting events found dispatching network-vif-plugged-a45f0c9b-48cc-4434-90c9-875c52f402d0 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:26:29 user nova-compute[73497]: WARNING nova.compute.manager [req-2c8294a8-de3f-4d81-bc1b-10fd09b97f40 req-51730da5-5909-4b7e-ab56-ab7eb6903342 service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Received unexpected event network-vif-plugged-a45f0c9b-48cc-4434-90c9-875c52f402d0 for instance with vm_state active and task_state rescuing.
Aug 26 23:26:29 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Removed pending event for c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c due to event {{(pid=73497) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 23:26:29 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092389.1818497, c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:26:29 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] VM Resumed (Lifecycle Event)
Aug 26 23:26:29 user nova-compute[73497]: DEBUG nova.compute.manager [None req-27c6d278-d307-4ba4-b7f3-53cd0e46cc95 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:26:29 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:26:29 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:26:29 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 23:26:29 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092389.1831324, c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:26:29 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] VM Started (Lifecycle Event)
Aug 26 23:26:29 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-1f0c4810-d9dd-4d40-910b-951569559ff7 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:26:29 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:26:29 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-1f0c4810-d9dd-4d40-910b-951569559ff7 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:26:29 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:26:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1f0c4810-d9dd-4d40-910b-951569559ff7 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.443s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:26:29 user nova-compute[73497]: DEBUG nova.compute.manager [req-51a98ad5-c804-4395-8ca7-1e8e586fd0f2 req-1170cb90-cb3c-46b3-a11e-af924ad6149c service nova] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Received event network-vif-plugged-79673cd5-e4d0-44ac-b415-92e80db4d291 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:26:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-51a98ad5-c804-4395-8ca7-1e8e586fd0f2 req-1170cb90-cb3c-46b3-a11e-af924ad6149c service nova] Acquiring lock "e9a5de88-37f0-4953-92a2-6f8db0b2f02e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:26:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-51a98ad5-c804-4395-8ca7-1e8e586fd0f2 req-1170cb90-cb3c-46b3-a11e-af924ad6149c service nova] Lock "e9a5de88-37f0-4953-92a2-6f8db0b2f02e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:26:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-51a98ad5-c804-4395-8ca7-1e8e586fd0f2 req-1170cb90-cb3c-46b3-a11e-af924ad6149c service nova] Lock "e9a5de88-37f0-4953-92a2-6f8db0b2f02e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:26:29 user nova-compute[73497]: DEBUG nova.compute.manager [req-51a98ad5-c804-4395-8ca7-1e8e586fd0f2 req-1170cb90-cb3c-46b3-a11e-af924ad6149c service nova] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] No waiting events found dispatching network-vif-plugged-79673cd5-e4d0-44ac-b415-92e80db4d291 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:26:29 user nova-compute[73497]: WARNING nova.compute.manager [req-51a98ad5-c804-4395-8ca7-1e8e586fd0f2 req-1170cb90-cb3c-46b3-a11e-af924ad6149c service nova] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Received unexpected event network-vif-plugged-79673cd5-e4d0-44ac-b415-92e80db4d291 for instance with vm_state deleted and task_state None.
Aug 26 23:26:29 user nova-compute[73497]: DEBUG nova.compute.manager [req-51a98ad5-c804-4395-8ca7-1e8e586fd0f2 req-1170cb90-cb3c-46b3-a11e-af924ad6149c service nova] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Received event network-vif-deleted-79673cd5-e4d0-44ac-b415-92e80db4d291 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:26:29 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-1f0c4810-d9dd-4d40-910b-951569559ff7 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Deleted allocations for instance e9a5de88-37f0-4953-92a2-6f8db0b2f02e
Aug 26 23:26:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1f0c4810-d9dd-4d40-910b-951569559ff7 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Lock "e9a5de88-37f0-4953-92a2-6f8db0b2f02e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.502s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:26:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-643fdb34-5013-487c-b3d7-ab82234fe7d7 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Acquiring lock "6df9ebc6-0b6a-4cdc-811d-d43be88958f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:26:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-643fdb34-5013-487c-b3d7-ab82234fe7d7 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Lock "6df9ebc6-0b6a-4cdc-811d-d43be88958f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:26:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-643fdb34-5013-487c-b3d7-ab82234fe7d7 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Acquiring lock "6df9ebc6-0b6a-4cdc-811d-d43be88958f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:26:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-643fdb34-5013-487c-b3d7-ab82234fe7d7 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Lock "6df9ebc6-0b6a-4cdc-811d-d43be88958f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:26:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-643fdb34-5013-487c-b3d7-ab82234fe7d7 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Lock "6df9ebc6-0b6a-4cdc-811d-d43be88958f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:26:36 user nova-compute[73497]: INFO nova.compute.manager [None req-643fdb34-5013-487c-b3d7-ab82234fe7d7 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Terminating instance
Aug 26 23:26:36 user nova-compute[73497]: DEBUG nova.compute.manager [None req-643fdb34-5013-487c-b3d7-ab82234fe7d7 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:26:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:37 user nova-compute[73497]: DEBUG nova.compute.manager [req-3cae16ae-7d86-48c4-96cf-b94a7188e5c6 req-08bcfdd0-df0d-47b0-9176-a516ca22e107 service nova] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Received event network-vif-unplugged-09704f88-352c-4a21-8e61-f2b25818658d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:26:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3cae16ae-7d86-48c4-96cf-b94a7188e5c6 req-08bcfdd0-df0d-47b0-9176-a516ca22e107 service nova] Acquiring lock "6df9ebc6-0b6a-4cdc-811d-d43be88958f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:26:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3cae16ae-7d86-48c4-96cf-b94a7188e5c6 req-08bcfdd0-df0d-47b0-9176-a516ca22e107 service nova] Lock "6df9ebc6-0b6a-4cdc-811d-d43be88958f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:26:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3cae16ae-7d86-48c4-96cf-b94a7188e5c6 req-08bcfdd0-df0d-47b0-9176-a516ca22e107 service nova] Lock "6df9ebc6-0b6a-4cdc-811d-d43be88958f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:26:37 user nova-compute[73497]: DEBUG nova.compute.manager [req-3cae16ae-7d86-48c4-96cf-b94a7188e5c6 req-08bcfdd0-df0d-47b0-9176-a516ca22e107 service nova] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] No waiting events found dispatching network-vif-unplugged-09704f88-352c-4a21-8e61-f2b25818658d {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:26:37 user nova-compute[73497]: DEBUG nova.compute.manager [req-3cae16ae-7d86-48c4-96cf-b94a7188e5c6 req-08bcfdd0-df0d-47b0-9176-a516ca22e107 service nova] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Received event network-vif-unplugged-09704f88-352c-4a21-8e61-f2b25818658d for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:26:37 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Instance destroyed successfully.
Aug 26 23:26:37 user nova-compute[73497]: DEBUG nova.objects.instance [None req-643fdb34-5013-487c-b3d7-ab82234fe7d7 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Lazy-loading 'resources' on Instance uuid 6df9ebc6-0b6a-4cdc-811d-d43be88958f7 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:26:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-643fdb34-5013-487c-b3d7-ab82234fe7d7 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:24:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1975139429',display_name='tempest-VolumesActionsTest-instance-1975139429',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1975139429',id=26,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:24:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='987e60ebce5d45bd8abac0aad79f24c5',ramdisk_id='',reservation_id='r-n4nhdgfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-629841090',owner_user_name='tempest-VolumesActionsTest-629841090-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:24:36Z,user_data=None,user_id='3e9b0d6ec9b34e74a5c0f1382dbc0e79',uuid=6df9ebc6-0b6a-4cdc-811d-d43be88958f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09704f88-352c-4a21-8e61-f2b25818658d", "address": "fa:16:3e:9a:c6:81", "network": {"id": "f4d31a8d-e7ba-4eb5-95bd-6b35c83d6232", "bridge": "br-int", "label": "tempest-VolumesActionsTest-704740708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "987e60ebce5d45bd8abac0aad79f24c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09704f88-35", "ovs_interfaceid": "09704f88-352c-4a21-8e61-f2b25818658d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:26:37 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-643fdb34-5013-487c-b3d7-ab82234fe7d7 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Converting VIF {"id": "09704f88-352c-4a21-8e61-f2b25818658d", "address": "fa:16:3e:9a:c6:81", "network": {"id": "f4d31a8d-e7ba-4eb5-95bd-6b35c83d6232", "bridge": "br-int", "label": "tempest-VolumesActionsTest-704740708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "987e60ebce5d45bd8abac0aad79f24c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09704f88-35", "ovs_interfaceid": "09704f88-352c-4a21-8e61-f2b25818658d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:26:37 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-643fdb34-5013-487c-b3d7-ab82234fe7d7 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:c6:81,bridge_name='br-int',has_traffic_filtering=True,id=09704f88-352c-4a21-8e61-f2b25818658d,network=Network(f4d31a8d-e7ba-4eb5-95bd-6b35c83d6232),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09704f88-35') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:26:37 user nova-compute[73497]: DEBUG os_vif [None req-643fdb34-5013-487c-b3d7-ab82234fe7d7 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:c6:81,bridge_name='br-int',has_traffic_filtering=True,id=09704f88-352c-4a21-8e61-f2b25818658d,network=Network(f4d31a8d-e7ba-4eb5-95bd-6b35c83d6232),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09704f88-35') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:26:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09704f88-35, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:26:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:26:37 user nova-compute[73497]: INFO os_vif [None req-643fdb34-5013-487c-b3d7-ab82234fe7d7 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:c6:81,bridge_name='br-int',has_traffic_filtering=True,id=09704f88-352c-4a21-8e61-f2b25818658d,network=Network(f4d31a8d-e7ba-4eb5-95bd-6b35c83d6232),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09704f88-35')
Aug 26 23:26:37 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-643fdb34-5013-487c-b3d7-ab82234fe7d7 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Deleting instance files /opt/stack/data/nova/instances/6df9ebc6-0b6a-4cdc-811d-d43be88958f7_del
Aug 26 23:26:37 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-643fdb34-5013-487c-b3d7-ab82234fe7d7 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Deletion of /opt/stack/data/nova/instances/6df9ebc6-0b6a-4cdc-811d-d43be88958f7_del complete
Aug 26 23:26:37 user nova-compute[73497]: INFO nova.compute.manager [None req-643fdb34-5013-487c-b3d7-ab82234fe7d7 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 26 23:26:37 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-643fdb34-5013-487c-b3d7-ab82234fe7d7 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:26:37 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:26:37 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:26:38 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:26:38 user nova-compute[73497]: DEBUG nova.compute.manager [req-1f3830ff-6454-41d2-b92d-b481069d98b9 req-b3ae8c49-90c0-4636-ab8a-dbd146c73c29 service nova] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Received event network-vif-deleted-09704f88-352c-4a21-8e61-f2b25818658d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:26:38 user nova-compute[73497]: INFO nova.compute.manager [req-1f3830ff-6454-41d2-b92d-b481069d98b9 req-b3ae8c49-90c0-4636-ab8a-dbd146c73c29 service nova] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Neutron deleted interface 09704f88-352c-4a21-8e61-f2b25818658d; detaching it from the instance and deleting it from the info cache
Aug 26 23:26:38 user nova-compute[73497]: DEBUG nova.network.neutron [req-1f3830ff-6454-41d2-b92d-b481069d98b9 req-b3ae8c49-90c0-4636-ab8a-dbd146c73c29 service nova] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:26:38 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Took 0.56 seconds to deallocate network for instance.
Aug 26 23:26:38 user nova-compute[73497]: DEBUG nova.compute.manager [req-1f3830ff-6454-41d2-b92d-b481069d98b9 req-b3ae8c49-90c0-4636-ab8a-dbd146c73c29 service nova] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Detach interface failed, port_id=09704f88-352c-4a21-8e61-f2b25818658d, reason: Instance 6df9ebc6-0b6a-4cdc-811d-d43be88958f7 could not be found. {{(pid=73497) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 23:26:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-643fdb34-5013-487c-b3d7-ab82234fe7d7 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:26:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-643fdb34-5013-487c-b3d7-ab82234fe7d7 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:26:38 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-643fdb34-5013-487c-b3d7-ab82234fe7d7 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:26:38 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-643fdb34-5013-487c-b3d7-ab82234fe7d7 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:26:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-643fdb34-5013-487c-b3d7-ab82234fe7d7 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:26:39 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-643fdb34-5013-487c-b3d7-ab82234fe7d7 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Deleted allocations for instance 6df9ebc6-0b6a-4cdc-811d-d43be88958f7
Aug 26 23:26:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-643fdb34-5013-487c-b3d7-ab82234fe7d7 tempest-VolumesActionsTest-629841090 tempest-VolumesActionsTest-629841090-project-member] Lock "6df9ebc6-0b6a-4cdc-811d-d43be88958f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.378s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:26:39 user nova-compute[73497]: DEBUG nova.compute.manager [req-cacc754a-b040-4297-9525-acf18dcbfd16 req-fc7014a2-c3f4-4aed-9a07-df3c58342730 service nova] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Received event network-vif-plugged-09704f88-352c-4a21-8e61-f2b25818658d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:26:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cacc754a-b040-4297-9525-acf18dcbfd16 req-fc7014a2-c3f4-4aed-9a07-df3c58342730 service nova] Acquiring lock "6df9ebc6-0b6a-4cdc-811d-d43be88958f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:26:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cacc754a-b040-4297-9525-acf18dcbfd16 req-fc7014a2-c3f4-4aed-9a07-df3c58342730 service nova] Lock "6df9ebc6-0b6a-4cdc-811d-d43be88958f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:26:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cacc754a-b040-4297-9525-acf18dcbfd16 req-fc7014a2-c3f4-4aed-9a07-df3c58342730 service nova] Lock "6df9ebc6-0b6a-4cdc-811d-d43be88958f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:26:39 user nova-compute[73497]: DEBUG nova.compute.manager [req-cacc754a-b040-4297-9525-acf18dcbfd16 req-fc7014a2-c3f4-4aed-9a07-df3c58342730 service nova] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] No waiting events found dispatching network-vif-plugged-09704f88-352c-4a21-8e61-f2b25818658d {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:26:39 user nova-compute[73497]: WARNING nova.compute.manager [req-cacc754a-b040-4297-9525-acf18dcbfd16 req-fc7014a2-c3f4-4aed-9a07-df3c58342730 service nova] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Received unexpected event network-vif-plugged-09704f88-352c-4a21-8e61-f2b25818658d for instance with vm_state deleted and task_state None.
Aug 26 23:26:39 user nova-compute[73497]: DEBUG nova.compute.manager [req-2745430a-0f1d-4375-97eb-c7e92f44807c req-553a6639-ac33-4e00-b179-18cd17e046a1 service nova] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Received event network-changed-1772e978-02b5-4c0b-a99c-67f6c6f91d58 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:26:39 user nova-compute[73497]: DEBUG nova.compute.manager [req-2745430a-0f1d-4375-97eb-c7e92f44807c req-553a6639-ac33-4e00-b179-18cd17e046a1 service nova] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Refreshing instance network info cache due to event network-changed-1772e978-02b5-4c0b-a99c-67f6c6f91d58. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:26:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2745430a-0f1d-4375-97eb-c7e92f44807c req-553a6639-ac33-4e00-b179-18cd17e046a1 service nova] Acquiring lock "refresh_cache-171985a3-358d-4b26-a66c-372b9b99b386" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:26:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2745430a-0f1d-4375-97eb-c7e92f44807c req-553a6639-ac33-4e00-b179-18cd17e046a1 service nova] Acquired lock "refresh_cache-171985a3-358d-4b26-a66c-372b9b99b386" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:26:39 user nova-compute[73497]: DEBUG nova.network.neutron [req-2745430a-0f1d-4375-97eb-c7e92f44807c req-553a6639-ac33-4e00-b179-18cd17e046a1 service nova] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Refreshing network info cache for port 1772e978-02b5-4c0b-a99c-67f6c6f91d58 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:26:40 user nova-compute[73497]: DEBUG nova.network.neutron [req-2745430a-0f1d-4375-97eb-c7e92f44807c req-553a6639-ac33-4e00-b179-18cd17e046a1 service nova] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Updated VIF entry in instance network info cache for port 1772e978-02b5-4c0b-a99c-67f6c6f91d58. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:26:40 user nova-compute[73497]: DEBUG nova.network.neutron [req-2745430a-0f1d-4375-97eb-c7e92f44807c req-553a6639-ac33-4e00-b179-18cd17e046a1 service nova] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Updating instance_info_cache with network_info: [{"id": "1772e978-02b5-4c0b-a99c-67f6c6f91d58", "address": "fa:16:3e:a7:28:86", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1772e978-02", "ovs_interfaceid": "1772e978-02b5-4c0b-a99c-67f6c6f91d58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:26:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2745430a-0f1d-4375-97eb-c7e92f44807c req-553a6639-ac33-4e00-b179-18cd17e046a1 service nova] Releasing lock "refresh_cache-171985a3-358d-4b26-a66c-372b9b99b386" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:26:41 user nova-compute[73497]: DEBUG nova.compute.manager [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Stashing vm_state: active {{(pid=73497) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 26 23:26:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:26:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:26:42 user nova-compute[73497]: DEBUG nova.compute.manager [req-330a2bf5-5fa6-4dca-bb2d-2bea1d93b72e req-3cfee84e-d421-42fa-9fbd-5f45738cff66 service nova] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Received event network-changed-1839e5ce-756d-4e0c-bf8c-f8a63976cb79 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:26:42 user nova-compute[73497]: DEBUG nova.compute.manager [req-330a2bf5-5fa6-4dca-bb2d-2bea1d93b72e req-3cfee84e-d421-42fa-9fbd-5f45738cff66 service nova] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Refreshing instance network info cache due to event network-changed-1839e5ce-756d-4e0c-bf8c-f8a63976cb79. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:26:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-330a2bf5-5fa6-4dca-bb2d-2bea1d93b72e req-3cfee84e-d421-42fa-9fbd-5f45738cff66 service nova] Acquiring lock "refresh_cache-40afa348-8391-4643-977c-e67eab5c9476" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:26:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-330a2bf5-5fa6-4dca-bb2d-2bea1d93b72e req-3cfee84e-d421-42fa-9fbd-5f45738cff66 service nova] Acquired lock "refresh_cache-40afa348-8391-4643-977c-e67eab5c9476" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:26:42 user nova-compute[73497]: DEBUG nova.network.neutron [req-330a2bf5-5fa6-4dca-bb2d-2bea1d93b72e req-3cfee84e-d421-42fa-9fbd-5f45738cff66 service nova] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Refreshing network info cache for port 1839e5ce-756d-4e0c-bf8c-f8a63976cb79 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:26:42 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:26:42 user nova-compute[73497]: INFO nova.compute.claims [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Claim successful on node user
Aug 26 23:26:42 user nova-compute[73497]: INFO nova.compute.resource_tracker [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Updating resource usage from migration 1a7b5b2a-d801-44eb-b24c-990f5ddcbb0a
Aug 26 23:26:42 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:26:42 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:26:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.483s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:26:42 user nova-compute[73497]: INFO nova.compute.manager [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Migrating
Aug 26 23:26:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "refresh_cache-40afa348-8391-4643-977c-e67eab5c9476" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:26:42 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693092387.7253702, e9a5de88-37f0-4953-92a2-6f8db0b2f02e => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:26:42 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] VM Stopped (Lifecycle Event)
Aug 26 23:26:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:42 user nova-compute[73497]: DEBUG nova.compute.manager [None req-ee95a9d7-8ff8-4a63-b602-a3039756e3ee None None] [instance: e9a5de88-37f0-4953-92a2-6f8db0b2f02e] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:26:43 user nova-compute[73497]: DEBUG nova.network.neutron [req-330a2bf5-5fa6-4dca-bb2d-2bea1d93b72e req-3cfee84e-d421-42fa-9fbd-5f45738cff66 service nova] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Updated VIF entry in instance network info cache for port 1839e5ce-756d-4e0c-bf8c-f8a63976cb79. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:26:43 user nova-compute[73497]: DEBUG nova.network.neutron [req-330a2bf5-5fa6-4dca-bb2d-2bea1d93b72e req-3cfee84e-d421-42fa-9fbd-5f45738cff66 service nova] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Updating instance_info_cache with network_info: [{"id": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "address": "fa:16:3e:c5:a7:fc", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1839e5ce-75", "ovs_interfaceid": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:26:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-330a2bf5-5fa6-4dca-bb2d-2bea1d93b72e req-3cfee84e-d421-42fa-9fbd-5f45738cff66 service nova] Releasing lock "refresh_cache-40afa348-8391-4643-977c-e67eab5c9476" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:26:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquired lock "refresh_cache-40afa348-8391-4643-977c-e67eab5c9476" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:26:43 user nova-compute[73497]: DEBUG nova.network.neutron [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:26:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:44 user nova-compute[73497]: DEBUG nova.network.neutron [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Updating instance_info_cache with network_info: [{"id": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "address": "fa:16:3e:c5:a7:fc", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1839e5ce-75", "ovs_interfaceid": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:26:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Releasing lock "refresh_cache-40afa348-8391-4643-977c-e67eab5c9476" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:26:44 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Starting migrate_disk_and_power_off {{(pid=73497) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 26 23:26:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:44 user nova-compute[73497]: DEBUG nova.compute.manager [req-9b1bc807-f79d-47df-a9e4-f1f62566ec7c req-0e24c82b-d287-4879-940e-0f2e203f9c99 service nova] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Received event network-vif-unplugged-1839e5ce-756d-4e0c-bf8c-f8a63976cb79 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:26:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9b1bc807-f79d-47df-a9e4-f1f62566ec7c req-0e24c82b-d287-4879-940e-0f2e203f9c99 service nova] Acquiring lock "40afa348-8391-4643-977c-e67eab5c9476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:26:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9b1bc807-f79d-47df-a9e4-f1f62566ec7c req-0e24c82b-d287-4879-940e-0f2e203f9c99 service nova] Lock "40afa348-8391-4643-977c-e67eab5c9476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:26:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9b1bc807-f79d-47df-a9e4-f1f62566ec7c req-0e24c82b-d287-4879-940e-0f2e203f9c99 service nova] Lock "40afa348-8391-4643-977c-e67eab5c9476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:26:44 user nova-compute[73497]: DEBUG nova.compute.manager [req-9b1bc807-f79d-47df-a9e4-f1f62566ec7c req-0e24c82b-d287-4879-940e-0f2e203f9c99 service nova] [instance: 40afa348-8391-4643-977c-e67eab5c9476] No waiting events found dispatching network-vif-unplugged-1839e5ce-756d-4e0c-bf8c-f8a63976cb79 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:26:44 user nova-compute[73497]: WARNING nova.compute.manager [req-9b1bc807-f79d-47df-a9e4-f1f62566ec7c req-0e24c82b-d287-4879-940e-0f2e203f9c99 service nova] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Received unexpected event network-vif-unplugged-1839e5ce-756d-4e0c-bf8c-f8a63976cb79 for instance with vm_state active and task_state resize_migrating.
Aug 26 23:26:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:45 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Instance destroyed successfully.
Aug 26 23:26:45 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:24:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2022799057',display_name='tempest-ServerActionsTestOtherA-server-2022799057',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2022799057',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkEfHl6zG9yr5sr9jutwV2XJmeMlhN65J2njpgcQb6mCyEUk0cV6s9h2VdW+/plwoOss4vho5+nme8j0/zabYBtL74xkosuFNe1bIAfxbSswJHdqiCv1/r8WNi7pn3DAQ==',key_name='tempest-keypair-1008924037',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:25:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='80c212cbb083450ea15ec54a96f12510',ramdisk_id='',reservation_id='r-8ixi3cop',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-81910947',owner_user_name='tempest-ServerActionsTestOtherA-81910947-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:26:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='935b8635557949cfba9b6528b97da95f',uuid=40afa348-8391-4643-977c-e67eab5c9476,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "address": "fa:16:3e:c5:a7:fc", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-636367253-network", "vif_mac": "fa:16:3e:c5:a7:fc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1839e5ce-75", "ovs_interfaceid": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Converting VIF {"id": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "address": "fa:16:3e:c5:a7:fc", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-636367253-network", "vif_mac": "fa:16:3e:c5:a7:fc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1839e5ce-75", "ovs_interfaceid": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:a7:fc,bridge_name='br-int',has_traffic_filtering=True,id=1839e5ce-756d-4e0c-bf8c-f8a63976cb79,network=Network(bf99a38a-faaf-4f1e-a161-736ce9089919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1839e5ce-75') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG os_vif [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:a7:fc,bridge_name='br-int',has_traffic_filtering=True,id=1839e5ce-756d-4e0c-bf8c-f8a63976cb79,network=Network(bf99a38a-faaf-4f1e-a161-736ce9089919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1839e5ce-75') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1839e5ce-75, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:26:45 user nova-compute[73497]: INFO os_vif [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:a7:fc,bridge_name='br-int',has_traffic_filtering=True,id=1839e5ce-756d-4e0c-bf8c-f8a63976cb79,network=Network(bf99a38a-faaf-4f1e-a161-736ce9089919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1839e5ce-75')
Aug 26 23:26:45 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbLpraVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:26:45 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:26:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc07d1c-f169-46f5-8353-9c38517f27f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8ca515-1e18-4afb-8d78-cecba26c44b6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:26:45 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:26:45 user nova-compute[73497]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:26:45 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:26:45 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:26:45 user nova-compute[73497]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:26:45 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281c3b1ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61'): ({'sde'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Removing single pathed devices sde {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05d2935-0ee1-4b0c-9dd4-9bcc7f6624cd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c9c361-5c84-4295-b713-70ae04dfa43c]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Flushing IO for device /dev/sde {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0237b01-aad2-48b1-90d7-19e3484fd7fe]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c6f992-00ae-4c0e-a43c-5b399101f72f]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] SCSI volumes sde have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3498ffb9-852e-4890-a02b-db70da0a5af2]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce575691-5066-436b-a9b2-eb7998df6ddf]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61, portal: 172.16.0.220,3260]
Aug 26 23:26:45 user nova-compute[73497]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61, portal: 172.16.0.220,3260] successful.
Aug 26 23:26:45 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dab2c4f-6263-4b89-abd1-3c95137fe49f]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] <== disconnect_volume: return (293ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:26:45 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:26:46 user nova-compute[73497]: DEBUG nova.network.neutron [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Port 1839e5ce-756d-4e0c-bf8c-f8a63976cb79 binding to destination host user is already ACTIVE {{(pid=73497) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 26 23:26:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "40afa348-8391-4643-977c-e67eab5c9476-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:26:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "40afa348-8391-4643-977c-e67eab5c9476-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:26:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "40afa348-8391-4643-977c-e67eab5c9476-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:26:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "refresh_cache-40afa348-8391-4643-977c-e67eab5c9476" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:26:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquired lock "refresh_cache-40afa348-8391-4643-977c-e67eab5c9476" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:26:46 user nova-compute[73497]: DEBUG nova.network.neutron [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:26:46 user nova-compute[73497]: DEBUG nova.compute.manager [req-22739bfb-8b35-4d09-ad83-9f1d1355734a req-81d060b6-bdac-476d-be6c-1b87f1039c47 service nova] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Received event network-vif-plugged-1839e5ce-756d-4e0c-bf8c-f8a63976cb79 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:26:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-22739bfb-8b35-4d09-ad83-9f1d1355734a req-81d060b6-bdac-476d-be6c-1b87f1039c47 service nova] Acquiring lock "40afa348-8391-4643-977c-e67eab5c9476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:26:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-22739bfb-8b35-4d09-ad83-9f1d1355734a req-81d060b6-bdac-476d-be6c-1b87f1039c47 service nova] Lock "40afa348-8391-4643-977c-e67eab5c9476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:26:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-22739bfb-8b35-4d09-ad83-9f1d1355734a req-81d060b6-bdac-476d-be6c-1b87f1039c47 service nova] Lock "40afa348-8391-4643-977c-e67eab5c9476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:26:46 user nova-compute[73497]: DEBUG nova.compute.manager [req-22739bfb-8b35-4d09-ad83-9f1d1355734a req-81d060b6-bdac-476d-be6c-1b87f1039c47 service nova] [instance: 40afa348-8391-4643-977c-e67eab5c9476] No waiting events found dispatching network-vif-plugged-1839e5ce-756d-4e0c-bf8c-f8a63976cb79 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:26:46 user nova-compute[73497]: WARNING nova.compute.manager [req-22739bfb-8b35-4d09-ad83-9f1d1355734a req-81d060b6-bdac-476d-be6c-1b87f1039c47 service nova] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Received unexpected event network-vif-plugged-1839e5ce-756d-4e0c-bf8c-f8a63976cb79 for instance with vm_state active and task_state resize_migrated.
Aug 26 23:26:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:47 user nova-compute[73497]: DEBUG nova.network.neutron [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Updating instance_info_cache with network_info: [{"id": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "address": "fa:16:3e:c5:a7:fc", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1839e5ce-75", "ovs_interfaceid": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:26:47 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Releasing lock "refresh_cache-40afa348-8391-4643-977c-e67eab5c9476" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:26:47 user nova-compute[73497]: DEBUG os_brick.utils [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:26:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:47 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd3fe5b-d391-4faf-acfb-987f9b46ecaa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:26:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:47 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[633e89d8-40e0-4178-a18e-dcf2f1be3da1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:26:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:47 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6db8905-d0c1-4321-ba0d-2d52bbd59b5e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:26:47 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6830d78-0310-491e-a5d9-fd30fd5fdd11]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:26:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:26:47 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:26:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:26:47 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:26:47 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdfc5ce-24f2-4087-a033-c14afa2fd3c8]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:26:47 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:26:47 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:26:47 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:26:47 user nova-compute[73497]: DEBUG os_brick.utils [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:26:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:52 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693092397.7080884, 6df9ebc6-0b6a-4cdc-811d-d43be88958f7 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:26:52 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] VM Stopped (Lifecycle Event)
Aug 26 23:26:52 user nova-compute[73497]: DEBUG nova.compute.manager [None req-61ecff91-0687-4e1a-b420-50ed1ed638e6 None None] [instance: 6df9ebc6-0b6a-4cdc-811d-d43be88958f7] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:26:55 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:26:55 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:26:55 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:26:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:26:57 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:26:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:26:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:26:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:26:57 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:26:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:59 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:26:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f6eb6e-272f-4b1e-b1d5-40769bf07165/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f6eb6e-272f-4b1e-b1d5-40769bf07165/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f6eb6e-272f-4b1e-b1d5-40769bf07165/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:26:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f6eb6e-272f-4b1e-b1d5-40769bf07165/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:26:59 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:26:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:00 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693092405.2633297, 40afa348-8391-4643-977c-e67eab5c9476 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:27:00 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 40afa348-8391-4643-977c-e67eab5c9476] VM Stopped (Lifecycle Event)
Aug 26 23:27:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:00 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4dd1a5d3-4034-4e80-bc4f-1d208ee8d868 None None] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:27:00 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4dd1a5d3-4034-4e80-bc4f-1d208ee8d868 None None] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:27:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:00 user nova-compute[73497]: INFO nova.compute.manager [None req-4dd1a5d3-4034-4e80-bc4f-1d208ee8d868 None None] [instance: 40afa348-8391-4643-977c-e67eab5c9476] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 23:27:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:00 user nova-compute[73497]: DEBUG nova.compute.manager [req-f83d078e-e92b-4f57-9884-42bc242e7749 req-546f86f5-452a-4a7a-b423-d78e2afac76c service nova] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Received event network-changed-c922af50-fef8-4a98-8642-f6a4df1fae6c {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:27:00 user nova-compute[73497]: DEBUG nova.compute.manager [req-f83d078e-e92b-4f57-9884-42bc242e7749 req-546f86f5-452a-4a7a-b423-d78e2afac76c service nova] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Refreshing instance network info cache due to event network-changed-c922af50-fef8-4a98-8642-f6a4df1fae6c. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:27:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f83d078e-e92b-4f57-9884-42bc242e7749 req-546f86f5-452a-4a7a-b423-d78e2afac76c service nova] Acquiring lock "refresh_cache-93f6eb6e-272f-4b1e-b1d5-40769bf07165" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:27:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f83d078e-e92b-4f57-9884-42bc242e7749 req-546f86f5-452a-4a7a-b423-d78e2afac76c service nova] Acquired lock "refresh_cache-93f6eb6e-272f-4b1e-b1d5-40769bf07165" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:27:00 user nova-compute[73497]: DEBUG nova.network.neutron [req-f83d078e-e92b-4f57-9884-42bc242e7749 req-546f86f5-452a-4a7a-b423-d78e2afac76c service nova] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Refreshing network info cache for port c922af50-fef8-4a98-8642-f6a4df1fae6c {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:27:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:27:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:01 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:27:01 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:27:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=7435MB free_disk=25.05047607421875GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:27:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:27:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:27:01 user nova-compute[73497]: DEBUG nova.network.neutron [req-f83d078e-e92b-4f57-9884-42bc242e7749 req-546f86f5-452a-4a7a-b423-d78e2afac76c service nova] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Updated VIF entry in instance network info cache for port c922af50-fef8-4a98-8642-f6a4df1fae6c. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:27:01 user nova-compute[73497]: DEBUG nova.network.neutron [req-f83d078e-e92b-4f57-9884-42bc242e7749 req-546f86f5-452a-4a7a-b423-d78e2afac76c service nova] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Updating instance_info_cache with network_info: [{"id": "c922af50-fef8-4a98-8642-f6a4df1fae6c", "address": "fa:16:3e:d9:19:3d", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc922af50-fe", "ovs_interfaceid": "c922af50-fef8-4a98-8642-f6a4df1fae6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:27:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f83d078e-e92b-4f57-9884-42bc242e7749 req-546f86f5-452a-4a7a-b423-d78e2afac76c service nova] Releasing lock "refresh_cache-93f6eb6e-272f-4b1e-b1d5-40769bf07165" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:27:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Applying migration context for instance 40afa348-8391-4643-977c-e67eab5c9476 as it has an incoming, in-progress migration 1a7b5b2a-d801-44eb-b24c-990f5ddcbb0a. Migration status is post-migrating {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 23:27:01 user nova-compute[73497]: INFO nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Updating resource usage from migration 1a7b5b2a-d801-44eb-b24c-990f5ddcbb0a
Aug 26 23:27:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 994093f0-e6b2-4c96-b259-c559ef2b1fbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:27:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 171985a3-358d-4b26-a66c-372b9b99b386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:27:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance aebaeda6-23d1-43a1-afc8-bdc8992067e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:27:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 043294e5-0618-4a31-bb19-1227ef1f5d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:27:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance e9e5c83f-0678-48d4-a81f-1a3f959aabcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:27:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance c601f97e-9e52-40c6-9085-45f38e709721 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:27:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:27:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 93f6eb6e-272f-4b1e-b1d5-40769bf07165 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:27:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance f7c83073-fadc-4e41-a4a9-df0bbe11aa28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:27:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Migration 1a7b5b2a-d801-44eb-b24c-990f5ddcbb0a is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 23:27:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 40afa348-8391-4643-977c-e67eab5c9476 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:27:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:27:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:27:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:02 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:27:02 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:27:02 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:27:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.570s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:27:03 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:27:03 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:27:03 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:27:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-e9e5c83f-0678-48d4-a81f-1a3f959aabcf" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:27:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-e9e5c83f-0678-48d4-a81f-1a3f959aabcf" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:27:03 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:27:04 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Updating instance_info_cache with network_info: [{"id": "3de77772-78de-4261-b064-d1c2d8e30b31", "address": "fa:16:3e:d7:8d:5d", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de77772-78", "ovs_interfaceid": "3de77772-78de-4261-b064-d1c2d8e30b31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:27:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-e9e5c83f-0678-48d4-a81f-1a3f959aabcf" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:27:04 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:27:04 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:27:04 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:27:04 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:27:05 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:27:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "93f6eb6e-272f-4b1e-b1d5-40769bf07165" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:27:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "93f6eb6e-272f-4b1e-b1d5-40769bf07165" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:27:05 user nova-compute[73497]: DEBUG nova.objects.instance [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lazy-loading 'flavor' on Instance uuid 93f6eb6e-272f-4b1e-b1d5-40769bf07165 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:27:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "93f6eb6e-272f-4b1e-b1d5-40769bf07165" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:27:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "93f6eb6e-272f-4b1e-b1d5-40769bf07165" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:27:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "93f6eb6e-272f-4b1e-b1d5-40769bf07165" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:27:05 user nova-compute[73497]: INFO nova.compute.manager [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Attaching volume 665ec3a4-14bf-4f0f-aba5-71e54a106a5c to /dev/vdb
Aug 26 23:27:06 user nova-compute[73497]: DEBUG os_brick.utils [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9be645e-3d1f-4090-92a9-149c452794a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4606635f-072a-466a-a9b9-ab4e13efff95]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e206d457-8652-465b-bf01-bbd703d52069]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6dbd8e-1e77-4171-b83a-c66d8383a6ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:27:06 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:27:06 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa7f944-cdf0-4c2f-b2e8-ba5587fc0252]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG os_brick.utils [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Updating existing volume attachment record: 384526f5-7f0d-4620-8875-e8b319614ebf {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Starting finish_migration {{(pid=73497) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Instance directory exists: not creating {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 23:27:06 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Creating image(s)
Aug 26 23:27:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Did not create local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Ensure instance console log exists: /opt/stack/data/nova/instances/40afa348-8391-4643-977c-e67eab5c9476/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Start _get_guest_xml network_info=[{"id": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "address": "fa:16:3e:c5:a7:fc", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-636367253-network", "vif_mac": "fa:16:3e:c5:a7:fc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1839e5ce-75", "ovs_interfaceid": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6e192392-d0f7-47e2-88b4-56977d2d6e8d', 'guest_format': None, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbLpraVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '40afa348-8391-4643-977c-e67eab5c9476', 'attached_at': '2023-08-26T23:27:07.000000', 'detached_at': '', 'volume_id': 'b5cc4471-9aff-4907-8edf-fb34125e8c61', 'serial': 'b5cc4471-9aff-4907-8edf-fb34125e8c61'}, 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:27:06 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:27:06 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:27:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbLpraVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:27:06 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:27:06 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:27:06 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:27:06 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:27:06 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:27:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f29dc9c-1b3f-4ee4-a8cd-846f5219fbf7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:27:06 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2348c4e6-a84e-4cae-94a4-a9d86545efb1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61] added
Aug 26 23:27:06 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.062s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8b53bf-274d-462f-aa91-958979f38cd6]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:06 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6aa546-b3a0-4d12-8a07-5f6044f225dc]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NbLpraVl {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NbLpraVl" returned: 0 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4ba91c-79fd-4635-a7f3-347ce5908a34]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NbLpraVl'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdab8b5e-9321-4bd6-871b-4477565c1da4]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01724a4-ac64-4527-bcc5-ffe550349637]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:27:07 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:27:07 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:27:07 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:27:07 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36bcd32-7362-47ed-99ca-69a320c59e10]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61, portal: 172.16.0.220,3260]
Aug 26 23:27:07 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61, portal: 172.16.0.220,3260] successful.
Aug 26 23:27:07 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28cb9c9-76bb-49d7-b882-26691d5927fb]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[68725292-faca-4872-8b69-a5cc962ded43]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:27:07 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:27:07 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:27:07 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:27:07 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:27:07 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:27:07 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.421s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea3e288-10d0-4031-8c32-fc93108b9386]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:27:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbLpraVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:27:08 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.459s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:27:08 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] <== connect_volume: return (1461ms) {'type': 'block', 'scsi_wwn': '23936313539323664', 'path': '/dev/sdd'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:27:08 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936313539323664', 'path': '/dev/sdd'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:27:08 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:24:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2022799057',display_name='tempest-ServerActionsTestOtherA-server-2022799057',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2022799057',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkEfHl6zG9yr5sr9jutwV2XJmeMlhN65J2njpgcQb6mCyEUk0cV6s9h2VdW+/plwoOss4vho5+nme8j0/zabYBtL74xkosuFNe1bIAfxbSswJHdqiCv1/r8WNi7pn3DAQ==',key_name='tempest-keypair-1008924037',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:25:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='80c212cbb083450ea15ec54a96f12510',ramdisk_id='',reservation_id='r-8ixi3cop',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-81910947',owner_user_name='tempest-ServerActionsTestOtherA-81910947-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:26:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='935b8635557949cfba9b6528b97da95f',uuid=40afa348-8391-4643-977c-e67eab5c9476,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "address": "fa:16:3e:c5:a7:fc", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-636367253-network", "vif_mac": "fa:16:3e:c5:a7:fc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1839e5ce-75", "ovs_interfaceid": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:27:08 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Converting VIF {"id": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "address": "fa:16:3e:c5:a7:fc", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-636367253-network", "vif_mac": "fa:16:3e:c5:a7:fc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1839e5ce-75", "ovs_interfaceid": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:27:08 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:a7:fc,bridge_name='br-int',has_traffic_filtering=True,id=1839e5ce-756d-4e0c-bf8c-f8a63976cb79,network=Network(bf99a38a-faaf-4f1e-a161-736ce9089919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1839e5ce-75') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:27:08 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:27:08 user nova-compute[73497]:   <uuid>40afa348-8391-4643-977c-e67eab5c9476</uuid>
Aug 26 23:27:08 user nova-compute[73497]:   <name>instance-0000001d</name>
Aug 26 23:27:08 user nova-compute[73497]:   <memory>2097152</memory>
Aug 26 23:27:08 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:27:08 user nova-compute[73497]:   <metadata>
Aug 26 23:27:08 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:27:08 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:27:08 user nova-compute[73497]:       <nova:name>tempest-ServerActionsTestOtherA-server-2022799057</nova:name>
Aug 26 23:27:08 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:27:06</nova:creationTime>
Aug 26 23:27:08 user nova-compute[73497]:       <nova:flavor name="m1.small">
Aug 26 23:27:08 user nova-compute[73497]:         <nova:memory>2048</nova:memory>
Aug 26 23:27:08 user nova-compute[73497]:         <nova:disk>20</nova:disk>
Aug 26 23:27:08 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:27:08 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:27:08 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:27:08 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:27:08 user nova-compute[73497]:       <nova:owner>
Aug 26 23:27:08 user nova-compute[73497]:         <nova:user uuid="935b8635557949cfba9b6528b97da95f">tempest-ServerActionsTestOtherA-81910947-project-member</nova:user>
Aug 26 23:27:08 user nova-compute[73497]:         <nova:project uuid="80c212cbb083450ea15ec54a96f12510">tempest-ServerActionsTestOtherA-81910947</nova:project>
Aug 26 23:27:08 user nova-compute[73497]:       </nova:owner>
Aug 26 23:27:08 user nova-compute[73497]:       <nova:ports>
Aug 26 23:27:08 user nova-compute[73497]:         <nova:port uuid="1839e5ce-756d-4e0c-bf8c-f8a63976cb79">
Aug 26 23:27:08 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 23:27:08 user nova-compute[73497]:         </nova:port>
Aug 26 23:27:08 user nova-compute[73497]:       </nova:ports>
Aug 26 23:27:08 user nova-compute[73497]:     </nova:instance>
Aug 26 23:27:08 user nova-compute[73497]:   </metadata>
Aug 26 23:27:08 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:27:08 user nova-compute[73497]:     <system>
Aug 26 23:27:08 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:27:08 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:27:08 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:27:08 user nova-compute[73497]:       <entry name="serial">40afa348-8391-4643-977c-e67eab5c9476</entry>
Aug 26 23:27:08 user nova-compute[73497]:       <entry name="uuid">40afa348-8391-4643-977c-e67eab5c9476</entry>
Aug 26 23:27:08 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:27:08 user nova-compute[73497]:     </system>
Aug 26 23:27:08 user nova-compute[73497]:   </sysinfo>
Aug 26 23:27:08 user nova-compute[73497]:   <os>
Aug 26 23:27:08 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:27:08 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:27:08 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:27:08 user nova-compute[73497]:   </os>
Aug 26 23:27:08 user nova-compute[73497]:   <features>
Aug 26 23:27:08 user nova-compute[73497]:     <acpi/>
Aug 26 23:27:08 user nova-compute[73497]:     <apic/>
Aug 26 23:27:08 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:27:08 user nova-compute[73497]:   </features>
Aug 26 23:27:08 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:27:08 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:27:08 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:27:08 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:27:08 user nova-compute[73497]:   </clock>
Aug 26 23:27:08 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:27:08 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:27:08 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:27:08 user nova-compute[73497]:   </cpu>
Aug 26 23:27:08 user nova-compute[73497]:   <devices>
Aug 26 23:27:08 user nova-compute[73497]:     <disk type="block" device="disk">
Aug 26 23:27:08 user nova-compute[73497]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:27:08 user nova-compute[73497]:       <source dev="/dev/sdd"/>
Aug 26 23:27:08 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:27:08 user nova-compute[73497]:       <serial>b5cc4471-9aff-4907-8edf-fb34125e8c61</serial>
Aug 26 23:27:08 user nova-compute[73497]:     </disk>
Aug 26 23:27:08 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:27:08 user nova-compute[73497]:       <mac address="fa:16:3e:c5:a7:fc"/>
Aug 26 23:27:08 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:27:08 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:27:08 user nova-compute[73497]:       <target dev="tap1839e5ce-75"/>
Aug 26 23:27:08 user nova-compute[73497]:     </interface>
Aug 26 23:27:08 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:27:08 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/40afa348-8391-4643-977c-e67eab5c9476/console.log" append="off"/>
Aug 26 23:27:08 user nova-compute[73497]:     </serial>
Aug 26 23:27:08 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:27:08 user nova-compute[73497]:     <video>
Aug 26 23:27:08 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:27:08 user nova-compute[73497]:     </video>
Aug 26 23:27:08 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:27:08 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:27:08 user nova-compute[73497]:     </rng>
Aug 26 23:27:08 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:27:08 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:27:08 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:27:08 user nova-compute[73497]:     </memballoon>
Aug 26 23:27:08 user nova-compute[73497]:   </devices>
Aug 26 23:27:08 user nova-compute[73497]: </domain>
Aug 26 23:27:08 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:27:08 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:24:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2022799057',display_name='tempest-ServerActionsTestOtherA-server-2022799057',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2022799057',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkEfHl6zG9yr5sr9jutwV2XJmeMlhN65J2njpgcQb6mCyEUk0cV6s9h2VdW+/plwoOss4vho5+nme8j0/zabYBtL74xkosuFNe1bIAfxbSswJHdqiCv1/r8WNi7pn3DAQ==',key_name='tempest-keypair-1008924037',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:25:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='80c212cbb083450ea15ec54a96f12510',ramdisk_id='',reservation_id='r-8ixi3cop',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-81910947',owner_user_name='tempest-ServerActionsTestOtherA-81910947-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:26:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='935b8635557949cfba9b6528b97da95f',uuid=40afa348-8391-4643-977c-e67eab5c9476,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "address": "fa:16:3e:c5:a7:fc", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-636367253-network", "vif_mac": "fa:16:3e:c5:a7:fc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1839e5ce-75", "ovs_interfaceid": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:27:08 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Converting VIF {"id": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "address": "fa:16:3e:c5:a7:fc", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-636367253-network", "vif_mac": "fa:16:3e:c5:a7:fc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1839e5ce-75", "ovs_interfaceid": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:27:08 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:a7:fc,bridge_name='br-int',has_traffic_filtering=True,id=1839e5ce-756d-4e0c-bf8c-f8a63976cb79,network=Network(bf99a38a-faaf-4f1e-a161-736ce9089919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1839e5ce-75') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:27:08 user nova-compute[73497]: DEBUG os_vif [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:a7:fc,bridge_name='br-int',has_traffic_filtering=True,id=1839e5ce-756d-4e0c-bf8c-f8a63976cb79,network=Network(bf99a38a-faaf-4f1e-a161-736ce9089919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1839e5ce-75') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:27:08 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:08 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:27:08 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:27:08 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:08 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1839e5ce-75, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:27:08 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1839e5ce-75, col_values=(('external_ids', {'iface-id': '1839e5ce-756d-4e0c-bf8c-f8a63976cb79', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:a7:fc', 'vm-uuid': '40afa348-8391-4643-977c-e67eab5c9476'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:27:08 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:08 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:27:08 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:08 user nova-compute[73497]: INFO os_vif [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:a7:fc,bridge_name='br-int',has_traffic_filtering=True,id=1839e5ce-756d-4e0c-bf8c-f8a63976cb79,network=Network(bf99a38a-faaf-4f1e-a161-736ce9089919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1839e5ce-75')
Aug 26 23:27:08 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:27:08 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] No VIF found with MAC fa:16:3e:c5:a7:fc, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:27:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:10 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:10 user nova-compute[73497]: DEBUG nova.compute.manager [req-c8892306-8f73-41e1-be16-4636d79d4270 req-f0db33dc-9d8c-4cbd-a6d6-6104d31ce2b9 service nova] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Received event network-vif-plugged-1839e5ce-756d-4e0c-bf8c-f8a63976cb79 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:27:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c8892306-8f73-41e1-be16-4636d79d4270 req-f0db33dc-9d8c-4cbd-a6d6-6104d31ce2b9 service nova] Acquiring lock "40afa348-8391-4643-977c-e67eab5c9476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:27:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c8892306-8f73-41e1-be16-4636d79d4270 req-f0db33dc-9d8c-4cbd-a6d6-6104d31ce2b9 service nova] Lock "40afa348-8391-4643-977c-e67eab5c9476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:27:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c8892306-8f73-41e1-be16-4636d79d4270 req-f0db33dc-9d8c-4cbd-a6d6-6104d31ce2b9 service nova] Lock "40afa348-8391-4643-977c-e67eab5c9476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:27:10 user nova-compute[73497]: DEBUG nova.compute.manager [req-c8892306-8f73-41e1-be16-4636d79d4270 req-f0db33dc-9d8c-4cbd-a6d6-6104d31ce2b9 service nova] [instance: 40afa348-8391-4643-977c-e67eab5c9476] No waiting events found dispatching network-vif-plugged-1839e5ce-756d-4e0c-bf8c-f8a63976cb79 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:27:10 user nova-compute[73497]: WARNING nova.compute.manager [req-c8892306-8f73-41e1-be16-4636d79d4270 req-f0db33dc-9d8c-4cbd-a6d6-6104d31ce2b9 service nova] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Received unexpected event network-vif-plugged-1839e5ce-756d-4e0c-bf8c-f8a63976cb79 for instance with vm_state active and task_state resize_finish.
Aug 26 23:27:11 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092431.974636, 40afa348-8391-4643-977c-e67eab5c9476 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:27:11 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 40afa348-8391-4643-977c-e67eab5c9476] VM Resumed (Lifecycle Event)
Aug 26 23:27:11 user nova-compute[73497]: DEBUG nova.compute.manager [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:27:11 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Instance running successfully.
Aug 26 23:27:11 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Failed to set time: agent not configured {{(pid=73497) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 26 23:27:11 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-5b84439c-ac30-4120-8b2d-f9ad883d2300 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] finish_migration finished successfully. {{(pid=73497) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 26 23:27:12 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:27:12 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:27:12 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 40afa348-8391-4643-977c-e67eab5c9476] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 23:27:12 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092431.9759967, 40afa348-8391-4643-977c-e67eab5c9476 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:27:12 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 40afa348-8391-4643-977c-e67eab5c9476] VM Started (Lifecycle Event)
Aug 26 23:27:12 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:27:12 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:27:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:12 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 40afa348-8391-4643-977c-e67eab5c9476] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 23:27:12 user nova-compute[73497]: DEBUG nova.compute.manager [req-03de23ef-297c-4fc4-959f-c91e2faa2ff0 req-f2a89723-9b96-4db9-a1d6-cac15ce4e0ce service nova] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Received event network-vif-plugged-1839e5ce-756d-4e0c-bf8c-f8a63976cb79 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:27:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-03de23ef-297c-4fc4-959f-c91e2faa2ff0 req-f2a89723-9b96-4db9-a1d6-cac15ce4e0ce service nova] Acquiring lock "40afa348-8391-4643-977c-e67eab5c9476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:27:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-03de23ef-297c-4fc4-959f-c91e2faa2ff0 req-f2a89723-9b96-4db9-a1d6-cac15ce4e0ce service nova] Lock "40afa348-8391-4643-977c-e67eab5c9476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:27:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-03de23ef-297c-4fc4-959f-c91e2faa2ff0 req-f2a89723-9b96-4db9-a1d6-cac15ce4e0ce service nova] Lock "40afa348-8391-4643-977c-e67eab5c9476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:27:12 user nova-compute[73497]: DEBUG nova.compute.manager [req-03de23ef-297c-4fc4-959f-c91e2faa2ff0 req-f2a89723-9b96-4db9-a1d6-cac15ce4e0ce service nova] [instance: 40afa348-8391-4643-977c-e67eab5c9476] No waiting events found dispatching network-vif-plugged-1839e5ce-756d-4e0c-bf8c-f8a63976cb79 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:27:12 user nova-compute[73497]: WARNING nova.compute.manager [req-03de23ef-297c-4fc4-959f-c91e2faa2ff0 req-f2a89723-9b96-4db9-a1d6-cac15ce4e0ce service nova] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Received unexpected event network-vif-plugged-1839e5ce-756d-4e0c-bf8c-f8a63976cb79 for instance with vm_state resized and task_state None.
Aug 26 23:27:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Acquiring lock "ed2c58fe-8d24-47ed-b5da-62e44e290901" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:27:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Lock "ed2c58fe-8d24-47ed-b5da-62e44e290901" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:27:18 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:27:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:27:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:27:18 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:27:18 user nova-compute[73497]: INFO nova.compute.claims [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Claim successful on node user
Aug 26 23:27:19 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EZpnclxT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:27:19 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:27:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:27:19 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:27:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:27:19 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4b17fe-bef1-4f6e-9065-033c34765bb3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:27:19 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea03691-579a-40bb-93cc-a4946047cecd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c] added
Aug 26 23:27:19 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c13844-902e-4e79-a3f0-60ca5adb8eef]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[666cee9e-2e28-485c-9d7c-4083151663c5]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EZpnclxT {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EZpnclxT" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[86869ea6-6bd6-472d-84d6-8b3e45641958]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EZpnclxT'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0774547-bfa6-4382-95a0-13bc3f7040e9]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.688s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[938ec572-dea3-4263-826d-f1ad348d4f61]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:27:19 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:27:19 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:27:19 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:27:19 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:27:19 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:27:19 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG nova.network.neutron [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed77674-6907-4a78-a85a-fd245f705a47]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c, portal: 172.16.0.220,3260]
Aug 26 23:27:19 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c, portal: 172.16.0.220,3260] successful.
Aug 26 23:27:19 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:27:19 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fdbfe0-b262-41c7-b067-9cbb0c6ddff0]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cdf16e-7186-469b-9c5b-5955289fda39]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:27:19 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:27:19 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:27:19 user nova-compute[73497]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c (non-flash)
Aug 26 23:27:19 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:27:19 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:27:19 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:27:19 user nova-compute[73497]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c (non-flash)
Aug 26 23:27:19 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.407s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd00632e-80fe-4aba-9144-6f948defe193]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EZpnclxT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG nova.policy [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39d36154f45848ecae45e455b5b150cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951ffc97c25a4d7b90efa5bb5cfd269c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:27:19 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Creating image(s)
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed2c58fe-8d24-47ed-b5da-62e44e290901/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Lock "/opt/stack/data/nova/instances/ed2c58fe-8d24-47ed-b5da-62e44e290901/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Lock "/opt/stack/data/nova/instances/ed2c58fe-8d24-47ed-b5da-62e44e290901/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:27:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.241s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:27:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:27:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.211s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/ed2c58fe-8d24-47ed-b5da-62e44e290901/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/ed2c58fe-8d24-47ed-b5da-62e44e290901/disk 1073741824" returned: 0 in 0.066s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:27:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:20 user nova-compute[73497]: DEBUG nova.network.neutron [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Successfully created port: af26fb56-8400-4916-bd8d-6ce28402144d {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:27:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.242s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:20 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed2c58fe-8d24-47ed-b5da-62e44e290901/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:27:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed2c58fe-8d24-47ed-b5da-62e44e290901/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.453s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:27:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] <== connect_volume: return (1457ms) {'type': 'block', 'scsi_wwn': '23737396530363963', 'path': '/dev/sde'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:27:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737396530363963', 'path': '/dev/sde'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:27:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed2c58fe-8d24-47ed-b5da-62e44e290901/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:20 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Cannot resize image /opt/stack/data/nova/instances/ed2c58fe-8d24-47ed-b5da-62e44e290901/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:27:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:27:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Ensure instance console log exists: /opt/stack/data/nova/instances/ed2c58fe-8d24-47ed-b5da-62e44e290901/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:27:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:27:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:27:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:27:20 user nova-compute[73497]: DEBUG nova.objects.instance [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lazy-loading 'flavor' on Instance uuid 93f6eb6e-272f-4b1e-b1d5-40769bf07165 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:27:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 23:27:20 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:27:20 user nova-compute[73497]:   <source dev="/dev/sde"/>
Aug 26 23:27:20 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:27:20 user nova-compute[73497]:   <serial>665ec3a4-14bf-4f0f-aba5-71e54a106a5c</serial>
Aug 26 23:27:20 user nova-compute[73497]: </disk>
Aug 26 23:27:20 user nova-compute[73497]:  {{(pid=73497) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] No VIF found with MAC fa:16:3e:d9:19:3d, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG nova.network.neutron [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Successfully updated port: af26fb56-8400-4916-bd8d-6ce28402144d {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Acquiring lock "refresh_cache-ed2c58fe-8d24-47ed-b5da-62e44e290901" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Acquired lock "refresh_cache-ed2c58fe-8d24-47ed-b5da-62e44e290901" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG nova.network.neutron [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG nova.compute.manager [req-0ad81ed9-7d78-42ed-bb03-4cb7b2f71e90 req-6a0eee41-14da-4d26-93e1-c96bdb331d72 service nova] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Received event network-changed-af26fb56-8400-4916-bd8d-6ce28402144d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG nova.compute.manager [req-0ad81ed9-7d78-42ed-bb03-4cb7b2f71e90 req-6a0eee41-14da-4d26-93e1-c96bdb331d72 service nova] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Refreshing instance network info cache due to event network-changed-af26fb56-8400-4916-bd8d-6ce28402144d. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0ad81ed9-7d78-42ed-bb03-4cb7b2f71e90 req-6a0eee41-14da-4d26-93e1-c96bdb331d72 service nova] Acquiring lock "refresh_cache-ed2c58fe-8d24-47ed-b5da-62e44e290901" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2c4aba5c-7b42-4f8b-a756-4f967cb97680 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "93f6eb6e-272f-4b1e-b1d5-40769bf07165" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.554s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG nova.network.neutron [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG nova.network.neutron [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Updating instance_info_cache with network_info: [{"id": "af26fb56-8400-4916-bd8d-6ce28402144d", "address": "fa:16:3e:b7:08:9a", "network": {"id": "35aa126f-8000-48cf-86c1-d57dbbb8c4d2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1248937097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "951ffc97c25a4d7b90efa5bb5cfd269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf26fb56-84", "ovs_interfaceid": "af26fb56-8400-4916-bd8d-6ce28402144d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Releasing lock "refresh_cache-ed2c58fe-8d24-47ed-b5da-62e44e290901" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Instance network_info: |[{"id": "af26fb56-8400-4916-bd8d-6ce28402144d", "address": "fa:16:3e:b7:08:9a", "network": {"id": "35aa126f-8000-48cf-86c1-d57dbbb8c4d2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1248937097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "951ffc97c25a4d7b90efa5bb5cfd269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf26fb56-84", "ovs_interfaceid": "af26fb56-8400-4916-bd8d-6ce28402144d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0ad81ed9-7d78-42ed-bb03-4cb7b2f71e90 req-6a0eee41-14da-4d26-93e1-c96bdb331d72 service nova] Acquired lock "refresh_cache-ed2c58fe-8d24-47ed-b5da-62e44e290901" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG nova.network.neutron [req-0ad81ed9-7d78-42ed-bb03-4cb7b2f71e90 req-6a0eee41-14da-4d26-93e1-c96bdb331d72 service nova] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Refreshing network info cache for port af26fb56-8400-4916-bd8d-6ce28402144d {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Start _get_guest_xml network_info=[{"id": "af26fb56-8400-4916-bd8d-6ce28402144d", "address": "fa:16:3e:b7:08:9a", "network": {"id": "35aa126f-8000-48cf-86c1-d57dbbb8c4d2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1248937097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "951ffc97c25a4d7b90efa5bb5cfd269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf26fb56-84", "ovs_interfaceid": "af26fb56-8400-4916-bd8d-6ce28402144d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:27:21 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:27:21 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:27:21 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:27:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1284936210',display_name='tempest-VolumesActionsTest-instance-1284936210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1284936210',id=32,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='951ffc97c25a4d7b90efa5bb5cfd269c',ramdisk_id='',reservation_id='r-0tr2abm1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1831950157',owner_user_name='tempest-VolumesActionsTest-1831950157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:27:20Z,user_data=None,user_id='39d36154f45848ecae45e455b5b150cd',uuid=ed2c58fe-8d24-47ed-b5da-62e44e290901,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af26fb56-8400-4916-bd8d-6ce28402144d", "address": "fa:16:3e:b7:08:9a", "network": {"id": "35aa126f-8000-48cf-86c1-d57dbbb8c4d2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1248937097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "951ffc97c25a4d7b90efa5bb5cfd269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf26fb56-84", "ovs_interfaceid": "af26fb56-8400-4916-bd8d-6ce28402144d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Converting VIF {"id": "af26fb56-8400-4916-bd8d-6ce28402144d", "address": "fa:16:3e:b7:08:9a", "network": {"id": "35aa126f-8000-48cf-86c1-d57dbbb8c4d2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1248937097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "951ffc97c25a4d7b90efa5bb5cfd269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf26fb56-84", "ovs_interfaceid": "af26fb56-8400-4916-bd8d-6ce28402144d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:08:9a,bridge_name='br-int',has_traffic_filtering=True,id=af26fb56-8400-4916-bd8d-6ce28402144d,network=Network(35aa126f-8000-48cf-86c1-d57dbbb8c4d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf26fb56-84') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG nova.objects.instance [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Lazy-loading 'pci_devices' on Instance uuid ed2c58fe-8d24-47ed-b5da-62e44e290901 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:27:21 user nova-compute[73497]:   <uuid>ed2c58fe-8d24-47ed-b5da-62e44e290901</uuid>
Aug 26 23:27:21 user nova-compute[73497]:   <name>instance-00000020</name>
Aug 26 23:27:21 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:27:21 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:27:21 user nova-compute[73497]:   <metadata>
Aug 26 23:27:21 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:27:21 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:27:21 user nova-compute[73497]:       <nova:name>tempest-VolumesActionsTest-instance-1284936210</nova:name>
Aug 26 23:27:21 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:27:21</nova:creationTime>
Aug 26 23:27:21 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:27:21 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:27:21 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:27:21 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:27:21 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:27:21 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:27:21 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:27:21 user nova-compute[73497]:       <nova:owner>
Aug 26 23:27:21 user nova-compute[73497]:         <nova:user uuid="39d36154f45848ecae45e455b5b150cd">tempest-VolumesActionsTest-1831950157-project-member</nova:user>
Aug 26 23:27:21 user nova-compute[73497]:         <nova:project uuid="951ffc97c25a4d7b90efa5bb5cfd269c">tempest-VolumesActionsTest-1831950157</nova:project>
Aug 26 23:27:21 user nova-compute[73497]:       </nova:owner>
Aug 26 23:27:21 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:27:21 user nova-compute[73497]:       <nova:ports>
Aug 26 23:27:21 user nova-compute[73497]:         <nova:port uuid="af26fb56-8400-4916-bd8d-6ce28402144d">
Aug 26 23:27:21 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 23:27:21 user nova-compute[73497]:         </nova:port>
Aug 26 23:27:21 user nova-compute[73497]:       </nova:ports>
Aug 26 23:27:21 user nova-compute[73497]:     </nova:instance>
Aug 26 23:27:21 user nova-compute[73497]:   </metadata>
Aug 26 23:27:21 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:27:21 user nova-compute[73497]:     <system>
Aug 26 23:27:21 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:27:21 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:27:21 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:27:21 user nova-compute[73497]:       <entry name="serial">ed2c58fe-8d24-47ed-b5da-62e44e290901</entry>
Aug 26 23:27:21 user nova-compute[73497]:       <entry name="uuid">ed2c58fe-8d24-47ed-b5da-62e44e290901</entry>
Aug 26 23:27:21 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:27:21 user nova-compute[73497]:     </system>
Aug 26 23:27:21 user nova-compute[73497]:   </sysinfo>
Aug 26 23:27:21 user nova-compute[73497]:   <os>
Aug 26 23:27:21 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:27:21 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:27:21 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:27:21 user nova-compute[73497]:   </os>
Aug 26 23:27:21 user nova-compute[73497]:   <features>
Aug 26 23:27:21 user nova-compute[73497]:     <acpi/>
Aug 26 23:27:21 user nova-compute[73497]:     <apic/>
Aug 26 23:27:21 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:27:21 user nova-compute[73497]:   </features>
Aug 26 23:27:21 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:27:21 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:27:21 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:27:21 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:27:21 user nova-compute[73497]:   </clock>
Aug 26 23:27:21 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:27:21 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:27:21 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:27:21 user nova-compute[73497]:   </cpu>
Aug 26 23:27:21 user nova-compute[73497]:   <devices>
Aug 26 23:27:21 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:27:21 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:27:21 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/ed2c58fe-8d24-47ed-b5da-62e44e290901/disk"/>
Aug 26 23:27:21 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:27:21 user nova-compute[73497]:     </disk>
Aug 26 23:27:21 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:27:21 user nova-compute[73497]:       <mac address="fa:16:3e:b7:08:9a"/>
Aug 26 23:27:21 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:27:21 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:27:21 user nova-compute[73497]:       <target dev="tapaf26fb56-84"/>
Aug 26 23:27:21 user nova-compute[73497]:     </interface>
Aug 26 23:27:21 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:27:21 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/ed2c58fe-8d24-47ed-b5da-62e44e290901/console.log" append="off"/>
Aug 26 23:27:21 user nova-compute[73497]:     </serial>
Aug 26 23:27:21 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:27:21 user nova-compute[73497]:     <video>
Aug 26 23:27:21 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:27:21 user nova-compute[73497]:     </video>
Aug 26 23:27:21 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:27:21 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:27:21 user nova-compute[73497]:     </rng>
Aug 26 23:27:21 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:27:21 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:27:21 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:27:21 user nova-compute[73497]:     </memballoon>
Aug 26 23:27:21 user nova-compute[73497]:   </devices>
Aug 26 23:27:21 user nova-compute[73497]: </domain>
Aug 26 23:27:21 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:27:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1284936210',display_name='tempest-VolumesActionsTest-instance-1284936210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1284936210',id=32,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='951ffc97c25a4d7b90efa5bb5cfd269c',ramdisk_id='',reservation_id='r-0tr2abm1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1831950157',owner_user_name='tempest-VolumesActionsTest-1831950157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:27:20Z,user_data=None,user_id='39d36154f45848ecae45e455b5b150cd',uuid=ed2c58fe-8d24-47ed-b5da-62e44e290901,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af26fb56-8400-4916-bd8d-6ce28402144d", "address": "fa:16:3e:b7:08:9a", "network": {"id": "35aa126f-8000-48cf-86c1-d57dbbb8c4d2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1248937097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "951ffc97c25a4d7b90efa5bb5cfd269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf26fb56-84", "ovs_interfaceid": "af26fb56-8400-4916-bd8d-6ce28402144d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Converting VIF {"id": "af26fb56-8400-4916-bd8d-6ce28402144d", "address": "fa:16:3e:b7:08:9a", "network": {"id": "35aa126f-8000-48cf-86c1-d57dbbb8c4d2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1248937097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "951ffc97c25a4d7b90efa5bb5cfd269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf26fb56-84", "ovs_interfaceid": "af26fb56-8400-4916-bd8d-6ce28402144d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:08:9a,bridge_name='br-int',has_traffic_filtering=True,id=af26fb56-8400-4916-bd8d-6ce28402144d,network=Network(35aa126f-8000-48cf-86c1-d57dbbb8c4d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf26fb56-84') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG os_vif [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:08:9a,bridge_name='br-int',has_traffic_filtering=True,id=af26fb56-8400-4916-bd8d-6ce28402144d,network=Network(35aa126f-8000-48cf-86c1-d57dbbb8c4d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf26fb56-84') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf26fb56-84, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaf26fb56-84, col_values=(('external_ids', {'iface-id': 'af26fb56-8400-4916-bd8d-6ce28402144d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:08:9a', 'vm-uuid': 'ed2c58fe-8d24-47ed-b5da-62e44e290901'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:27:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:27:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:22 user nova-compute[73497]: INFO os_vif [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:08:9a,bridge_name='br-int',has_traffic_filtering=True,id=af26fb56-8400-4916-bd8d-6ce28402144d,network=Network(35aa126f-8000-48cf-86c1-d57dbbb8c4d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf26fb56-84')
Aug 26 23:27:22 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:27:22 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] No VIF found with MAC fa:16:3e:b7:08:9a, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:27:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8d8af2e2-07c8-4e7e-918a-4ba294c3d40b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "93f6eb6e-272f-4b1e-b1d5-40769bf07165" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:27:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8d8af2e2-07c8-4e7e-918a-4ba294c3d40b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "93f6eb6e-272f-4b1e-b1d5-40769bf07165" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:27:22 user nova-compute[73497]: INFO nova.compute.manager [None req-8d8af2e2-07c8-4e7e-918a-4ba294c3d40b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Detaching volume 665ec3a4-14bf-4f0f-aba5-71e54a106a5c
Aug 26 23:27:22 user nova-compute[73497]: INFO nova.virt.block_device [None req-8d8af2e2-07c8-4e7e-918a-4ba294c3d40b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Attempting to driver detach volume 665ec3a4-14bf-4f0f-aba5-71e54a106a5c from mountpoint /dev/vdb
Aug 26 23:27:22 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8d8af2e2-07c8-4e7e-918a-4ba294c3d40b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Attempting to detach device vdb from instance 93f6eb6e-272f-4b1e-b1d5-40769bf07165 from the persistent domain config. {{(pid=73497) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 23:27:22 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-8d8af2e2-07c8-4e7e-918a-4ba294c3d40b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:27:22 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:27:22 user nova-compute[73497]:   <source dev="/dev/sde"/>
Aug 26 23:27:22 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:27:22 user nova-compute[73497]:   <serial>665ec3a4-14bf-4f0f-aba5-71e54a106a5c</serial>
Aug 26 23:27:22 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:27:22 user nova-compute[73497]: </disk>
Aug 26 23:27:22 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:27:22 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-8d8af2e2-07c8-4e7e-918a-4ba294c3d40b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Successfully detached device vdb from instance 93f6eb6e-272f-4b1e-b1d5-40769bf07165 from the persistent domain config.
Aug 26 23:27:22 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8d8af2e2-07c8-4e7e-918a-4ba294c3d40b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 93f6eb6e-272f-4b1e-b1d5-40769bf07165 from the live domain config. {{(pid=73497) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 23:27:22 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-8d8af2e2-07c8-4e7e-918a-4ba294c3d40b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:27:22 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:27:22 user nova-compute[73497]:   <source dev="/dev/sde"/>
Aug 26 23:27:22 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:27:22 user nova-compute[73497]:   <serial>665ec3a4-14bf-4f0f-aba5-71e54a106a5c</serial>
Aug 26 23:27:22 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:27:22 user nova-compute[73497]: </disk>
Aug 26 23:27:22 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG nova.network.neutron [req-0ad81ed9-7d78-42ed-bb03-4cb7b2f71e90 req-6a0eee41-14da-4d26-93e1-c96bdb331d72 service nova] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Updated VIF entry in instance network info cache for port af26fb56-8400-4916-bd8d-6ce28402144d. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG nova.network.neutron [req-0ad81ed9-7d78-42ed-bb03-4cb7b2f71e90 req-6a0eee41-14da-4d26-93e1-c96bdb331d72 service nova] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Updating instance_info_cache with network_info: [{"id": "af26fb56-8400-4916-bd8d-6ce28402144d", "address": "fa:16:3e:b7:08:9a", "network": {"id": "35aa126f-8000-48cf-86c1-d57dbbb8c4d2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1248937097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "951ffc97c25a4d7b90efa5bb5cfd269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf26fb56-84", "ovs_interfaceid": "af26fb56-8400-4916-bd8d-6ce28402144d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0ad81ed9-7d78-42ed-bb03-4cb7b2f71e90 req-6a0eee41-14da-4d26-93e1-c96bdb331d72 service nova] Releasing lock "refresh_cache-ed2c58fe-8d24-47ed-b5da-62e44e290901" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Received event <DeviceRemovedEvent: 1693092443.402332, 93f6eb6e-272f-4b1e-b1d5-40769bf07165 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73497) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8d8af2e2-07c8-4e7e-918a-4ba294c3d40b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 93f6eb6e-272f-4b1e-b1d5-40769bf07165 {{(pid=73497) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 23:27:23 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-8d8af2e2-07c8-4e7e-918a-4ba294c3d40b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Successfully detached device vdb from instance 93f6eb6e-272f-4b1e-b1d5-40769bf07165 from the live domain config.
Aug 26 23:27:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d8af2e2-07c8-4e7e-918a-4ba294c3d40b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d8af2e2-07c8-4e7e-918a-4ba294c3d40b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EZpnclxT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:27:23 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-8d8af2e2-07c8-4e7e-918a-4ba294c3d40b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:27:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8d8af2e2-07c8-4e7e-918a-4ba294c3d40b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8d8af2e2-07c8-4e7e-918a-4ba294c3d40b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d8af2e2-07c8-4e7e-918a-4ba294c3d40b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e608f9-0d7f-49bc-ba60-8fe519022204]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4a50f8-a974-4906-926f-5e12a0755dc0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d8af2e2-07c8-4e7e-918a-4ba294c3d40b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:27:23 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:27:23 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:27:23 user nova-compute[73497]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c (non-flash)
Aug 26 23:27:23 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d8af2e2-07c8-4e7e-918a-4ba294c3d40b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:27:23 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:27:23 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:27:23 user nova-compute[73497]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c (non-flash)
Aug 26 23:27:23 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d8af2e2-07c8-4e7e-918a-4ba294c3d40b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282c53eef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c'): ({'sde'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-8d8af2e2-07c8-4e7e-918a-4ba294c3d40b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Removing single pathed devices sde {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a92b752-dc70-40d1-bd04-cedacaae09b7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[776d2578-cda4-455b-9742-e1429972fb0a]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-8d8af2e2-07c8-4e7e-918a-4ba294c3d40b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Flushing IO for device /dev/sde {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0759cc2f-d123-4dcc-9137-5fc1c8c4877d]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-8d8af2e2-07c8-4e7e-918a-4ba294c3d40b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.058s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[725385bb-e6f7-439e-b8d6-15b6061281e7]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-8d8af2e2-07c8-4e7e-918a-4ba294c3d40b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-8d8af2e2-07c8-4e7e-918a-4ba294c3d40b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] SCSI volumes sde have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d8af2e2-07c8-4e7e-918a-4ba294c3d40b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[39eac927-df3a-4d90-b240-06e6f2c2411b]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d8af2e2-07c8-4e7e-918a-4ba294c3d40b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9d4f99-9ead-4244-9ca3-0d36c75866dd]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d8af2e2-07c8-4e7e-918a-4ba294c3d40b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c, portal: 172.16.0.220,3260]
Aug 26 23:27:23 user nova-compute[73497]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c, portal: 172.16.0.220,3260] successful.
Aug 26 23:27:23 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665ec3a4-14bf-4f0f-aba5-71e54a106a5c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b465c377-aa89-4540-a2dd-eb360d597b35]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d8af2e2-07c8-4e7e-918a-4ba294c3d40b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8d8af2e2-07c8-4e7e-918a-4ba294c3d40b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d8af2e2-07c8-4e7e-918a-4ba294c3d40b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] <== disconnect_volume: return (380ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d8af2e2-07c8-4e7e-918a-4ba294c3d40b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:23 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:24 user nova-compute[73497]: DEBUG nova.compute.manager [req-1bace29b-437a-4e50-8701-27f430a0fc71 req-1abd2db3-49c9-48b2-ad43-fe2472281c2d service nova] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Received event network-vif-plugged-af26fb56-8400-4916-bd8d-6ce28402144d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:27:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1bace29b-437a-4e50-8701-27f430a0fc71 req-1abd2db3-49c9-48b2-ad43-fe2472281c2d service nova] Acquiring lock "ed2c58fe-8d24-47ed-b5da-62e44e290901-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:27:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1bace29b-437a-4e50-8701-27f430a0fc71 req-1abd2db3-49c9-48b2-ad43-fe2472281c2d service nova] Lock "ed2c58fe-8d24-47ed-b5da-62e44e290901-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:27:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1bace29b-437a-4e50-8701-27f430a0fc71 req-1abd2db3-49c9-48b2-ad43-fe2472281c2d service nova] Lock "ed2c58fe-8d24-47ed-b5da-62e44e290901-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:27:24 user nova-compute[73497]: DEBUG nova.compute.manager [req-1bace29b-437a-4e50-8701-27f430a0fc71 req-1abd2db3-49c9-48b2-ad43-fe2472281c2d service nova] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] No waiting events found dispatching network-vif-plugged-af26fb56-8400-4916-bd8d-6ce28402144d {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:27:24 user nova-compute[73497]: WARNING nova.compute.manager [req-1bace29b-437a-4e50-8701-27f430a0fc71 req-1abd2db3-49c9-48b2-ad43-fe2472281c2d service nova] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Received unexpected event network-vif-plugged-af26fb56-8400-4916-bd8d-6ce28402144d for instance with vm_state building and task_state spawning.
Aug 26 23:27:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:25 user nova-compute[73497]: DEBUG nova.objects.instance [None req-8d8af2e2-07c8-4e7e-918a-4ba294c3d40b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lazy-loading 'flavor' on Instance uuid 93f6eb6e-272f-4b1e-b1d5-40769bf07165 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:27:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8d8af2e2-07c8-4e7e-918a-4ba294c3d40b tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "93f6eb6e-272f-4b1e-b1d5-40769bf07165" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.342s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:27:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "e15ddee6-a642-4638-9534-21e640b3d017" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:27:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "e15ddee6-a642-4638-9534-21e640b3d017" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:27:25 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:27:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:27:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:27:25 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:27:25 user nova-compute[73497]: INFO nova.compute.claims [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Claim successful on node user
Aug 26 23:27:26 user nova-compute[73497]: DEBUG nova.compute.manager [req-90acabe0-9496-43e2-a140-7558156df8e0 req-b2c0be17-34c0-4cb6-b635-c1de46f8de7f service nova] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Received event network-vif-plugged-af26fb56-8400-4916-bd8d-6ce28402144d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:27:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-90acabe0-9496-43e2-a140-7558156df8e0 req-b2c0be17-34c0-4cb6-b635-c1de46f8de7f service nova] Acquiring lock "ed2c58fe-8d24-47ed-b5da-62e44e290901-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:27:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-90acabe0-9496-43e2-a140-7558156df8e0 req-b2c0be17-34c0-4cb6-b635-c1de46f8de7f service nova] Lock "ed2c58fe-8d24-47ed-b5da-62e44e290901-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:27:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-90acabe0-9496-43e2-a140-7558156df8e0 req-b2c0be17-34c0-4cb6-b635-c1de46f8de7f service nova] Lock "ed2c58fe-8d24-47ed-b5da-62e44e290901-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:27:26 user nova-compute[73497]: DEBUG nova.compute.manager [req-90acabe0-9496-43e2-a140-7558156df8e0 req-b2c0be17-34c0-4cb6-b635-c1de46f8de7f service nova] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] No waiting events found dispatching network-vif-plugged-af26fb56-8400-4916-bd8d-6ce28402144d {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:27:26 user nova-compute[73497]: WARNING nova.compute.manager [req-90acabe0-9496-43e2-a140-7558156df8e0 req-b2c0be17-34c0-4cb6-b635-c1de46f8de7f service nova] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Received unexpected event network-vif-plugged-af26fb56-8400-4916-bd8d-6ce28402144d for instance with vm_state building and task_state spawning.
Aug 26 23:27:26 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092446.2353067, ed2c58fe-8d24-47ed-b5da-62e44e290901 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:27:26 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] VM Resumed (Lifecycle Event)
Aug 26 23:27:26 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:27:26 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:27:26 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Instance spawned successfully.
Aug 26 23:27:26 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:27:26 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:27:26 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:27:26 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:27:26 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:27:26 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:27:26 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:27:26 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:27:26 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:27:26 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:27:26 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092446.2370713, ed2c58fe-8d24-47ed-b5da-62e44e290901 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:27:26 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] VM Started (Lifecycle Event)
Aug 26 23:27:26 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:27:26 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:27:26 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:27:26 user nova-compute[73497]: INFO nova.compute.manager [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Took 6.57 seconds to spawn the instance on the hypervisor.
Aug 26 23:27:26 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:27:26 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:27:26 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:27:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.577s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:27:26 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:27:26 user nova-compute[73497]: INFO nova.compute.manager [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Took 7.67 seconds to build instance.
Aug 26 23:27:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c709e681-4837-44e9-93bf-1b0963af1ab1 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Lock "ed2c58fe-8d24-47ed-b5da-62e44e290901" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.783s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:27:26 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:27:26 user nova-compute[73497]: DEBUG nova.network.neutron [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:27:26 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:27:26 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:27:26 user nova-compute[73497]: DEBUG nova.policy [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'af64aa253eec41a0976c3e527fe41831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4ca787dd33440d98779668507369ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:27:26 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:27:26 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:27:26 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Creating image(s)
Aug 26 23:27:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "/opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:27:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "/opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:27:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "/opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:27:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.196s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:27:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:27:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.230s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk 1073741824" returned: 0 in 0.062s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.298s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:27:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.193s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:27 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:27:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:27 user nova-compute[73497]: DEBUG nova.network.neutron [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Successfully created port: 8d982123-d2ef-4d00-95d1-bee24f228175 {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:27:27 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:27 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Cannot resize image /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:27:27 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:27:27 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Ensure instance console log exists: /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:27:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:27:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:27:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG nova.network.neutron [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Successfully updated port: 8d982123-d2ef-4d00-95d1-bee24f228175 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "refresh_cache-e15ddee6-a642-4638-9534-21e640b3d017" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquired lock "refresh_cache-e15ddee6-a642-4638-9534-21e640b3d017" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG nova.network.neutron [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG nova.compute.manager [req-3a179641-8751-434c-ae71-62372bed36c9 req-0abadb0d-8a60-4da1-9767-49b0764ea000 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Received event network-changed-8d982123-d2ef-4d00-95d1-bee24f228175 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG nova.compute.manager [req-3a179641-8751-434c-ae71-62372bed36c9 req-0abadb0d-8a60-4da1-9767-49b0764ea000 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Refreshing instance network info cache due to event network-changed-8d982123-d2ef-4d00-95d1-bee24f228175. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3a179641-8751-434c-ae71-62372bed36c9 req-0abadb0d-8a60-4da1-9767-49b0764ea000 service nova] Acquiring lock "refresh_cache-e15ddee6-a642-4638-9534-21e640b3d017" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG nova.network.neutron [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG nova.network.neutron [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Updating instance_info_cache with network_info: [{"id": "8d982123-d2ef-4d00-95d1-bee24f228175", "address": "fa:16:3e:e8:ce:24", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d982123-d2", "ovs_interfaceid": "8d982123-d2ef-4d00-95d1-bee24f228175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Releasing lock "refresh_cache-e15ddee6-a642-4638-9534-21e640b3d017" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Instance network_info: |[{"id": "8d982123-d2ef-4d00-95d1-bee24f228175", "address": "fa:16:3e:e8:ce:24", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d982123-d2", "ovs_interfaceid": "8d982123-d2ef-4d00-95d1-bee24f228175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3a179641-8751-434c-ae71-62372bed36c9 req-0abadb0d-8a60-4da1-9767-49b0764ea000 service nova] Acquired lock "refresh_cache-e15ddee6-a642-4638-9534-21e640b3d017" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG nova.network.neutron [req-3a179641-8751-434c-ae71-62372bed36c9 req-0abadb0d-8a60-4da1-9767-49b0764ea000 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Refreshing network info cache for port 8d982123-d2ef-4d00-95d1-bee24f228175 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Start _get_guest_xml network_info=[{"id": "8d982123-d2ef-4d00-95d1-bee24f228175", "address": "fa:16:3e:e8:ce:24", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d982123-d2", "ovs_interfaceid": "8d982123-d2ef-4d00-95d1-bee24f228175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:27:28 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:27:28 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:27:28 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:27:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-493508388',display_name='tempest-ServerRescueNegativeTestJSON-server-493508388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-493508388',id=33,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINj3seD7LQAkaX0wYOG1fS3idoL99uw4+1lVHlG8bZ0rOjqkGpGnEUfwVCpDQwjz4kP4hFSLF4r/El5/40r8+otqhjInnqtJnBnHrwpLdvAuBQM4cvraqsvSlrODkbriA==',key_name='tempest-keypair-198397446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c4ca787dd33440d98779668507369ee',ramdisk_id='',reservation_id='r-on4mu606',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1946187856',owner_user_name='tempest-ServerRescueNegativeTestJSON-1946187856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:27:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='af64aa253eec41a0976c3e527fe41831',uuid=e15ddee6-a642-4638-9534-21e640b3d017,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d982123-d2ef-4d00-95d1-bee24f228175", "address": "fa:16:3e:e8:ce:24", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d982123-d2", "ovs_interfaceid": "8d982123-d2ef-4d00-95d1-bee24f228175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Converting VIF {"id": "8d982123-d2ef-4d00-95d1-bee24f228175", "address": "fa:16:3e:e8:ce:24", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d982123-d2", "ovs_interfaceid": "8d982123-d2ef-4d00-95d1-bee24f228175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ce:24,bridge_name='br-int',has_traffic_filtering=True,id=8d982123-d2ef-4d00-95d1-bee24f228175,network=Network(6f13f07f-104d-4d8d-b5fa-afa402402a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d982123-d2') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG nova.objects.instance [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lazy-loading 'pci_devices' on Instance uuid e15ddee6-a642-4638-9534-21e640b3d017 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:27:28 user nova-compute[73497]:   <uuid>e15ddee6-a642-4638-9534-21e640b3d017</uuid>
Aug 26 23:27:28 user nova-compute[73497]:   <name>instance-00000021</name>
Aug 26 23:27:28 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:27:28 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:27:28 user nova-compute[73497]:   <metadata>
Aug 26 23:27:28 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:27:28 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:27:28 user nova-compute[73497]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-493508388</nova:name>
Aug 26 23:27:28 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:27:28</nova:creationTime>
Aug 26 23:27:28 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:27:28 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:27:28 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:27:28 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:27:28 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:27:28 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:27:28 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:27:28 user nova-compute[73497]:       <nova:owner>
Aug 26 23:27:28 user nova-compute[73497]:         <nova:user uuid="af64aa253eec41a0976c3e527fe41831">tempest-ServerRescueNegativeTestJSON-1946187856-project-member</nova:user>
Aug 26 23:27:28 user nova-compute[73497]:         <nova:project uuid="0c4ca787dd33440d98779668507369ee">tempest-ServerRescueNegativeTestJSON-1946187856</nova:project>
Aug 26 23:27:28 user nova-compute[73497]:       </nova:owner>
Aug 26 23:27:28 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:27:28 user nova-compute[73497]:       <nova:ports>
Aug 26 23:27:28 user nova-compute[73497]:         <nova:port uuid="8d982123-d2ef-4d00-95d1-bee24f228175">
Aug 26 23:27:28 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 23:27:28 user nova-compute[73497]:         </nova:port>
Aug 26 23:27:28 user nova-compute[73497]:       </nova:ports>
Aug 26 23:27:28 user nova-compute[73497]:     </nova:instance>
Aug 26 23:27:28 user nova-compute[73497]:   </metadata>
Aug 26 23:27:28 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:27:28 user nova-compute[73497]:     <system>
Aug 26 23:27:28 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:27:28 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:27:28 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:27:28 user nova-compute[73497]:       <entry name="serial">e15ddee6-a642-4638-9534-21e640b3d017</entry>
Aug 26 23:27:28 user nova-compute[73497]:       <entry name="uuid">e15ddee6-a642-4638-9534-21e640b3d017</entry>
Aug 26 23:27:28 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:27:28 user nova-compute[73497]:     </system>
Aug 26 23:27:28 user nova-compute[73497]:   </sysinfo>
Aug 26 23:27:28 user nova-compute[73497]:   <os>
Aug 26 23:27:28 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:27:28 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:27:28 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:27:28 user nova-compute[73497]:   </os>
Aug 26 23:27:28 user nova-compute[73497]:   <features>
Aug 26 23:27:28 user nova-compute[73497]:     <acpi/>
Aug 26 23:27:28 user nova-compute[73497]:     <apic/>
Aug 26 23:27:28 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:27:28 user nova-compute[73497]:   </features>
Aug 26 23:27:28 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:27:28 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:27:28 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:27:28 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:27:28 user nova-compute[73497]:   </clock>
Aug 26 23:27:28 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:27:28 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:27:28 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:27:28 user nova-compute[73497]:   </cpu>
Aug 26 23:27:28 user nova-compute[73497]:   <devices>
Aug 26 23:27:28 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:27:28 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:27:28 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk"/>
Aug 26 23:27:28 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:27:28 user nova-compute[73497]:     </disk>
Aug 26 23:27:28 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:27:28 user nova-compute[73497]:       <mac address="fa:16:3e:e8:ce:24"/>
Aug 26 23:27:28 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:27:28 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:27:28 user nova-compute[73497]:       <target dev="tap8d982123-d2"/>
Aug 26 23:27:28 user nova-compute[73497]:     </interface>
Aug 26 23:27:28 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:27:28 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/console.log" append="off"/>
Aug 26 23:27:28 user nova-compute[73497]:     </serial>
Aug 26 23:27:28 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:27:28 user nova-compute[73497]:     <video>
Aug 26 23:27:28 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:27:28 user nova-compute[73497]:     </video>
Aug 26 23:27:28 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:27:28 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:27:28 user nova-compute[73497]:     </rng>
Aug 26 23:27:28 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:27:28 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:27:28 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:27:28 user nova-compute[73497]:     </memballoon>
Aug 26 23:27:28 user nova-compute[73497]:   </devices>
Aug 26 23:27:28 user nova-compute[73497]: </domain>
Aug 26 23:27:28 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:27:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-493508388',display_name='tempest-ServerRescueNegativeTestJSON-server-493508388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-493508388',id=33,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINj3seD7LQAkaX0wYOG1fS3idoL99uw4+1lVHlG8bZ0rOjqkGpGnEUfwVCpDQwjz4kP4hFSLF4r/El5/40r8+otqhjInnqtJnBnHrwpLdvAuBQM4cvraqsvSlrODkbriA==',key_name='tempest-keypair-198397446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c4ca787dd33440d98779668507369ee',ramdisk_id='',reservation_id='r-on4mu606',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1946187856',owner_user_name='tempest-ServerRescueNegativeTestJSON-1946187856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:27:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='af64aa253eec41a0976c3e527fe41831',uuid=e15ddee6-a642-4638-9534-21e640b3d017,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d982123-d2ef-4d00-95d1-bee24f228175", "address": "fa:16:3e:e8:ce:24", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d982123-d2", "ovs_interfaceid": "8d982123-d2ef-4d00-95d1-bee24f228175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Converting VIF {"id": "8d982123-d2ef-4d00-95d1-bee24f228175", "address": "fa:16:3e:e8:ce:24", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d982123-d2", "ovs_interfaceid": "8d982123-d2ef-4d00-95d1-bee24f228175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ce:24,bridge_name='br-int',has_traffic_filtering=True,id=8d982123-d2ef-4d00-95d1-bee24f228175,network=Network(6f13f07f-104d-4d8d-b5fa-afa402402a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d982123-d2') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG os_vif [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ce:24,bridge_name='br-int',has_traffic_filtering=True,id=8d982123-d2ef-4d00-95d1-bee24f228175,network=Network(6f13f07f-104d-4d8d-b5fa-afa402402a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d982123-d2') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d982123-d2, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8d982123-d2, col_values=(('external_ids', {'iface-id': '8d982123-d2ef-4d00-95d1-bee24f228175', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:ce:24', 'vm-uuid': 'e15ddee6-a642-4638-9534-21e640b3d017'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:28 user nova-compute[73497]: INFO os_vif [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ce:24,bridge_name='br-int',has_traffic_filtering=True,id=8d982123-d2ef-4d00-95d1-bee24f228175,network=Network(6f13f07f-104d-4d8d-b5fa-afa402402a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d982123-d2')
Aug 26 23:27:28 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:27:28 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] No VIF found with MAC fa:16:3e:e8:ce:24, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:27:29 user nova-compute[73497]: DEBUG nova.network.neutron [req-3a179641-8751-434c-ae71-62372bed36c9 req-0abadb0d-8a60-4da1-9767-49b0764ea000 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Updated VIF entry in instance network info cache for port 8d982123-d2ef-4d00-95d1-bee24f228175. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:27:29 user nova-compute[73497]: DEBUG nova.network.neutron [req-3a179641-8751-434c-ae71-62372bed36c9 req-0abadb0d-8a60-4da1-9767-49b0764ea000 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Updating instance_info_cache with network_info: [{"id": "8d982123-d2ef-4d00-95d1-bee24f228175", "address": "fa:16:3e:e8:ce:24", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d982123-d2", "ovs_interfaceid": "8d982123-d2ef-4d00-95d1-bee24f228175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:27:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3a179641-8751-434c-ae71-62372bed36c9 req-0abadb0d-8a60-4da1-9767-49b0764ea000 service nova] Releasing lock "refresh_cache-e15ddee6-a642-4638-9534-21e640b3d017" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:27:30 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:30 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:30 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:30 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:30 user nova-compute[73497]: DEBUG nova.compute.manager [req-3feadd65-da4f-4570-823a-bced41d21b2f req-6400dc1d-6a67-4d58-8d2e-2143327fc86b service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Received event network-vif-plugged-8d982123-d2ef-4d00-95d1-bee24f228175 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:27:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3feadd65-da4f-4570-823a-bced41d21b2f req-6400dc1d-6a67-4d58-8d2e-2143327fc86b service nova] Acquiring lock "e15ddee6-a642-4638-9534-21e640b3d017-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:27:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3feadd65-da4f-4570-823a-bced41d21b2f req-6400dc1d-6a67-4d58-8d2e-2143327fc86b service nova] Lock "e15ddee6-a642-4638-9534-21e640b3d017-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:27:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3feadd65-da4f-4570-823a-bced41d21b2f req-6400dc1d-6a67-4d58-8d2e-2143327fc86b service nova] Lock "e15ddee6-a642-4638-9534-21e640b3d017-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:27:30 user nova-compute[73497]: DEBUG nova.compute.manager [req-3feadd65-da4f-4570-823a-bced41d21b2f req-6400dc1d-6a67-4d58-8d2e-2143327fc86b service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] No waiting events found dispatching network-vif-plugged-8d982123-d2ef-4d00-95d1-bee24f228175 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:27:30 user nova-compute[73497]: WARNING nova.compute.manager [req-3feadd65-da4f-4570-823a-bced41d21b2f req-6400dc1d-6a67-4d58-8d2e-2143327fc86b service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Received unexpected event network-vif-plugged-8d982123-d2ef-4d00-95d1-bee24f228175 for instance with vm_state building and task_state spawning.
Aug 26 23:27:30 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:30 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:32 user nova-compute[73497]: DEBUG nova.compute.manager [req-a3ccd798-6b00-41ff-a9e8-1f3885fe0170 req-d3cc44c4-d4e0-43dc-96bd-3c480b9f0d87 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Received event network-vif-plugged-8d982123-d2ef-4d00-95d1-bee24f228175 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:27:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a3ccd798-6b00-41ff-a9e8-1f3885fe0170 req-d3cc44c4-d4e0-43dc-96bd-3c480b9f0d87 service nova] Acquiring lock "e15ddee6-a642-4638-9534-21e640b3d017-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:27:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a3ccd798-6b00-41ff-a9e8-1f3885fe0170 req-d3cc44c4-d4e0-43dc-96bd-3c480b9f0d87 service nova] Lock "e15ddee6-a642-4638-9534-21e640b3d017-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:27:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a3ccd798-6b00-41ff-a9e8-1f3885fe0170 req-d3cc44c4-d4e0-43dc-96bd-3c480b9f0d87 service nova] Lock "e15ddee6-a642-4638-9534-21e640b3d017-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:27:32 user nova-compute[73497]: DEBUG nova.compute.manager [req-a3ccd798-6b00-41ff-a9e8-1f3885fe0170 req-d3cc44c4-d4e0-43dc-96bd-3c480b9f0d87 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] No waiting events found dispatching network-vif-plugged-8d982123-d2ef-4d00-95d1-bee24f228175 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:27:32 user nova-compute[73497]: WARNING nova.compute.manager [req-a3ccd798-6b00-41ff-a9e8-1f3885fe0170 req-d3cc44c4-d4e0-43dc-96bd-3c480b9f0d87 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Received unexpected event network-vif-plugged-8d982123-d2ef-4d00-95d1-bee24f228175 for instance with vm_state building and task_state spawning.
Aug 26 23:27:32 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092452.8170574, e15ddee6-a642-4638-9534-21e640b3d017 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:27:32 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e15ddee6-a642-4638-9534-21e640b3d017] VM Resumed (Lifecycle Event)
Aug 26 23:27:32 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:27:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:27:32 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Instance spawned successfully.
Aug 26 23:27:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:27:32 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:27:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:27:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:27:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:27:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:27:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:27:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:27:32 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:27:32 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e15ddee6-a642-4638-9534-21e640b3d017] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:27:32 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092452.8186543, e15ddee6-a642-4638-9534-21e640b3d017 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:27:32 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e15ddee6-a642-4638-9534-21e640b3d017] VM Started (Lifecycle Event)
Aug 26 23:27:32 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:27:32 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:27:32 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e15ddee6-a642-4638-9534-21e640b3d017] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:27:32 user nova-compute[73497]: INFO nova.compute.manager [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Took 6.30 seconds to spawn the instance on the hypervisor.
Aug 26 23:27:32 user nova-compute[73497]: DEBUG nova.compute.manager [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:27:33 user nova-compute[73497]: INFO nova.compute.manager [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Took 7.22 seconds to build instance.
Aug 26 23:27:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4040df5f-34db-492e-a7c8-7db7632a6132 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "e15ddee6-a642-4638-9534-21e640b3d017" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.334s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:27:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-95908c26-9d41-48e0-9718-a6d619cd0b36 req-3935d43e-462c-4316-aa8c-851f5c5ab7a1 service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Received event network-changed-74cddf0f-c302-4ae4-8142-cee5764c7c4f {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:27:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-95908c26-9d41-48e0-9718-a6d619cd0b36 req-3935d43e-462c-4316-aa8c-851f5c5ab7a1 service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Refreshing instance network info cache due to event network-changed-74cddf0f-c302-4ae4-8142-cee5764c7c4f. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:27:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-95908c26-9d41-48e0-9718-a6d619cd0b36 req-3935d43e-462c-4316-aa8c-851f5c5ab7a1 service nova] Acquiring lock "refresh_cache-f7c83073-fadc-4e41-a4a9-df0bbe11aa28" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:27:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-95908c26-9d41-48e0-9718-a6d619cd0b36 req-3935d43e-462c-4316-aa8c-851f5c5ab7a1 service nova] Acquired lock "refresh_cache-f7c83073-fadc-4e41-a4a9-df0bbe11aa28" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:27:33 user nova-compute[73497]: DEBUG nova.network.neutron [req-95908c26-9d41-48e0-9718-a6d619cd0b36 req-3935d43e-462c-4316-aa8c-851f5c5ab7a1 service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Refreshing network info cache for port 74cddf0f-c302-4ae4-8142-cee5764c7c4f {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:27:33 user nova-compute[73497]: DEBUG nova.network.neutron [req-95908c26-9d41-48e0-9718-a6d619cd0b36 req-3935d43e-462c-4316-aa8c-851f5c5ab7a1 service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Updated VIF entry in instance network info cache for port 74cddf0f-c302-4ae4-8142-cee5764c7c4f. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:27:33 user nova-compute[73497]: DEBUG nova.network.neutron [req-95908c26-9d41-48e0-9718-a6d619cd0b36 req-3935d43e-462c-4316-aa8c-851f5c5ab7a1 service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Updating instance_info_cache with network_info: [{"id": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "address": "fa:16:3e:cf:bd:9e", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74cddf0f-c3", "ovs_interfaceid": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:27:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-95908c26-9d41-48e0-9718-a6d619cd0b36 req-3935d43e-462c-4316-aa8c-851f5c5ab7a1 service nova] Releasing lock "refresh_cache-f7c83073-fadc-4e41-a4a9-df0bbe11aa28" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:27:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:27:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:27:38 user nova-compute[73497]: DEBUG nova.objects.instance [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lazy-loading 'flavor' on Instance uuid f7c83073-fadc-4e41-a4a9-df0bbe11aa28 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:27:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:27:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:27:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:27:38 user nova-compute[73497]: INFO nova.compute.manager [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Attaching volume 12c35c25-ba0c-408b-b188-7fc38a5c9177 to /dev/vdb
Aug 26 23:27:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:38 user nova-compute[73497]: DEBUG os_brick.utils [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:27:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:38 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98d7faf-46a6-4712-8221-32ab0158aeae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:38 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c525cbcf-fea8-45ad-b5c8-92199a854b85]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:38 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6526774-f722-4524-8583-ef7ba93449c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:38 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9fdd90-500d-41bd-af3d-5719b61a7937]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:27:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:27:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:39 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:27:39 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:27:39 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebcf105-a865-4674-be06-b3b770f5eff6]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:27:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:27:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:27:39 user nova-compute[73497]: DEBUG os_brick.utils [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:27:39 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Updating existing volume attachment record: a1c188e9-159d-4e95-afe7-1b13f4100169 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:27:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:48 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:27:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YGgkMVsT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:27:51 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:27:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:27:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:27:51 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:27:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:27:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:27:51 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:27:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:51 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64ae22a-4377-4669-ac0e-b9d80d193395]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:27:51 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:27:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:51 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c614d05-c539-4174-8700-5583b8779351]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177] added
Aug 26 23:27:51 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:27:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:51 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9d5859-a5a5-4430-af6c-0b04d28d70b4]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:27:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:51 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[514ab830-a9e6-40f2-8ab8-80fb6801015c]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:27:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YGgkMVsT {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YGgkMVsT" returned: 0 in 0.031s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:51 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ab3435-eea9-4636-8df1-fd45b5216429]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YGgkMVsT'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:27:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:51 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d32040-6dfc-45d7-ba28-537d2530fb41]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:27:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:52 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e82c30-aae8-4c5e-b3de-78a50bf26214]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:27:52 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:27:52 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:27:52 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:27:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:27:52 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:27:52 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:27:52 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:27:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:52 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2007ca91-2a6a-4500-8c1f-7c1a8c2d6f09]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177, portal: 172.16.0.220,3260]
Aug 26 23:27:52 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177, portal: 172.16.0.220,3260] successful.
Aug 26 23:27:52 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:27:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:52 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b49ddca-54ac-4dc7-8712-af43a059d90e]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:27:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:52 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[646d5f44-ab21-4da0-8e54-409fc887271d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:27:52 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:27:52 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:27:52 user nova-compute[73497]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)
Aug 26 23:27:52 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:27:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:27:52 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:27:52 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:27:52 user nova-compute[73497]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)
Aug 26 23:27:52 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:27:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:27:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:27:52 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:27:52 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:27:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:52 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[862ba3db-aab7-44cb-9dfb-efdd83241362]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:27:52 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:27:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YGgkMVsT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:27:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:27:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23261646161333233', 'path': '/dev/sde'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:27:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261646161333233', 'path': '/dev/sde'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:27:53 user nova-compute[73497]: DEBUG nova.objects.instance [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lazy-loading 'flavor' on Instance uuid f7c83073-fadc-4e41-a4a9-df0bbe11aa28 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:27:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 23:27:53 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:27:53 user nova-compute[73497]:   <source dev="/dev/sde"/>
Aug 26 23:27:53 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:27:53 user nova-compute[73497]:   <serial>12c35c25-ba0c-408b-b188-7fc38a5c9177</serial>
Aug 26 23:27:53 user nova-compute[73497]: </disk>
Aug 26 23:27:53 user nova-compute[73497]:  {{(pid=73497) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 23:27:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:27:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:27:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] No VIF found with MAC fa:16:3e:cf:bd:9e, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:27:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b8c1a418-ba1a-4221-b74e-c2fd3f1944d1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.015s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:27:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d6b244e2-272e-4a85-9d64-927999d73815 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:27:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d6b244e2-272e-4a85-9d64-927999d73815 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:27:54 user nova-compute[73497]: DEBUG nova.compute.manager [None req-d6b244e2-272e-4a85-9d64-927999d73815 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:27:54 user nova-compute[73497]: DEBUG nova.compute.manager [None req-d6b244e2-272e-4a85-9d64-927999d73815 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73497) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 26 23:27:54 user nova-compute[73497]: DEBUG nova.objects.instance [None req-d6b244e2-272e-4a85-9d64-927999d73815 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lazy-loading 'flavor' on Instance uuid f7c83073-fadc-4e41-a4a9-df0bbe11aa28 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:27:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:54 user nova-compute[73497]: DEBUG nova.compute.manager [req-ae77f792-93a4-4202-962f-25cfb43d83ab req-73e3f300-4552-4da1-80e6-95d97c103343 service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Received event network-vif-unplugged-74cddf0f-c302-4ae4-8142-cee5764c7c4f {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:27:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ae77f792-93a4-4202-962f-25cfb43d83ab req-73e3f300-4552-4da1-80e6-95d97c103343 service nova] Acquiring lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:27:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ae77f792-93a4-4202-962f-25cfb43d83ab req-73e3f300-4552-4da1-80e6-95d97c103343 service nova] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:27:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ae77f792-93a4-4202-962f-25cfb43d83ab req-73e3f300-4552-4da1-80e6-95d97c103343 service nova] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:27:54 user nova-compute[73497]: DEBUG nova.compute.manager [req-ae77f792-93a4-4202-962f-25cfb43d83ab req-73e3f300-4552-4da1-80e6-95d97c103343 service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] No waiting events found dispatching network-vif-unplugged-74cddf0f-c302-4ae4-8142-cee5764c7c4f {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:27:54 user nova-compute[73497]: WARNING nova.compute.manager [req-ae77f792-93a4-4202-962f-25cfb43d83ab req-73e3f300-4552-4da1-80e6-95d97c103343 service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Received unexpected event network-vif-unplugged-74cddf0f-c302-4ae4-8142-cee5764c7c4f for instance with vm_state active and task_state powering-off.
Aug 26 23:27:55 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Instance destroyed successfully.
Aug 26 23:27:55 user nova-compute[73497]: DEBUG nova.compute.manager [None req-d6b244e2-272e-4a85-9d64-927999d73815 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:27:55 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:27:55 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:27:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d6b244e2-272e-4a85-9d64-927999d73815 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.970s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:27:56 user nova-compute[73497]: DEBUG nova.compute.manager [req-3b610754-f023-4ab9-8695-c952b440c711 req-bb2debce-4ec4-4748-ad88-00e2e8c4aa87 service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Received event network-vif-plugged-74cddf0f-c302-4ae4-8142-cee5764c7c4f {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:27:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3b610754-f023-4ab9-8695-c952b440c711 req-bb2debce-4ec4-4748-ad88-00e2e8c4aa87 service nova] Acquiring lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:27:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3b610754-f023-4ab9-8695-c952b440c711 req-bb2debce-4ec4-4748-ad88-00e2e8c4aa87 service nova] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:27:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3b610754-f023-4ab9-8695-c952b440c711 req-bb2debce-4ec4-4748-ad88-00e2e8c4aa87 service nova] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:27:56 user nova-compute[73497]: DEBUG nova.compute.manager [req-3b610754-f023-4ab9-8695-c952b440c711 req-bb2debce-4ec4-4748-ad88-00e2e8c4aa87 service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] No waiting events found dispatching network-vif-plugged-74cddf0f-c302-4ae4-8142-cee5764c7c4f {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:27:56 user nova-compute[73497]: WARNING nova.compute.manager [req-3b610754-f023-4ab9-8695-c952b440c711 req-bb2debce-4ec4-4748-ad88-00e2e8c4aa87 service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Received unexpected event network-vif-plugged-74cddf0f-c302-4ae4-8142-cee5764c7c4f for instance with vm_state stopped and task_state None.
Aug 26 23:27:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:57 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:27:58 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:58 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:27:59 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:27:59 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:27:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:27:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:27:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:27:59 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:27:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:27:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:27:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:28:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:28:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:28:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:28:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:28:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:28:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:28:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:28:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:28:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:28:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:28:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:28:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:28:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:28:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:28:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:28:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:28:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:28:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:28:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:28:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:28:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f6eb6e-272f-4b1e-b1d5-40769bf07165/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:28:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f6eb6e-272f-4b1e-b1d5-40769bf07165/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:28:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f6eb6e-272f-4b1e-b1d5-40769bf07165/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:28:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f6eb6e-272f-4b1e-b1d5-40769bf07165/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:28:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:28:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:28:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:28:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:28:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:28:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:28:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:28:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:28:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:28:03 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:28:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:28:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:28:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:28:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:28:03 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:28:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed2c58fe-8d24-47ed-b5da-62e44e290901/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:28:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed2c58fe-8d24-47ed-b5da-62e44e290901/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:28:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed2c58fe-8d24-47ed-b5da-62e44e290901/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:28:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed2c58fe-8d24-47ed-b5da-62e44e290901/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:28:04 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:28:04 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:28:04 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=7087MB free_disk=24.97787857055664GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:28:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:28:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:28:05 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Applying migration context for instance 40afa348-8391-4643-977c-e67eab5c9476 as it has an incoming, in-progress migration 1a7b5b2a-d801-44eb-b24c-990f5ddcbb0a. Migration status is finished {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 23:28:05 user nova-compute[73497]: INFO nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Updating resource usage from migration 1a7b5b2a-d801-44eb-b24c-990f5ddcbb0a
Aug 26 23:28:05 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 994093f0-e6b2-4c96-b259-c559ef2b1fbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:28:05 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 171985a3-358d-4b26-a66c-372b9b99b386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:28:05 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance aebaeda6-23d1-43a1-afc8-bdc8992067e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:28:05 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 043294e5-0618-4a31-bb19-1227ef1f5d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:28:05 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance e9e5c83f-0678-48d4-a81f-1a3f959aabcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:28:05 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance c601f97e-9e52-40c6-9085-45f38e709721 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:28:05 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:28:05 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 93f6eb6e-272f-4b1e-b1d5-40769bf07165 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:28:05 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance f7c83073-fadc-4e41-a4a9-df0bbe11aa28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:28:05 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Migration 1a7b5b2a-d801-44eb-b24c-990f5ddcbb0a is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 23:28:05 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 40afa348-8391-4643-977c-e67eab5c9476 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:28:05 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance ed2c58fe-8d24-47ed-b5da-62e44e290901 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:28:05 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance e15ddee6-a642-4638-9534-21e640b3d017 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:28:05 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:28:05 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:28:05 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:28:05 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:28:05 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:28:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.707s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:28:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:06 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:28:06 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:28:06 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:28:06 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Rebuilding the list of instances to heal {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 23:28:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-994093f0-e6b2-4c96-b259-c559ef2b1fbc" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:28:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-994093f0-e6b2-4c96-b259-c559ef2b1fbc" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:28:07 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:28:07 user nova-compute[73497]: DEBUG nova.objects.instance [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lazy-loading 'info_cache' on Instance uuid 994093f0-e6b2-4c96-b259-c559ef2b1fbc {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:28:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:07 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Updating instance_info_cache with network_info: [{"id": "9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2", "address": "fa:16:3e:b8:5f:1d", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b0aca2b-85", "ovs_interfaceid": "9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:28:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-994093f0-e6b2-4c96-b259-c559ef2b1fbc" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:28:07 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:28:07 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:28:07 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:28:07 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:28:08 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:10 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693092475.1344428, f7c83073-fadc-4e41-a4a9-df0bbe11aa28 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:28:10 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] VM Stopped (Lifecycle Event)
Aug 26 23:28:10 user nova-compute[73497]: DEBUG nova.compute.manager [None req-3e1e0622-b5e8-4115-b821-54bf175e0fba None None] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:28:10 user nova-compute[73497]: DEBUG nova.compute.manager [None req-3e1e0622-b5e8-4115-b821-54bf175e0fba None None] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:28:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:12 user nova-compute[73497]: INFO nova.compute.manager [None req-022fec64-a58f-4abc-8a11-3a3e1eb2cd80 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Unrescuing
Aug 26 23:28:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-022fec64-a58f-4abc-8a11-3a3e1eb2cd80 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "refresh_cache-c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:28:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-022fec64-a58f-4abc-8a11-3a3e1eb2cd80 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquired lock "refresh_cache-c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:28:12 user nova-compute[73497]: DEBUG nova.network.neutron [None req-022fec64-a58f-4abc-8a11-3a3e1eb2cd80 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:28:12 user nova-compute[73497]: DEBUG nova.network.neutron [None req-022fec64-a58f-4abc-8a11-3a3e1eb2cd80 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Updating instance_info_cache with network_info: [{"id": "a45f0c9b-48cc-4434-90c9-875c52f402d0", "address": "fa:16:3e:87:b8:93", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa45f0c9b-48", "ovs_interfaceid": "a45f0c9b-48cc-4434-90c9-875c52f402d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:28:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-022fec64-a58f-4abc-8a11-3a3e1eb2cd80 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Releasing lock "refresh_cache-c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:28:12 user nova-compute[73497]: DEBUG nova.objects.instance [None req-022fec64-a58f-4abc-8a11-3a3e1eb2cd80 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lazy-loading 'flavor' on Instance uuid c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:28:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e8e68e8c-424c-48f9-9600-66f850eb0e1f tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "93f6eb6e-272f-4b1e-b1d5-40769bf07165" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:28:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e8e68e8c-424c-48f9-9600-66f850eb0e1f tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "93f6eb6e-272f-4b1e-b1d5-40769bf07165" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:28:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e8e68e8c-424c-48f9-9600-66f850eb0e1f tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "93f6eb6e-272f-4b1e-b1d5-40769bf07165-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:28:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e8e68e8c-424c-48f9-9600-66f850eb0e1f tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "93f6eb6e-272f-4b1e-b1d5-40769bf07165-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:28:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e8e68e8c-424c-48f9-9600-66f850eb0e1f tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "93f6eb6e-272f-4b1e-b1d5-40769bf07165-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:28:13 user nova-compute[73497]: INFO nova.compute.manager [None req-e8e68e8c-424c-48f9-9600-66f850eb0e1f tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Terminating instance
Aug 26 23:28:13 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e8e68e8c-424c-48f9-9600-66f850eb0e1f tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:28:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:13 user nova-compute[73497]: DEBUG nova.compute.manager [req-fbb0b591-4d98-4efd-9502-566e5d24d623 req-42594f72-48b5-4495-8915-a4967b486ec6 service nova] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Received event network-vif-unplugged-c922af50-fef8-4a98-8642-f6a4df1fae6c {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:28:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-fbb0b591-4d98-4efd-9502-566e5d24d623 req-42594f72-48b5-4495-8915-a4967b486ec6 service nova] Acquiring lock "93f6eb6e-272f-4b1e-b1d5-40769bf07165-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:28:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-fbb0b591-4d98-4efd-9502-566e5d24d623 req-42594f72-48b5-4495-8915-a4967b486ec6 service nova] Lock "93f6eb6e-272f-4b1e-b1d5-40769bf07165-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:28:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-fbb0b591-4d98-4efd-9502-566e5d24d623 req-42594f72-48b5-4495-8915-a4967b486ec6 service nova] Lock "93f6eb6e-272f-4b1e-b1d5-40769bf07165-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:28:13 user nova-compute[73497]: DEBUG nova.compute.manager [req-fbb0b591-4d98-4efd-9502-566e5d24d623 req-42594f72-48b5-4495-8915-a4967b486ec6 service nova] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] No waiting events found dispatching network-vif-unplugged-c922af50-fef8-4a98-8642-f6a4df1fae6c {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:28:13 user nova-compute[73497]: DEBUG nova.compute.manager [req-fbb0b591-4d98-4efd-9502-566e5d24d623 req-42594f72-48b5-4495-8915-a4967b486ec6 service nova] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Received event network-vif-unplugged-c922af50-fef8-4a98-8642-f6a4df1fae6c for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:28:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:28:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:28:14 user nova-compute[73497]: DEBUG nova.compute.manager [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:28:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:28:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:28:14 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:28:14 user nova-compute[73497]: INFO nova.compute.claims [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Claim successful on node user
Aug 26 23:28:14 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Instance destroyed successfully.
Aug 26 23:28:14 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Instance destroyed successfully.
Aug 26 23:28:14 user nova-compute[73497]: DEBUG nova.objects.instance [None req-e8e68e8c-424c-48f9-9600-66f850eb0e1f tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lazy-loading 'resources' on Instance uuid 93f6eb6e-272f-4b1e-b1d5-40769bf07165 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:28:14 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-e8e68e8c-424c-48f9-9600-66f850eb0e1f tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:25:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-842605694',display_name='tempest-AttachVolumeNegativeTest-server-842605694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-842605694',id=30,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2Zz4WI1YLvvHF9BPHORG6tZi/a8HDTCrZeDvmmRk8SgHrJ1UNTfHsXv26/j91ITHMdIUPZMlB08W/noq3+swSs0M0suoExVI5PLHTPdgGokWqYzDCB5zw6eIgP1uZAvQ==',key_name='tempest-keypair-401471657',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:25:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d784b1d6c31e41d6a03fc377b0be69f5',ramdisk_id='',reservation_id='r-fcjcd0e8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1095215256',owner_user_name='tempest-AttachVolumeNegativeTest-1095215256-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:25:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e38409b92a95475db83540cbc4222466',uuid=93f6eb6e-272f-4b1e-b1d5-40769bf07165,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c922af50-fef8-4a98-8642-f6a4df1fae6c", "address": "fa:16:3e:d9:19:3d", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc922af50-fe", "ovs_interfaceid": "c922af50-fef8-4a98-8642-f6a4df1fae6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:28:14 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e8e68e8c-424c-48f9-9600-66f850eb0e1f tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Converting VIF {"id": "c922af50-fef8-4a98-8642-f6a4df1fae6c", "address": "fa:16:3e:d9:19:3d", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc922af50-fe", "ovs_interfaceid": "c922af50-fef8-4a98-8642-f6a4df1fae6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:28:14 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e8e68e8c-424c-48f9-9600-66f850eb0e1f tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:19:3d,bridge_name='br-int',has_traffic_filtering=True,id=c922af50-fef8-4a98-8642-f6a4df1fae6c,network=Network(7bae9729-050d-4ff3-a842-91d0ec2c08d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc922af50-fe') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:28:14 user nova-compute[73497]: DEBUG os_vif [None req-e8e68e8c-424c-48f9-9600-66f850eb0e1f tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:19:3d,bridge_name='br-int',has_traffic_filtering=True,id=c922af50-fef8-4a98-8642-f6a4df1fae6c,network=Network(7bae9729-050d-4ff3-a842-91d0ec2c08d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc922af50-fe') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:28:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc922af50-fe, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:28:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:28:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:14 user nova-compute[73497]: INFO os_vif [None req-e8e68e8c-424c-48f9-9600-66f850eb0e1f tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:19:3d,bridge_name='br-int',has_traffic_filtering=True,id=c922af50-fef8-4a98-8642-f6a4df1fae6c,network=Network(7bae9729-050d-4ff3-a842-91d0ec2c08d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc922af50-fe')
Aug 26 23:28:14 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-e8e68e8c-424c-48f9-9600-66f850eb0e1f tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Deleting instance files /opt/stack/data/nova/instances/93f6eb6e-272f-4b1e-b1d5-40769bf07165_del
Aug 26 23:28:14 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-e8e68e8c-424c-48f9-9600-66f850eb0e1f tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Deletion of /opt/stack/data/nova/instances/93f6eb6e-272f-4b1e-b1d5-40769bf07165_del complete
Aug 26 23:28:14 user nova-compute[73497]: INFO nova.compute.manager [None req-e8e68e8c-424c-48f9-9600-66f850eb0e1f tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Took 1.26 seconds to destroy the instance on the hypervisor.
Aug 26 23:28:14 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-e8e68e8c-424c-48f9-9600-66f850eb0e1f tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:28:14 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:28:14 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:28:14 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:28:14 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:28:14 user nova-compute[73497]: DEBUG nova.compute.manager [req-49f78c28-bf0d-4e15-8c79-734f08c291d5 req-bf4e7774-e079-445e-8d38-c21962cad04b service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Received event network-vif-unplugged-a45f0c9b-48cc-4434-90c9-875c52f402d0 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:28:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-49f78c28-bf0d-4e15-8c79-734f08c291d5 req-bf4e7774-e079-445e-8d38-c21962cad04b service nova] Acquiring lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:28:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-49f78c28-bf0d-4e15-8c79-734f08c291d5 req-bf4e7774-e079-445e-8d38-c21962cad04b service nova] Lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:28:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-49f78c28-bf0d-4e15-8c79-734f08c291d5 req-bf4e7774-e079-445e-8d38-c21962cad04b service nova] Lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:28:14 user nova-compute[73497]: DEBUG nova.compute.manager [req-49f78c28-bf0d-4e15-8c79-734f08c291d5 req-bf4e7774-e079-445e-8d38-c21962cad04b service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] No waiting events found dispatching network-vif-unplugged-a45f0c9b-48cc-4434-90c9-875c52f402d0 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:28:14 user nova-compute[73497]: WARNING nova.compute.manager [req-49f78c28-bf0d-4e15-8c79-734f08c291d5 req-bf4e7774-e079-445e-8d38-c21962cad04b service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Received unexpected event network-vif-unplugged-a45f0c9b-48cc-4434-90c9-875c52f402d0 for instance with vm_state rescued and task_state unrescuing.
Aug 26 23:28:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.736s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:28:14 user nova-compute[73497]: DEBUG nova.compute.manager [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:28:14 user nova-compute[73497]: DEBUG nova.compute.manager [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:28:14 user nova-compute[73497]: DEBUG nova.network.neutron [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:28:14 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:28:14 user nova-compute[73497]: DEBUG nova.compute.manager [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:28:15 user nova-compute[73497]: DEBUG nova.policy [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '948c44e55c7c404fb660394a747cf162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae441ca35d847e89eb99397fe167960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:28:15 user nova-compute[73497]: DEBUG nova.compute.manager [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:28:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:28:15 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Creating image(s)
Aug 26 23:28:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "/opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:28:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "/opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:28:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "/opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:28:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "d10355a36084f1abecfd1941abf367c9cbe44fa7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:28:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "d10355a36084f1abecfd1941abf367c9cbe44fa7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:28:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d10355a36084f1abecfd1941abf367c9cbe44fa7.part --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:28:15 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:28:15 user nova-compute[73497]: DEBUG nova.compute.manager [req-aed3c73f-156f-4721-bbf6-756cdae495ea req-b09b606c-7d93-47ce-ac9f-555ef533e92b service nova] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Received event network-vif-plugged-c922af50-fef8-4a98-8642-f6a4df1fae6c {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:28:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-aed3c73f-156f-4721-bbf6-756cdae495ea req-b09b606c-7d93-47ce-ac9f-555ef533e92b service nova] Acquiring lock "93f6eb6e-272f-4b1e-b1d5-40769bf07165-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:28:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-aed3c73f-156f-4721-bbf6-756cdae495ea req-b09b606c-7d93-47ce-ac9f-555ef533e92b service nova] Lock "93f6eb6e-272f-4b1e-b1d5-40769bf07165-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:28:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-aed3c73f-156f-4721-bbf6-756cdae495ea req-b09b606c-7d93-47ce-ac9f-555ef533e92b service nova] Lock "93f6eb6e-272f-4b1e-b1d5-40769bf07165-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:28:15 user nova-compute[73497]: DEBUG nova.compute.manager [req-aed3c73f-156f-4721-bbf6-756cdae495ea req-b09b606c-7d93-47ce-ac9f-555ef533e92b service nova] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] No waiting events found dispatching network-vif-plugged-c922af50-fef8-4a98-8642-f6a4df1fae6c {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:28:15 user nova-compute[73497]: WARNING nova.compute.manager [req-aed3c73f-156f-4721-bbf6-756cdae495ea req-b09b606c-7d93-47ce-ac9f-555ef533e92b service nova] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Received unexpected event network-vif-plugged-c922af50-fef8-4a98-8642-f6a4df1fae6c for instance with vm_state active and task_state deleting.
Aug 26 23:28:15 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Took 1.21 seconds to deallocate network for instance.
Aug 26 23:28:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d10355a36084f1abecfd1941abf367c9cbe44fa7.part --force-share --output=json" returned: 0 in 0.288s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:28:15 user nova-compute[73497]: DEBUG nova.virt.images [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] 4953616c-6ab8-44e7-9644-490160ff0ba9 was qcow2, converting to raw {{(pid=73497) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 23:28:16 user nova-compute[73497]: DEBUG nova.privsep.utils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73497) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 23:28:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d10355a36084f1abecfd1941abf367c9cbe44fa7.part /opt/stack/data/nova/instances/_base/d10355a36084f1abecfd1941abf367c9cbe44fa7.converted {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:28:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:16 user nova-compute[73497]: DEBUG nova.network.neutron [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Successfully created port: 9993c7ac-e4a2-41c8-97d9-75c681d68a6a {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:28:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e8e68e8c-424c-48f9-9600-66f850eb0e1f tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:28:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e8e68e8c-424c-48f9-9600-66f850eb0e1f tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:28:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d10355a36084f1abecfd1941abf367c9cbe44fa7.part /opt/stack/data/nova/instances/_base/d10355a36084f1abecfd1941abf367c9cbe44fa7.converted" returned: 0 in 0.450s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:28:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d10355a36084f1abecfd1941abf367c9cbe44fa7.converted --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:28:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d10355a36084f1abecfd1941abf367c9cbe44fa7.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:28:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "d10355a36084f1abecfd1941abf367c9cbe44fa7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.483s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:28:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d10355a36084f1abecfd1941abf367c9cbe44fa7 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:28:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d10355a36084f1abecfd1941abf367c9cbe44fa7 --force-share --output=json" returned: 0 in 0.193s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:28:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "d10355a36084f1abecfd1941abf367c9cbe44fa7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:28:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "d10355a36084f1abecfd1941abf367c9cbe44fa7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:28:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d10355a36084f1abecfd1941abf367c9cbe44fa7 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:28:16 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-e8e68e8c-424c-48f9-9600-66f850eb0e1f tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:28:16 user nova-compute[73497]: DEBUG nova.compute.manager [req-ec35b7b4-aaaf-4e07-848a-51d07ce758f6 req-f9f74db5-3c55-433c-b12e-4df210d3805b service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Received event network-vif-plugged-a45f0c9b-48cc-4434-90c9-875c52f402d0 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:28:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ec35b7b4-aaaf-4e07-848a-51d07ce758f6 req-f9f74db5-3c55-433c-b12e-4df210d3805b service nova] Acquiring lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:28:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ec35b7b4-aaaf-4e07-848a-51d07ce758f6 req-f9f74db5-3c55-433c-b12e-4df210d3805b service nova] Lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:28:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ec35b7b4-aaaf-4e07-848a-51d07ce758f6 req-f9f74db5-3c55-433c-b12e-4df210d3805b service nova] Lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:28:16 user nova-compute[73497]: DEBUG nova.compute.manager [req-ec35b7b4-aaaf-4e07-848a-51d07ce758f6 req-f9f74db5-3c55-433c-b12e-4df210d3805b service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] No waiting events found dispatching network-vif-plugged-a45f0c9b-48cc-4434-90c9-875c52f402d0 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:28:16 user nova-compute[73497]: WARNING nova.compute.manager [req-ec35b7b4-aaaf-4e07-848a-51d07ce758f6 req-f9f74db5-3c55-433c-b12e-4df210d3805b service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Received unexpected event network-vif-plugged-a45f0c9b-48cc-4434-90c9-875c52f402d0 for instance with vm_state rescued and task_state unrescuing.
Aug 26 23:28:16 user nova-compute[73497]: DEBUG nova.compute.manager [req-ec35b7b4-aaaf-4e07-848a-51d07ce758f6 req-f9f74db5-3c55-433c-b12e-4df210d3805b service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Received event network-vif-plugged-a45f0c9b-48cc-4434-90c9-875c52f402d0 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:28:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ec35b7b4-aaaf-4e07-848a-51d07ce758f6 req-f9f74db5-3c55-433c-b12e-4df210d3805b service nova] Acquiring lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:28:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ec35b7b4-aaaf-4e07-848a-51d07ce758f6 req-f9f74db5-3c55-433c-b12e-4df210d3805b service nova] Lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:28:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ec35b7b4-aaaf-4e07-848a-51d07ce758f6 req-f9f74db5-3c55-433c-b12e-4df210d3805b service nova] Lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:28:16 user nova-compute[73497]: DEBUG nova.compute.manager [req-ec35b7b4-aaaf-4e07-848a-51d07ce758f6 req-f9f74db5-3c55-433c-b12e-4df210d3805b service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] No waiting events found dispatching network-vif-plugged-a45f0c9b-48cc-4434-90c9-875c52f402d0 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:28:16 user nova-compute[73497]: WARNING nova.compute.manager [req-ec35b7b4-aaaf-4e07-848a-51d07ce758f6 req-f9f74db5-3c55-433c-b12e-4df210d3805b service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Received unexpected event network-vif-plugged-a45f0c9b-48cc-4434-90c9-875c52f402d0 for instance with vm_state rescued and task_state unrescuing.
Aug 26 23:28:16 user nova-compute[73497]: DEBUG nova.compute.manager [req-ec35b7b4-aaaf-4e07-848a-51d07ce758f6 req-f9f74db5-3c55-433c-b12e-4df210d3805b service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Received event network-vif-plugged-a45f0c9b-48cc-4434-90c9-875c52f402d0 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:28:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ec35b7b4-aaaf-4e07-848a-51d07ce758f6 req-f9f74db5-3c55-433c-b12e-4df210d3805b service nova] Acquiring lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:28:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ec35b7b4-aaaf-4e07-848a-51d07ce758f6 req-f9f74db5-3c55-433c-b12e-4df210d3805b service nova] Lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:28:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ec35b7b4-aaaf-4e07-848a-51d07ce758f6 req-f9f74db5-3c55-433c-b12e-4df210d3805b service nova] Lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:28:16 user nova-compute[73497]: DEBUG nova.compute.manager [req-ec35b7b4-aaaf-4e07-848a-51d07ce758f6 req-f9f74db5-3c55-433c-b12e-4df210d3805b service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] No waiting events found dispatching network-vif-plugged-a45f0c9b-48cc-4434-90c9-875c52f402d0 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:28:16 user nova-compute[73497]: WARNING nova.compute.manager [req-ec35b7b4-aaaf-4e07-848a-51d07ce758f6 req-f9f74db5-3c55-433c-b12e-4df210d3805b service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Received unexpected event network-vif-plugged-a45f0c9b-48cc-4434-90c9-875c52f402d0 for instance with vm_state rescued and task_state unrescuing.
Aug 26 23:28:16 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-e8e68e8c-424c-48f9-9600-66f850eb0e1f tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:28:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e8e68e8c-424c-48f9-9600-66f850eb0e1f tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.967s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:28:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d10355a36084f1abecfd1941abf367c9cbe44fa7 --force-share --output=json" returned: 0 in 0.227s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:28:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d10355a36084f1abecfd1941abf367c9cbe44fa7,backing_fmt=raw /opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:28:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:17 user nova-compute[73497]: DEBUG nova.network.neutron [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Successfully updated port: 9993c7ac-e4a2-41c8-97d9-75c681d68a6a {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:28:17 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-e8e68e8c-424c-48f9-9600-66f850eb0e1f tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Deleted allocations for instance 93f6eb6e-272f-4b1e-b1d5-40769bf07165
Aug 26 23:28:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d10355a36084f1abecfd1941abf367c9cbe44fa7,backing_fmt=raw /opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/disk 1073741824" returned: 0 in 0.173s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:28:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "d10355a36084f1abecfd1941abf367c9cbe44fa7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.403s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:28:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d10355a36084f1abecfd1941abf367c9cbe44fa7 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:28:17 user nova-compute[73497]: DEBUG nova.compute.manager [req-ead1dc5f-ed5b-4220-a11d-fb75819c105b req-309b6e20-d8c2-42bb-9d27-c579798b5455 service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Received event network-changed-9993c7ac-e4a2-41c8-97d9-75c681d68a6a {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:28:17 user nova-compute[73497]: DEBUG nova.compute.manager [req-ead1dc5f-ed5b-4220-a11d-fb75819c105b req-309b6e20-d8c2-42bb-9d27-c579798b5455 service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Refreshing instance network info cache due to event network-changed-9993c7ac-e4a2-41c8-97d9-75c681d68a6a. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:28:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ead1dc5f-ed5b-4220-a11d-fb75819c105b req-309b6e20-d8c2-42bb-9d27-c579798b5455 service nova] Acquiring lock "refresh_cache-b7506745-ace5-45e2-bc1d-883f2c51f1c4" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:28:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ead1dc5f-ed5b-4220-a11d-fb75819c105b req-309b6e20-d8c2-42bb-9d27-c579798b5455 service nova] Acquired lock "refresh_cache-b7506745-ace5-45e2-bc1d-883f2c51f1c4" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:28:17 user nova-compute[73497]: DEBUG nova.network.neutron [req-ead1dc5f-ed5b-4220-a11d-fb75819c105b req-309b6e20-d8c2-42bb-9d27-c579798b5455 service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Refreshing network info cache for port 9993c7ac-e4a2-41c8-97d9-75c681d68a6a {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:28:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "refresh_cache-b7506745-ace5-45e2-bc1d-883f2c51f1c4" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:28:17 user nova-compute[73497]: DEBUG nova.network.neutron [req-ead1dc5f-ed5b-4220-a11d-fb75819c105b req-309b6e20-d8c2-42bb-9d27-c579798b5455 service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:28:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e8e68e8c-424c-48f9-9600-66f850eb0e1f tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "93f6eb6e-272f-4b1e-b1d5-40769bf07165" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.082s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:28:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d10355a36084f1abecfd1941abf367c9cbe44fa7 --force-share --output=json" returned: 0 in 0.178s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:28:17 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:28:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:28:17 user nova-compute[73497]: DEBUG nova.network.neutron [req-ead1dc5f-ed5b-4220-a11d-fb75819c105b req-309b6e20-d8c2-42bb-9d27-c579798b5455 service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:28:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ead1dc5f-ed5b-4220-a11d-fb75819c105b req-309b6e20-d8c2-42bb-9d27-c579798b5455 service nova] Releasing lock "refresh_cache-b7506745-ace5-45e2-bc1d-883f2c51f1c4" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:28:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquired lock "refresh_cache-b7506745-ace5-45e2-bc1d-883f2c51f1c4" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:28:17 user nova-compute[73497]: DEBUG nova.network.neutron [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:28:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:28:17 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Cannot resize image /opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:28:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:28:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Ensure instance console log exists: /opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:28:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:28:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:28:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:28:17 user nova-compute[73497]: DEBUG nova.network.neutron [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:28:17 user nova-compute[73497]: DEBUG nova.compute.manager [req-f88d9446-20ec-4502-aac1-247857fefd93 req-fcfa1766-2bc2-46f7-a5de-a9e3da0c7733 service nova] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Received event network-vif-deleted-c922af50-fef8-4a98-8642-f6a4df1fae6c {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG nova.network.neutron [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Updating instance_info_cache with network_info: [{"id": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "address": "fa:16:3e:7e:a1:4c", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9993c7ac-e4", "ovs_interfaceid": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Releasing lock "refresh_cache-b7506745-ace5-45e2-bc1d-883f2c51f1c4" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG nova.compute.manager [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Instance network_info: |[{"id": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "address": "fa:16:3e:7e:a1:4c", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9993c7ac-e4", "ovs_interfaceid": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Start _get_guest_xml network_info=[{"id": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "address": "fa:16:3e:7e:a1:4c", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9993c7ac-e4", "ovs_interfaceid": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:28:10Z,direct_url=<?>,disk_format='qcow2',id=4953616c-6ab8-44e7-9644-490160ff0ba9,min_disk=0,min_ram=0,name='tempest-scenario-img--868784889',owner='9ae441ca35d847e89eb99397fe167960',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '4953616c-6ab8-44e7-9644-490160ff0ba9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:28:18 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:28:18 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:28:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:28:10Z,direct_url=<?>,disk_format='qcow2',id=4953616c-6ab8-44e7-9644-490160ff0ba9,min_disk=0,min_ram=0,name='tempest-scenario-img--868784889',owner='9ae441ca35d847e89eb99397fe167960',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:28:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1357907004',display_name='tempest-TestMinimumBasicScenario-server-1357907004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1357907004',id=34,image_ref='4953616c-6ab8-44e7-9644-490160ff0ba9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHawhLjVpHObEM1sejmZUdYQSEnONqYB9L2Qv/axMeT5kKxPx9/QuS/i5jErqR53WVLlmHVIBUw7Z4Scv0xP68Y1o8+EymV6cmPgQpjbZL+arFhxVBB0cTzGv9OLKbkK5Q==',key_name='tempest-TestMinimumBasicScenario-1395022215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ae441ca35d847e89eb99397fe167960',ramdisk_id='',reservation_id='r-qslnut47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4953616c-6ab8-44e7-9644-490160ff0ba9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1836970755',owner_user_name='tempest-TestMinimumBasicScenario-1836970755-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:28:15Z,user_data=None,user_id='948c44e55c7c404fb660394a747cf162',uuid=b7506745-ace5-45e2-bc1d-883f2c51f1c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "address": "fa:16:3e:7e:a1:4c", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9993c7ac-e4", "ovs_interfaceid": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Converting VIF {"id": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "address": "fa:16:3e:7e:a1:4c", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9993c7ac-e4", "ovs_interfaceid": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a1:4c,bridge_name='br-int',has_traffic_filtering=True,id=9993c7ac-e4a2-41c8-97d9-75c681d68a6a,network=Network(f11c42be-cba6-4e59-80b1-6fdd90a41c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9993c7ac-e4') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG nova.objects.instance [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lazy-loading 'pci_devices' on Instance uuid b7506745-ace5-45e2-bc1d-883f2c51f1c4 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:28:18 user nova-compute[73497]:   <uuid>b7506745-ace5-45e2-bc1d-883f2c51f1c4</uuid>
Aug 26 23:28:18 user nova-compute[73497]:   <name>instance-00000022</name>
Aug 26 23:28:18 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:28:18 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:28:18 user nova-compute[73497]:   <metadata>
Aug 26 23:28:18 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:28:18 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:28:18 user nova-compute[73497]:       <nova:name>tempest-TestMinimumBasicScenario-server-1357907004</nova:name>
Aug 26 23:28:18 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:28:18</nova:creationTime>
Aug 26 23:28:18 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:28:18 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:28:18 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:28:18 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:28:18 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:28:18 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:28:18 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:28:18 user nova-compute[73497]:       <nova:owner>
Aug 26 23:28:18 user nova-compute[73497]:         <nova:user uuid="948c44e55c7c404fb660394a747cf162">tempest-TestMinimumBasicScenario-1836970755-project-member</nova:user>
Aug 26 23:28:18 user nova-compute[73497]:         <nova:project uuid="9ae441ca35d847e89eb99397fe167960">tempest-TestMinimumBasicScenario-1836970755</nova:project>
Aug 26 23:28:18 user nova-compute[73497]:       </nova:owner>
Aug 26 23:28:18 user nova-compute[73497]:       <nova:root type="image" uuid="4953616c-6ab8-44e7-9644-490160ff0ba9"/>
Aug 26 23:28:18 user nova-compute[73497]:       <nova:ports>
Aug 26 23:28:18 user nova-compute[73497]:         <nova:port uuid="9993c7ac-e4a2-41c8-97d9-75c681d68a6a">
Aug 26 23:28:18 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 23:28:18 user nova-compute[73497]:         </nova:port>
Aug 26 23:28:18 user nova-compute[73497]:       </nova:ports>
Aug 26 23:28:18 user nova-compute[73497]:     </nova:instance>
Aug 26 23:28:18 user nova-compute[73497]:   </metadata>
Aug 26 23:28:18 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:28:18 user nova-compute[73497]:     <system>
Aug 26 23:28:18 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:28:18 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:28:18 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:28:18 user nova-compute[73497]:       <entry name="serial">b7506745-ace5-45e2-bc1d-883f2c51f1c4</entry>
Aug 26 23:28:18 user nova-compute[73497]:       <entry name="uuid">b7506745-ace5-45e2-bc1d-883f2c51f1c4</entry>
Aug 26 23:28:18 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:28:18 user nova-compute[73497]:     </system>
Aug 26 23:28:18 user nova-compute[73497]:   </sysinfo>
Aug 26 23:28:18 user nova-compute[73497]:   <os>
Aug 26 23:28:18 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:28:18 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:28:18 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:28:18 user nova-compute[73497]:   </os>
Aug 26 23:28:18 user nova-compute[73497]:   <features>
Aug 26 23:28:18 user nova-compute[73497]:     <acpi/>
Aug 26 23:28:18 user nova-compute[73497]:     <apic/>
Aug 26 23:28:18 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:28:18 user nova-compute[73497]:   </features>
Aug 26 23:28:18 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:28:18 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:28:18 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:28:18 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:28:18 user nova-compute[73497]:   </clock>
Aug 26 23:28:18 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:28:18 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:28:18 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:28:18 user nova-compute[73497]:   </cpu>
Aug 26 23:28:18 user nova-compute[73497]:   <devices>
Aug 26 23:28:18 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:28:18 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:28:18 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/disk"/>
Aug 26 23:28:18 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:28:18 user nova-compute[73497]:     </disk>
Aug 26 23:28:18 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:28:18 user nova-compute[73497]:       <mac address="fa:16:3e:7e:a1:4c"/>
Aug 26 23:28:18 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:28:18 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:28:18 user nova-compute[73497]:       <target dev="tap9993c7ac-e4"/>
Aug 26 23:28:18 user nova-compute[73497]:     </interface>
Aug 26 23:28:18 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:28:18 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/console.log" append="off"/>
Aug 26 23:28:18 user nova-compute[73497]:     </serial>
Aug 26 23:28:18 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:28:18 user nova-compute[73497]:     <video>
Aug 26 23:28:18 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:28:18 user nova-compute[73497]:     </video>
Aug 26 23:28:18 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:28:18 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:28:18 user nova-compute[73497]:     </rng>
Aug 26 23:28:18 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:28:18 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:28:18 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:28:18 user nova-compute[73497]:     </memballoon>
Aug 26 23:28:18 user nova-compute[73497]:   </devices>
Aug 26 23:28:18 user nova-compute[73497]: </domain>
Aug 26 23:28:18 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:28:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1357907004',display_name='tempest-TestMinimumBasicScenario-server-1357907004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1357907004',id=34,image_ref='4953616c-6ab8-44e7-9644-490160ff0ba9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHawhLjVpHObEM1sejmZUdYQSEnONqYB9L2Qv/axMeT5kKxPx9/QuS/i5jErqR53WVLlmHVIBUw7Z4Scv0xP68Y1o8+EymV6cmPgQpjbZL+arFhxVBB0cTzGv9OLKbkK5Q==',key_name='tempest-TestMinimumBasicScenario-1395022215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ae441ca35d847e89eb99397fe167960',ramdisk_id='',reservation_id='r-qslnut47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4953616c-6ab8-44e7-9644-490160ff0ba9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1836970755',owner_user_name='tempest-TestMinimumBasicScenario-1836970755-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:28:15Z,user_data=None,user_id='948c44e55c7c404fb660394a747cf162',uuid=b7506745-ace5-45e2-bc1d-883f2c51f1c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "address": "fa:16:3e:7e:a1:4c", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9993c7ac-e4", "ovs_interfaceid": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Converting VIF {"id": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "address": "fa:16:3e:7e:a1:4c", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9993c7ac-e4", "ovs_interfaceid": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a1:4c,bridge_name='br-int',has_traffic_filtering=True,id=9993c7ac-e4a2-41c8-97d9-75c681d68a6a,network=Network(f11c42be-cba6-4e59-80b1-6fdd90a41c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9993c7ac-e4') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG os_vif [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a1:4c,bridge_name='br-int',has_traffic_filtering=True,id=9993c7ac-e4a2-41c8-97d9-75c681d68a6a,network=Network(f11c42be-cba6-4e59-80b1-6fdd90a41c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9993c7ac-e4') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9993c7ac-e4, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9993c7ac-e4, col_values=(('external_ids', {'iface-id': '9993c7ac-e4a2-41c8-97d9-75c681d68a6a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:a1:4c', 'vm-uuid': 'b7506745-ace5-45e2-bc1d-883f2c51f1c4'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:18 user nova-compute[73497]: INFO os_vif [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a1:4c,bridge_name='br-int',has_traffic_filtering=True,id=9993c7ac-e4a2-41c8-97d9-75c681d68a6a,network=Network(f11c42be-cba6-4e59-80b1-6fdd90a41c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9993c7ac-e4')
Aug 26 23:28:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] No VIF found with MAC fa:16:3e:7e:a1:4c, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Removed pending event for c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c due to event {{(pid=73497) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092498.6474564, c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:28:18 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] VM Resumed (Lifecycle Event)
Aug 26 23:28:18 user nova-compute[73497]: DEBUG nova.compute.manager [None req-022fec64-a58f-4abc-8a11-3a3e1eb2cd80 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:28:18 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 23:28:18 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092498.648648, c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:28:18 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] VM Started (Lifecycle Event)
Aug 26 23:28:18 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:28:18 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:28:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:20 user nova-compute[73497]: DEBUG nova.compute.manager [req-e6690389-189b-425a-aed9-6ddcff7cc209 req-520f2f26-44ab-4cf5-b870-c30e794dbfdc service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Received event network-vif-plugged-9993c7ac-e4a2-41c8-97d9-75c681d68a6a {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:28:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-e6690389-189b-425a-aed9-6ddcff7cc209 req-520f2f26-44ab-4cf5-b870-c30e794dbfdc service nova] Acquiring lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:28:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-e6690389-189b-425a-aed9-6ddcff7cc209 req-520f2f26-44ab-4cf5-b870-c30e794dbfdc service nova] Lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:28:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-e6690389-189b-425a-aed9-6ddcff7cc209 req-520f2f26-44ab-4cf5-b870-c30e794dbfdc service nova] Lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:28:20 user nova-compute[73497]: DEBUG nova.compute.manager [req-e6690389-189b-425a-aed9-6ddcff7cc209 req-520f2f26-44ab-4cf5-b870-c30e794dbfdc service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] No waiting events found dispatching network-vif-plugged-9993c7ac-e4a2-41c8-97d9-75c681d68a6a {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:28:20 user nova-compute[73497]: WARNING nova.compute.manager [req-e6690389-189b-425a-aed9-6ddcff7cc209 req-520f2f26-44ab-4cf5-b870-c30e794dbfdc service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Received unexpected event network-vif-plugged-9993c7ac-e4a2-41c8-97d9-75c681d68a6a for instance with vm_state building and task_state spawning.
Aug 26 23:28:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:22 user nova-compute[73497]: DEBUG nova.compute.manager [req-876e5d04-9a7a-4da1-8b61-a2f81a736b41 req-eb95259d-ba31-4543-b79e-8e45deaab827 service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Received event network-vif-plugged-9993c7ac-e4a2-41c8-97d9-75c681d68a6a {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:28:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-876e5d04-9a7a-4da1-8b61-a2f81a736b41 req-eb95259d-ba31-4543-b79e-8e45deaab827 service nova] Acquiring lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:28:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-876e5d04-9a7a-4da1-8b61-a2f81a736b41 req-eb95259d-ba31-4543-b79e-8e45deaab827 service nova] Lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:28:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-876e5d04-9a7a-4da1-8b61-a2f81a736b41 req-eb95259d-ba31-4543-b79e-8e45deaab827 service nova] Lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:28:22 user nova-compute[73497]: DEBUG nova.compute.manager [req-876e5d04-9a7a-4da1-8b61-a2f81a736b41 req-eb95259d-ba31-4543-b79e-8e45deaab827 service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] No waiting events found dispatching network-vif-plugged-9993c7ac-e4a2-41c8-97d9-75c681d68a6a {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:28:22 user nova-compute[73497]: WARNING nova.compute.manager [req-876e5d04-9a7a-4da1-8b61-a2f81a736b41 req-eb95259d-ba31-4543-b79e-8e45deaab827 service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Received unexpected event network-vif-plugged-9993c7ac-e4a2-41c8-97d9-75c681d68a6a for instance with vm_state building and task_state spawning.
Aug 26 23:28:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:22 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092502.2066112, b7506745-ace5-45e2-bc1d-883f2c51f1c4 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:28:22 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] VM Resumed (Lifecycle Event)
Aug 26 23:28:22 user nova-compute[73497]: DEBUG nova.compute.manager [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:28:22 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:28:22 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Instance spawned successfully.
Aug 26 23:28:22 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:28:22 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:28:22 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:28:22 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:28:22 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:28:22 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:28:22 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:28:22 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:28:22 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:28:22 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:28:22 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092502.2109962, b7506745-ace5-45e2-bc1d-883f2c51f1c4 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:28:22 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] VM Started (Lifecycle Event)
Aug 26 23:28:22 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:28:22 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:28:22 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:28:22 user nova-compute[73497]: INFO nova.compute.manager [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Took 7.19 seconds to spawn the instance on the hypervisor.
Aug 26 23:28:22 user nova-compute[73497]: DEBUG nova.compute.manager [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:28:22 user nova-compute[73497]: INFO nova.compute.manager [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Took 8.38 seconds to build instance.
Aug 26 23:28:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3589dcf5-ecbb-4ad1-9dee-b3f7aab37bce tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.521s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:28:23 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:29 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693092494.4274259, 93f6eb6e-272f-4b1e-b1d5-40769bf07165 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:28:29 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] VM Stopped (Lifecycle Event)
Aug 26 23:28:29 user nova-compute[73497]: DEBUG nova.compute.manager [None req-a74b7fc3-4f05-4d39-b161-e18a575c5e2f None None] [instance: 93f6eb6e-272f-4b1e-b1d5-40769bf07165] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:28:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b227762d-7f1b-4980-b391-8d68e0ea19de tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "40afa348-8391-4643-977c-e67eab5c9476" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:28:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b227762d-7f1b-4980-b391-8d68e0ea19de tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "40afa348-8391-4643-977c-e67eab5c9476" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:28:31 user nova-compute[73497]: DEBUG nova.compute.manager [None req-b227762d-7f1b-4980-b391-8d68e0ea19de tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Going to confirm migration 2 {{(pid=73497) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 26 23:28:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b227762d-7f1b-4980-b391-8d68e0ea19de tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "refresh_cache-40afa348-8391-4643-977c-e67eab5c9476" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:28:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b227762d-7f1b-4980-b391-8d68e0ea19de tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquired lock "refresh_cache-40afa348-8391-4643-977c-e67eab5c9476" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:28:31 user nova-compute[73497]: DEBUG nova.network.neutron [None req-b227762d-7f1b-4980-b391-8d68e0ea19de tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:28:31 user nova-compute[73497]: DEBUG nova.objects.instance [None req-b227762d-7f1b-4980-b391-8d68e0ea19de tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lazy-loading 'info_cache' on Instance uuid 40afa348-8391-4643-977c-e67eab5c9476 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:28:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:32 user nova-compute[73497]: DEBUG nova.network.neutron [None req-b227762d-7f1b-4980-b391-8d68e0ea19de tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Updating instance_info_cache with network_info: [{"id": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "address": "fa:16:3e:c5:a7:fc", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1839e5ce-75", "ovs_interfaceid": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:28:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b227762d-7f1b-4980-b391-8d68e0ea19de tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Releasing lock "refresh_cache-40afa348-8391-4643-977c-e67eab5c9476" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:28:32 user nova-compute[73497]: DEBUG nova.objects.instance [None req-b227762d-7f1b-4980-b391-8d68e0ea19de tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lazy-loading 'migration_context' on Instance uuid 40afa348-8391-4643-977c-e67eab5c9476 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:28:32 user nova-compute[73497]: DEBUG nova.objects.base [None req-b227762d-7f1b-4980-b391-8d68e0ea19de tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Object Instance<40afa348-8391-4643-977c-e67eab5c9476> lazy-loaded attributes: info_cache,migration_context {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:28:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b227762d-7f1b-4980-b391-8d68e0ea19de tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:28:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b227762d-7f1b-4980-b391-8d68e0ea19de tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:28:32 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-b227762d-7f1b-4980-b391-8d68e0ea19de tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:28:32 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-b227762d-7f1b-4980-b391-8d68e0ea19de tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:28:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b227762d-7f1b-4980-b391-8d68e0ea19de tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.471s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:28:32 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-b227762d-7f1b-4980-b391-8d68e0ea19de tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Deleted allocation for migration 1a7b5b2a-d801-44eb-b24c-990f5ddcbb0a
Aug 26 23:28:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b227762d-7f1b-4980-b391-8d68e0ea19de tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "40afa348-8391-4643-977c-e67eab5c9476" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.666s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:28:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:48 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:55 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:28:55 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:28:56 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:28:56 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Cleaning up deleted instances {{(pid=73497) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 23:28:56 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] There are 0 instances to clean {{(pid=73497) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 23:28:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:58 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:28:58 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:59 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:28:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:28:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:28:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:28:59 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:28:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:28:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:28:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:28:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:28:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:28:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:28:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:28:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:29:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:29:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:29:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:29:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed2c58fe-8d24-47ed-b5da-62e44e290901/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed2c58fe-8d24-47ed-b5da-62e44e290901/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed2c58fe-8d24-47ed-b5da-62e44e290901/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed2c58fe-8d24-47ed-b5da-62e44e290901/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:03 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:29:03 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:29:03 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=7145MB free_disk=24.904064178466797GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:29:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:04 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 994093f0-e6b2-4c96-b259-c559ef2b1fbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:29:04 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 171985a3-358d-4b26-a66c-372b9b99b386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:29:04 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance aebaeda6-23d1-43a1-afc8-bdc8992067e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:29:04 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 043294e5-0618-4a31-bb19-1227ef1f5d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:29:04 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance e9e5c83f-0678-48d4-a81f-1a3f959aabcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:29:04 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance c601f97e-9e52-40c6-9085-45f38e709721 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:29:04 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:29:04 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance f7c83073-fadc-4e41-a4a9-df0bbe11aa28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:29:04 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 40afa348-8391-4643-977c-e67eab5c9476 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:29:04 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance ed2c58fe-8d24-47ed-b5da-62e44e290901 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:29:04 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance e15ddee6-a642-4638-9534-21e640b3d017 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:29:04 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance b7506745-ace5-45e2-bc1d-883f2c51f1c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:29:04 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:29:04 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:29:04 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:29:04 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:29:04 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:29:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.718s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:04 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:29:05 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:29:05 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:29:05 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:29:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-171985a3-358d-4b26-a66c-372b9b99b386" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:29:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-171985a3-358d-4b26-a66c-372b9b99b386" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:29:05 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:29:05 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Updating instance_info_cache with network_info: [{"id": "1772e978-02b5-4c0b-a99c-67f6c6f91d58", "address": "fa:16:3e:a7:28:86", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1772e978-02", "ovs_interfaceid": "1772e978-02b5-4c0b-a99c-67f6c6f91d58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:29:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-171985a3-358d-4b26-a66c-372b9b99b386" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:29:05 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:29:05 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:29:05 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:29:05 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:29:05 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:29:05 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:29:05 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Cleaning up deleted instances with incomplete migration  {{(pid=73497) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 23:29:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:08 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "853bd672-97af-4e36-9bd4-5cc428b83765" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "853bd672-97af-4e36-9bd4-5cc428b83765" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:08 user nova-compute[73497]: DEBUG nova.compute.manager [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:29:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:08 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:29:08 user nova-compute[73497]: INFO nova.compute.claims [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Claim successful on node user
Aug 26 23:29:09 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:29:09 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:29:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.508s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:09 user nova-compute[73497]: DEBUG nova.compute.manager [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:29:09 user nova-compute[73497]: DEBUG nova.compute.manager [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:29:09 user nova-compute[73497]: DEBUG nova.network.neutron [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:29:09 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:29:09 user nova-compute[73497]: DEBUG nova.compute.manager [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:29:09 user nova-compute[73497]: DEBUG nova.policy [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e38409b92a95475db83540cbc4222466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd784b1d6c31e41d6a03fc377b0be69f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:29:09 user nova-compute[73497]: DEBUG nova.compute.manager [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:29:09 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:29:09 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Creating image(s)
Aug 26 23:29:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "/opt/stack/data/nova/instances/853bd672-97af-4e36-9bd4-5cc428b83765/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "/opt/stack/data/nova/instances/853bd672-97af-4e36-9bd4-5cc428b83765/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "/opt/stack/data/nova/instances/853bd672-97af-4e36-9bd4-5cc428b83765/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:09 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0031711a-8e1f-4692-843b-507c9ff6eaa4 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Acquiring lock "ed2c58fe-8d24-47ed-b5da-62e44e290901" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0031711a-8e1f-4692-843b-507c9ff6eaa4 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Lock "ed2c58fe-8d24-47ed-b5da-62e44e290901" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0031711a-8e1f-4692-843b-507c9ff6eaa4 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Acquiring lock "ed2c58fe-8d24-47ed-b5da-62e44e290901-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0031711a-8e1f-4692-843b-507c9ff6eaa4 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Lock "ed2c58fe-8d24-47ed-b5da-62e44e290901-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0031711a-8e1f-4692-843b-507c9ff6eaa4 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Lock "ed2c58fe-8d24-47ed-b5da-62e44e290901-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:09 user nova-compute[73497]: INFO nova.compute.manager [None req-0031711a-8e1f-4692-843b-507c9ff6eaa4 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Terminating instance
Aug 26 23:29:09 user nova-compute[73497]: DEBUG nova.compute.manager [None req-0031711a-8e1f-4692-843b-507c9ff6eaa4 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:29:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:09 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.186s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:09 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:09 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.210s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:09 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/853bd672-97af-4e36-9bd4-5cc428b83765/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/853bd672-97af-4e36-9bd4-5cc428b83765/disk 1073741824" returned: 0 in 0.067s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:10 user nova-compute[73497]: DEBUG nova.compute.manager [req-657423d9-c305-40a1-9c21-20633a2fa9cd req-0acf3aee-2daf-446f-a718-f5effa75c1e2 service nova] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Received event network-vif-unplugged-af26fb56-8400-4916-bd8d-6ce28402144d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:29:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-657423d9-c305-40a1-9c21-20633a2fa9cd req-0acf3aee-2daf-446f-a718-f5effa75c1e2 service nova] Acquiring lock "ed2c58fe-8d24-47ed-b5da-62e44e290901-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-657423d9-c305-40a1-9c21-20633a2fa9cd req-0acf3aee-2daf-446f-a718-f5effa75c1e2 service nova] Lock "ed2c58fe-8d24-47ed-b5da-62e44e290901-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-657423d9-c305-40a1-9c21-20633a2fa9cd req-0acf3aee-2daf-446f-a718-f5effa75c1e2 service nova] Lock "ed2c58fe-8d24-47ed-b5da-62e44e290901-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:10 user nova-compute[73497]: DEBUG nova.compute.manager [req-657423d9-c305-40a1-9c21-20633a2fa9cd req-0acf3aee-2daf-446f-a718-f5effa75c1e2 service nova] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] No waiting events found dispatching network-vif-unplugged-af26fb56-8400-4916-bd8d-6ce28402144d {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:29:10 user nova-compute[73497]: DEBUG nova.compute.manager [req-657423d9-c305-40a1-9c21-20633a2fa9cd req-0acf3aee-2daf-446f-a718-f5effa75c1e2 service nova] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Received event network-vif-unplugged-af26fb56-8400-4916-bd8d-6ce28402144d for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:29:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.196s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:10 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Checking if we can resize image /opt/stack/data/nova/instances/853bd672-97af-4e36-9bd4-5cc428b83765/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:29:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853bd672-97af-4e36-9bd4-5cc428b83765/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:10 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Instance destroyed successfully.
Aug 26 23:29:10 user nova-compute[73497]: DEBUG nova.objects.instance [None req-0031711a-8e1f-4692-843b-507c9ff6eaa4 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Lazy-loading 'resources' on Instance uuid ed2c58fe-8d24-47ed-b5da-62e44e290901 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:29:10 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-0031711a-8e1f-4692-843b-507c9ff6eaa4 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:27:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1284936210',display_name='tempest-VolumesActionsTest-instance-1284936210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1284936210',id=32,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:27:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='951ffc97c25a4d7b90efa5bb5cfd269c',ramdisk_id='',reservation_id='r-0tr2abm1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1831950157',owner_user_name='tempest-VolumesActionsTest-1831950157-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:27:26Z,user_data=None,user_id='39d36154f45848ecae45e455b5b150cd',uuid=ed2c58fe-8d24-47ed-b5da-62e44e290901,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af26fb56-8400-4916-bd8d-6ce28402144d", "address": "fa:16:3e:b7:08:9a", "network": {"id": "35aa126f-8000-48cf-86c1-d57dbbb8c4d2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1248937097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "951ffc97c25a4d7b90efa5bb5cfd269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf26fb56-84", "ovs_interfaceid": "af26fb56-8400-4916-bd8d-6ce28402144d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:29:10 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-0031711a-8e1f-4692-843b-507c9ff6eaa4 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Converting VIF {"id": "af26fb56-8400-4916-bd8d-6ce28402144d", "address": "fa:16:3e:b7:08:9a", "network": {"id": "35aa126f-8000-48cf-86c1-d57dbbb8c4d2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1248937097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "951ffc97c25a4d7b90efa5bb5cfd269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf26fb56-84", "ovs_interfaceid": "af26fb56-8400-4916-bd8d-6ce28402144d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:29:10 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-0031711a-8e1f-4692-843b-507c9ff6eaa4 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:08:9a,bridge_name='br-int',has_traffic_filtering=True,id=af26fb56-8400-4916-bd8d-6ce28402144d,network=Network(35aa126f-8000-48cf-86c1-d57dbbb8c4d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf26fb56-84') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:29:10 user nova-compute[73497]: DEBUG os_vif [None req-0031711a-8e1f-4692-843b-507c9ff6eaa4 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:08:9a,bridge_name='br-int',has_traffic_filtering=True,id=af26fb56-8400-4916-bd8d-6ce28402144d,network=Network(35aa126f-8000-48cf-86c1-d57dbbb8c4d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf26fb56-84') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:29:10 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:10 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf26fb56-84, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:29:10 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:10 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:29:10 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:10 user nova-compute[73497]: INFO os_vif [None req-0031711a-8e1f-4692-843b-507c9ff6eaa4 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:08:9a,bridge_name='br-int',has_traffic_filtering=True,id=af26fb56-8400-4916-bd8d-6ce28402144d,network=Network(35aa126f-8000-48cf-86c1-d57dbbb8c4d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf26fb56-84')
Aug 26 23:29:10 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-0031711a-8e1f-4692-843b-507c9ff6eaa4 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Deleting instance files /opt/stack/data/nova/instances/ed2c58fe-8d24-47ed-b5da-62e44e290901_del
Aug 26 23:29:10 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-0031711a-8e1f-4692-843b-507c9ff6eaa4 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Deletion of /opt/stack/data/nova/instances/ed2c58fe-8d24-47ed-b5da-62e44e290901_del complete
Aug 26 23:29:10 user nova-compute[73497]: INFO nova.compute.manager [None req-0031711a-8e1f-4692-843b-507c9ff6eaa4 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Took 0.80 seconds to destroy the instance on the hypervisor.
Aug 26 23:29:10 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-0031711a-8e1f-4692-843b-507c9ff6eaa4 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:29:10 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:29:10 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:29:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853bd672-97af-4e36-9bd4-5cc428b83765/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:10 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Cannot resize image /opt/stack/data/nova/instances/853bd672-97af-4e36-9bd4-5cc428b83765/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:29:10 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:29:10 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Ensure instance console log exists: /opt/stack/data/nova/instances/853bd672-97af-4e36-9bd4-5cc428b83765/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:29:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:10 user nova-compute[73497]: DEBUG nova.network.neutron [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Successfully created port: 55f5d62f-e069-45a4-953f-d3ec033c3ba1 {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:29:11 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Took 0.99 seconds to deallocate network for instance.
Aug 26 23:29:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0031711a-8e1f-4692-843b-507c9ff6eaa4 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0031711a-8e1f-4692-843b-507c9ff6eaa4 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG nova.compute.manager [req-2195987c-bbdb-4226-ab33-d5786f35c10e req-96184016-c2ae-4e21-8b15-98a95c3b596b service nova] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Received event network-vif-deleted-af26fb56-8400-4916-bd8d-6ce28402144d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG nova.network.neutron [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Successfully updated port: 55f5d62f-e069-45a4-953f-d3ec033c3ba1 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "refresh_cache-853bd672-97af-4e36-9bd4-5cc428b83765" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquired lock "refresh_cache-853bd672-97af-4e36-9bd4-5cc428b83765" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG nova.network.neutron [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG nova.network.neutron [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-0031711a-8e1f-4692-843b-507c9ff6eaa4 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-0031711a-8e1f-4692-843b-507c9ff6eaa4 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0031711a-8e1f-4692-843b-507c9ff6eaa4 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG nova.network.neutron [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Updating instance_info_cache with network_info: [{"id": "55f5d62f-e069-45a4-953f-d3ec033c3ba1", "address": "fa:16:3e:75:d8:38", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55f5d62f-e0", "ovs_interfaceid": "55f5d62f-e069-45a4-953f-d3ec033c3ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Releasing lock "refresh_cache-853bd672-97af-4e36-9bd4-5cc428b83765" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG nova.compute.manager [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Instance network_info: |[{"id": "55f5d62f-e069-45a4-953f-d3ec033c3ba1", "address": "fa:16:3e:75:d8:38", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55f5d62f-e0", "ovs_interfaceid": "55f5d62f-e069-45a4-953f-d3ec033c3ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Start _get_guest_xml network_info=[{"id": "55f5d62f-e069-45a4-953f-d3ec033c3ba1", "address": "fa:16:3e:75:d8:38", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55f5d62f-e0", "ovs_interfaceid": "55f5d62f-e069-45a4-953f-d3ec033c3ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:29:11 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-0031711a-8e1f-4692-843b-507c9ff6eaa4 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Deleted allocations for instance ed2c58fe-8d24-47ed-b5da-62e44e290901
Aug 26 23:29:11 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:29:11 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:29:11 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1175610065',display_name='tempest-AttachVolumeNegativeTest-server-1175610065',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1175610065',id=35,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAUpFIeOcp1zPIB1StcMmyoqllB/TxzqADHDyaJo2QJoaHz6mot2YhFbI2ARRQboxOc9WkNnkXD0lWj18spSOL3kTOy5zVIJTQ1DdZklxozo74r7DiMARbDzCogj4amLg==',key_name='tempest-keypair-1449143744',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d784b1d6c31e41d6a03fc377b0be69f5',ramdisk_id='',reservation_id='r-taxc52ms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1095215256',owner_user_name='tempest-AttachVolumeNegativeTest-1095215256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:29:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e38409b92a95475db83540cbc4222466',uuid=853bd672-97af-4e36-9bd4-5cc428b83765,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55f5d62f-e069-45a4-953f-d3ec033c3ba1", "address": "fa:16:3e:75:d8:38", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55f5d62f-e0", "ovs_interfaceid": "55f5d62f-e069-45a4-953f-d3ec033c3ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Converting VIF {"id": "55f5d62f-e069-45a4-953f-d3ec033c3ba1", "address": "fa:16:3e:75:d8:38", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55f5d62f-e0", "ovs_interfaceid": "55f5d62f-e069-45a4-953f-d3ec033c3ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:d8:38,bridge_name='br-int',has_traffic_filtering=True,id=55f5d62f-e069-45a4-953f-d3ec033c3ba1,network=Network(7bae9729-050d-4ff3-a842-91d0ec2c08d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55f5d62f-e0') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG nova.objects.instance [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lazy-loading 'pci_devices' on Instance uuid 853bd672-97af-4e36-9bd4-5cc428b83765 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:29:11 user nova-compute[73497]:   <uuid>853bd672-97af-4e36-9bd4-5cc428b83765</uuid>
Aug 26 23:29:11 user nova-compute[73497]:   <name>instance-00000023</name>
Aug 26 23:29:11 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:29:11 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:29:11 user nova-compute[73497]:   <metadata>
Aug 26 23:29:11 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:29:11 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:29:11 user nova-compute[73497]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1175610065</nova:name>
Aug 26 23:29:11 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:29:11</nova:creationTime>
Aug 26 23:29:11 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:29:11 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:29:11 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:29:11 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:29:11 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:29:11 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:29:11 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:29:11 user nova-compute[73497]:       <nova:owner>
Aug 26 23:29:11 user nova-compute[73497]:         <nova:user uuid="e38409b92a95475db83540cbc4222466">tempest-AttachVolumeNegativeTest-1095215256-project-member</nova:user>
Aug 26 23:29:11 user nova-compute[73497]:         <nova:project uuid="d784b1d6c31e41d6a03fc377b0be69f5">tempest-AttachVolumeNegativeTest-1095215256</nova:project>
Aug 26 23:29:11 user nova-compute[73497]:       </nova:owner>
Aug 26 23:29:11 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:29:11 user nova-compute[73497]:       <nova:ports>
Aug 26 23:29:11 user nova-compute[73497]:         <nova:port uuid="55f5d62f-e069-45a4-953f-d3ec033c3ba1">
Aug 26 23:29:11 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 23:29:11 user nova-compute[73497]:         </nova:port>
Aug 26 23:29:11 user nova-compute[73497]:       </nova:ports>
Aug 26 23:29:11 user nova-compute[73497]:     </nova:instance>
Aug 26 23:29:11 user nova-compute[73497]:   </metadata>
Aug 26 23:29:11 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:29:11 user nova-compute[73497]:     <system>
Aug 26 23:29:11 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:29:11 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:29:11 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:29:11 user nova-compute[73497]:       <entry name="serial">853bd672-97af-4e36-9bd4-5cc428b83765</entry>
Aug 26 23:29:11 user nova-compute[73497]:       <entry name="uuid">853bd672-97af-4e36-9bd4-5cc428b83765</entry>
Aug 26 23:29:11 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:29:11 user nova-compute[73497]:     </system>
Aug 26 23:29:11 user nova-compute[73497]:   </sysinfo>
Aug 26 23:29:11 user nova-compute[73497]:   <os>
Aug 26 23:29:11 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:29:11 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:29:11 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:29:11 user nova-compute[73497]:   </os>
Aug 26 23:29:11 user nova-compute[73497]:   <features>
Aug 26 23:29:11 user nova-compute[73497]:     <acpi/>
Aug 26 23:29:11 user nova-compute[73497]:     <apic/>
Aug 26 23:29:11 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:29:11 user nova-compute[73497]:   </features>
Aug 26 23:29:11 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:29:11 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:29:11 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:29:11 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:29:11 user nova-compute[73497]:   </clock>
Aug 26 23:29:11 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:29:11 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:29:11 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:29:11 user nova-compute[73497]:   </cpu>
Aug 26 23:29:11 user nova-compute[73497]:   <devices>
Aug 26 23:29:11 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:29:11 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:29:11 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/853bd672-97af-4e36-9bd4-5cc428b83765/disk"/>
Aug 26 23:29:11 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:29:11 user nova-compute[73497]:     </disk>
Aug 26 23:29:11 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:29:11 user nova-compute[73497]:       <mac address="fa:16:3e:75:d8:38"/>
Aug 26 23:29:11 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:29:11 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:29:11 user nova-compute[73497]:       <target dev="tap55f5d62f-e0"/>
Aug 26 23:29:11 user nova-compute[73497]:     </interface>
Aug 26 23:29:11 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:29:11 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/853bd672-97af-4e36-9bd4-5cc428b83765/console.log" append="off"/>
Aug 26 23:29:11 user nova-compute[73497]:     </serial>
Aug 26 23:29:11 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:29:11 user nova-compute[73497]:     <video>
Aug 26 23:29:11 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:29:11 user nova-compute[73497]:     </video>
Aug 26 23:29:11 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:29:11 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:29:11 user nova-compute[73497]:     </rng>
Aug 26 23:29:11 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:29:11 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:29:11 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:29:11 user nova-compute[73497]:     </memballoon>
Aug 26 23:29:11 user nova-compute[73497]:   </devices>
Aug 26 23:29:11 user nova-compute[73497]: </domain>
Aug 26 23:29:11 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1175610065',display_name='tempest-AttachVolumeNegativeTest-server-1175610065',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1175610065',id=35,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAUpFIeOcp1zPIB1StcMmyoqllB/TxzqADHDyaJo2QJoaHz6mot2YhFbI2ARRQboxOc9WkNnkXD0lWj18spSOL3kTOy5zVIJTQ1DdZklxozo74r7DiMARbDzCogj4amLg==',key_name='tempest-keypair-1449143744',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d784b1d6c31e41d6a03fc377b0be69f5',ramdisk_id='',reservation_id='r-taxc52ms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1095215256',owner_user_name='tempest-AttachVolumeNegativeTest-1095215256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:29:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e38409b92a95475db83540cbc4222466',uuid=853bd672-97af-4e36-9bd4-5cc428b83765,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55f5d62f-e069-45a4-953f-d3ec033c3ba1", "address": "fa:16:3e:75:d8:38", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55f5d62f-e0", "ovs_interfaceid": "55f5d62f-e069-45a4-953f-d3ec033c3ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Converting VIF {"id": "55f5d62f-e069-45a4-953f-d3ec033c3ba1", "address": "fa:16:3e:75:d8:38", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55f5d62f-e0", "ovs_interfaceid": "55f5d62f-e069-45a4-953f-d3ec033c3ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:d8:38,bridge_name='br-int',has_traffic_filtering=True,id=55f5d62f-e069-45a4-953f-d3ec033c3ba1,network=Network(7bae9729-050d-4ff3-a842-91d0ec2c08d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55f5d62f-e0') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG os_vif [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:d8:38,bridge_name='br-int',has_traffic_filtering=True,id=55f5d62f-e069-45a4-953f-d3ec033c3ba1,network=Network(7bae9729-050d-4ff3-a842-91d0ec2c08d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55f5d62f-e0') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55f5d62f-e0, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap55f5d62f-e0, col_values=(('external_ids', {'iface-id': '55f5d62f-e069-45a4-953f-d3ec033c3ba1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:d8:38', 'vm-uuid': '853bd672-97af-4e36-9bd4-5cc428b83765'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0031711a-8e1f-4692-843b-507c9ff6eaa4 tempest-VolumesActionsTest-1831950157 tempest-VolumesActionsTest-1831950157-project-member] Lock "ed2c58fe-8d24-47ed-b5da-62e44e290901" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.390s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:29:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:11 user nova-compute[73497]: INFO os_vif [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:d8:38,bridge_name='br-int',has_traffic_filtering=True,id=55f5d62f-e069-45a4-953f-d3ec033c3ba1,network=Network(7bae9729-050d-4ff3-a842-91d0ec2c08d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55f5d62f-e0')
Aug 26 23:29:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:29:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] No VIF found with MAC fa:16:3e:75:d8:38, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:29:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:12 user nova-compute[73497]: DEBUG nova.compute.manager [req-0b21a586-d6fe-48ee-999c-683818c73206 req-4bb767ec-790b-416d-a74e-603b44dde4dc service nova] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Received event network-vif-plugged-af26fb56-8400-4916-bd8d-6ce28402144d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:29:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0b21a586-d6fe-48ee-999c-683818c73206 req-4bb767ec-790b-416d-a74e-603b44dde4dc service nova] Acquiring lock "ed2c58fe-8d24-47ed-b5da-62e44e290901-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0b21a586-d6fe-48ee-999c-683818c73206 req-4bb767ec-790b-416d-a74e-603b44dde4dc service nova] Lock "ed2c58fe-8d24-47ed-b5da-62e44e290901-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0b21a586-d6fe-48ee-999c-683818c73206 req-4bb767ec-790b-416d-a74e-603b44dde4dc service nova] Lock "ed2c58fe-8d24-47ed-b5da-62e44e290901-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:12 user nova-compute[73497]: DEBUG nova.compute.manager [req-0b21a586-d6fe-48ee-999c-683818c73206 req-4bb767ec-790b-416d-a74e-603b44dde4dc service nova] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] No waiting events found dispatching network-vif-plugged-af26fb56-8400-4916-bd8d-6ce28402144d {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:29:12 user nova-compute[73497]: WARNING nova.compute.manager [req-0b21a586-d6fe-48ee-999c-683818c73206 req-4bb767ec-790b-416d-a74e-603b44dde4dc service nova] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Received unexpected event network-vif-plugged-af26fb56-8400-4916-bd8d-6ce28402144d for instance with vm_state deleted and task_state None.
Aug 26 23:29:12 user nova-compute[73497]: DEBUG nova.compute.manager [req-0b21a586-d6fe-48ee-999c-683818c73206 req-4bb767ec-790b-416d-a74e-603b44dde4dc service nova] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Received event network-changed-55f5d62f-e069-45a4-953f-d3ec033c3ba1 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:29:12 user nova-compute[73497]: DEBUG nova.compute.manager [req-0b21a586-d6fe-48ee-999c-683818c73206 req-4bb767ec-790b-416d-a74e-603b44dde4dc service nova] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Refreshing instance network info cache due to event network-changed-55f5d62f-e069-45a4-953f-d3ec033c3ba1. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:29:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0b21a586-d6fe-48ee-999c-683818c73206 req-4bb767ec-790b-416d-a74e-603b44dde4dc service nova] Acquiring lock "refresh_cache-853bd672-97af-4e36-9bd4-5cc428b83765" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:29:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0b21a586-d6fe-48ee-999c-683818c73206 req-4bb767ec-790b-416d-a74e-603b44dde4dc service nova] Acquired lock "refresh_cache-853bd672-97af-4e36-9bd4-5cc428b83765" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:29:12 user nova-compute[73497]: DEBUG nova.network.neutron [req-0b21a586-d6fe-48ee-999c-683818c73206 req-4bb767ec-790b-416d-a74e-603b44dde4dc service nova] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Refreshing network info cache for port 55f5d62f-e069-45a4-953f-d3ec033c3ba1 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:29:12 user nova-compute[73497]: DEBUG nova.network.neutron [req-0b21a586-d6fe-48ee-999c-683818c73206 req-4bb767ec-790b-416d-a74e-603b44dde4dc service nova] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Updated VIF entry in instance network info cache for port 55f5d62f-e069-45a4-953f-d3ec033c3ba1. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:29:12 user nova-compute[73497]: DEBUG nova.network.neutron [req-0b21a586-d6fe-48ee-999c-683818c73206 req-4bb767ec-790b-416d-a74e-603b44dde4dc service nova] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Updating instance_info_cache with network_info: [{"id": "55f5d62f-e069-45a4-953f-d3ec033c3ba1", "address": "fa:16:3e:75:d8:38", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55f5d62f-e0", "ovs_interfaceid": "55f5d62f-e069-45a4-953f-d3ec033c3ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:29:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0b21a586-d6fe-48ee-999c-683818c73206 req-4bb767ec-790b-416d-a74e-603b44dde4dc service nova] Releasing lock "refresh_cache-853bd672-97af-4e36-9bd4-5cc428b83765" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:29:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:14 user nova-compute[73497]: DEBUG nova.compute.manager [req-03625c76-2934-4588-bc03-e695cf510720 req-6cc54ddb-df5d-452c-afa6-8ae5033c8604 service nova] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Received event network-vif-plugged-55f5d62f-e069-45a4-953f-d3ec033c3ba1 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:29:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-03625c76-2934-4588-bc03-e695cf510720 req-6cc54ddb-df5d-452c-afa6-8ae5033c8604 service nova] Acquiring lock "853bd672-97af-4e36-9bd4-5cc428b83765-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-03625c76-2934-4588-bc03-e695cf510720 req-6cc54ddb-df5d-452c-afa6-8ae5033c8604 service nova] Lock "853bd672-97af-4e36-9bd4-5cc428b83765-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-03625c76-2934-4588-bc03-e695cf510720 req-6cc54ddb-df5d-452c-afa6-8ae5033c8604 service nova] Lock "853bd672-97af-4e36-9bd4-5cc428b83765-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:14 user nova-compute[73497]: DEBUG nova.compute.manager [req-03625c76-2934-4588-bc03-e695cf510720 req-6cc54ddb-df5d-452c-afa6-8ae5033c8604 service nova] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] No waiting events found dispatching network-vif-plugged-55f5d62f-e069-45a4-953f-d3ec033c3ba1 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:29:14 user nova-compute[73497]: WARNING nova.compute.manager [req-03625c76-2934-4588-bc03-e695cf510720 req-6cc54ddb-df5d-452c-afa6-8ae5033c8604 service nova] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Received unexpected event network-vif-plugged-55f5d62f-e069-45a4-953f-d3ec033c3ba1 for instance with vm_state building and task_state spawning.
Aug 26 23:29:14 user nova-compute[73497]: DEBUG nova.compute.manager [req-03625c76-2934-4588-bc03-e695cf510720 req-6cc54ddb-df5d-452c-afa6-8ae5033c8604 service nova] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Received event network-vif-plugged-55f5d62f-e069-45a4-953f-d3ec033c3ba1 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:29:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-03625c76-2934-4588-bc03-e695cf510720 req-6cc54ddb-df5d-452c-afa6-8ae5033c8604 service nova] Acquiring lock "853bd672-97af-4e36-9bd4-5cc428b83765-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-03625c76-2934-4588-bc03-e695cf510720 req-6cc54ddb-df5d-452c-afa6-8ae5033c8604 service nova] Lock "853bd672-97af-4e36-9bd4-5cc428b83765-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-03625c76-2934-4588-bc03-e695cf510720 req-6cc54ddb-df5d-452c-afa6-8ae5033c8604 service nova] Lock "853bd672-97af-4e36-9bd4-5cc428b83765-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:14 user nova-compute[73497]: DEBUG nova.compute.manager [req-03625c76-2934-4588-bc03-e695cf510720 req-6cc54ddb-df5d-452c-afa6-8ae5033c8604 service nova] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] No waiting events found dispatching network-vif-plugged-55f5d62f-e069-45a4-953f-d3ec033c3ba1 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:29:14 user nova-compute[73497]: WARNING nova.compute.manager [req-03625c76-2934-4588-bc03-e695cf510720 req-6cc54ddb-df5d-452c-afa6-8ae5033c8604 service nova] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Received unexpected event network-vif-plugged-55f5d62f-e069-45a4-953f-d3ec033c3ba1 for instance with vm_state building and task_state spawning.
Aug 26 23:29:15 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092555.5319862, 853bd672-97af-4e36-9bd4-5cc428b83765 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:29:15 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] VM Resumed (Lifecycle Event)
Aug 26 23:29:15 user nova-compute[73497]: DEBUG nova.compute.manager [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:29:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:29:15 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Instance spawned successfully.
Aug 26 23:29:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:29:15 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:29:15 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:29:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:29:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:29:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:29:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:29:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:29:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:29:15 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:29:15 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092555.5356216, 853bd672-97af-4e36-9bd4-5cc428b83765 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:29:15 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] VM Started (Lifecycle Event)
Aug 26 23:29:15 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:29:15 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:29:15 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:29:15 user nova-compute[73497]: INFO nova.compute.manager [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Took 6.14 seconds to spawn the instance on the hypervisor.
Aug 26 23:29:15 user nova-compute[73497]: DEBUG nova.compute.manager [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:29:15 user nova-compute[73497]: INFO nova.compute.manager [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Took 7.02 seconds to build instance.
Aug 26 23:29:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1ce75059-f47f-4ac4-a4e2-5c0fe6f0adbb tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "853bd672-97af-4e36-9bd4-5cc428b83765" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.115s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:17 user nova-compute[73497]: DEBUG nova.compute.manager [req-2dabb8c3-a3f2-4008-86d4-0548d835d7cd req-6f6001ad-1655-4c77-ae0d-5b47425dd0cc service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Received event network-changed-8d982123-d2ef-4d00-95d1-bee24f228175 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:29:17 user nova-compute[73497]: DEBUG nova.compute.manager [req-2dabb8c3-a3f2-4008-86d4-0548d835d7cd req-6f6001ad-1655-4c77-ae0d-5b47425dd0cc service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Refreshing instance network info cache due to event network-changed-8d982123-d2ef-4d00-95d1-bee24f228175. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:29:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2dabb8c3-a3f2-4008-86d4-0548d835d7cd req-6f6001ad-1655-4c77-ae0d-5b47425dd0cc service nova] Acquiring lock "refresh_cache-e15ddee6-a642-4638-9534-21e640b3d017" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:29:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2dabb8c3-a3f2-4008-86d4-0548d835d7cd req-6f6001ad-1655-4c77-ae0d-5b47425dd0cc service nova] Acquired lock "refresh_cache-e15ddee6-a642-4638-9534-21e640b3d017" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:29:17 user nova-compute[73497]: DEBUG nova.network.neutron [req-2dabb8c3-a3f2-4008-86d4-0548d835d7cd req-6f6001ad-1655-4c77-ae0d-5b47425dd0cc service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Refreshing network info cache for port 8d982123-d2ef-4d00-95d1-bee24f228175 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:29:17 user nova-compute[73497]: DEBUG nova.network.neutron [req-2dabb8c3-a3f2-4008-86d4-0548d835d7cd req-6f6001ad-1655-4c77-ae0d-5b47425dd0cc service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Updated VIF entry in instance network info cache for port 8d982123-d2ef-4d00-95d1-bee24f228175. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:29:17 user nova-compute[73497]: DEBUG nova.network.neutron [req-2dabb8c3-a3f2-4008-86d4-0548d835d7cd req-6f6001ad-1655-4c77-ae0d-5b47425dd0cc service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Updating instance_info_cache with network_info: [{"id": "8d982123-d2ef-4d00-95d1-bee24f228175", "address": "fa:16:3e:e8:ce:24", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d982123-d2", "ovs_interfaceid": "8d982123-d2ef-4d00-95d1-bee24f228175", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:29:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2dabb8c3-a3f2-4008-86d4-0548d835d7cd req-6f6001ad-1655-4c77-ae0d-5b47425dd0cc service nova] Releasing lock "refresh_cache-e15ddee6-a642-4638-9534-21e640b3d017" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:29:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "e15ddee6-a642-4638-9534-21e640b3d017" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "e15ddee6-a642-4638-9534-21e640b3d017" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:18 user nova-compute[73497]: DEBUG nova.objects.instance [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lazy-loading 'flavor' on Instance uuid e15ddee6-a642-4638-9534-21e640b3d017 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:29:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "e15ddee6-a642-4638-9534-21e640b3d017" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "e15ddee6-a642-4638-9534-21e640b3d017" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "e15ddee6-a642-4638-9534-21e640b3d017" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:18 user nova-compute[73497]: INFO nova.compute.manager [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Attaching volume c8aa603f-2da2-4539-8010-8eb3eb6fcb13 to /dev/vdb
Aug 26 23:29:18 user nova-compute[73497]: DEBUG os_brick.utils [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:29:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eafb9c0-b69c-41ab-9f72-0ad1e82ed7f8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:29:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d9a16f-4f7e-4c59-9071-5c099f5b1f04]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:29:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adfff38-4b90-46fd-b01b-887bcbea8fe3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:29:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[508295a6-35d0-412f-bfe2-7c7c09d49148]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:29:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:29:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:29:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:29:19 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:29:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca6d1c6-6346-4b74-ada9-32a303f213a1]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:29:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:29:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:29:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:29:19 user nova-compute[73497]: DEBUG os_brick.utils [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:29:19 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Updating existing volume attachment record: facfb988-3356-4ec3-a2e9-822e8699a713 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:29:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:25 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693092550.2037818, ed2c58fe-8d24-47ed-b5da-62e44e290901 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:29:25 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] VM Stopped (Lifecycle Event)
Aug 26 23:29:25 user nova-compute[73497]: DEBUG nova.compute.manager [None req-fbfc2caa-621e-4c0a-93ea-8d76f6b3a791 None None] [instance: ed2c58fe-8d24-47ed-b5da-62e44e290901] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:29:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Acquiring lock "e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:28 user nova-compute[73497]: DEBUG nova.compute.manager [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:29:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:28 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:29:28 user nova-compute[73497]: INFO nova.compute.claims [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Claim successful on node user
Aug 26 23:29:29 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:29:29 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:29:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.601s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:29 user nova-compute[73497]: DEBUG nova.compute.manager [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:29:29 user nova-compute[73497]: DEBUG nova.compute.manager [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:29:29 user nova-compute[73497]: DEBUG nova.network.neutron [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:29:29 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:29:29 user nova-compute[73497]: DEBUG nova.compute.manager [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:29:29 user nova-compute[73497]: DEBUG nova.policy [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec43dd42316042a4895706726866b103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '077c6c937fcc4d8d95eb66d8d7f87167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:29:29 user nova-compute[73497]: DEBUG nova.compute.manager [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:29:29 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:29:29 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Creating image(s)
Aug 26 23:29:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Acquiring lock "/opt/stack/data/nova/instances/e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "/opt/stack/data/nova/instances/e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "/opt/stack/data/nova/instances/e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.197s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.188s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7/disk 1073741824" returned: 0 in 0.065s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.199s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:30 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:29:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:30 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Cannot resize image /opt/stack/data/nova/instances/e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:29:30 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:29:30 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Ensure instance console log exists: /opt/stack/data/nova/instances/e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:29:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:30 user nova-compute[73497]: DEBUG nova.network.neutron [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Successfully created port: 8e3698bc-dd93-41f1-a767-c634e383a1cb {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG nova.network.neutron [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Successfully updated port: 8e3698bc-dd93-41f1-a767-c634e383a1cb {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Acquiring lock "refresh_cache-e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Acquired lock "refresh_cache-e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG nova.network.neutron [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lIpBFJvH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:29:31 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:29:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:29:31 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:29:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:29:31 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG nova.compute.manager [req-bfc4b95b-d073-4de1-adba-3b858f8509e3 req-3422e035-1b50-4c4b-b281-0b1617ffecf3 service nova] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Received event network-changed-8e3698bc-dd93-41f1-a767-c634e383a1cb {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG nova.compute.manager [req-bfc4b95b-d073-4de1-adba-3b858f8509e3 req-3422e035-1b50-4c4b-b281-0b1617ffecf3 service nova] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Refreshing instance network info cache due to event network-changed-8e3698bc-dd93-41f1-a767-c634e383a1cb. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-bfc4b95b-d073-4de1-adba-3b858f8509e3 req-3422e035-1b50-4c4b-b281-0b1617ffecf3 service nova] Acquiring lock "refresh_cache-e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffad851b-4f6d-4e7b-a1de-e5b6b258093d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:29:31 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a167065a-527b-4411-afc3-9cef2a04bd59]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13] added
Aug 26 23:29:31 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG nova.network.neutron [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81724da-b953-4460-9642-bd6371482bc3]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3b44cb-e844-4d24-8d34-2e88891cb5d2]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lIpBFJvH {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lIpBFJvH" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afcd502-dd01-4e99-9f60-fcaef7e847b0]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lIpBFJvH'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d770661c-ed29-4159-a524-8f79c2a957e1]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[489fd8c8-548f-400f-bbda-b65ba0b82a5c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:29:31 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:29:31 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:29:31 user nova-compute[73497]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)
Aug 26 23:29:31 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:29:31 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:29:31 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:29:31 user nova-compute[73497]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)
Aug 26 23:29:31 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5bcab7d-4f1b-44b1-8e02-b1c15fc00df1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13, portal: 172.16.0.220,3260]
Aug 26 23:29:31 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13, portal: 172.16.0.220,3260] successful.
Aug 26 23:29:31 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa2d19d-d7de-4acd-b137-04531bbe898f]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45c6c67-b5ae-4998-9d0d-52875698dca3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:29:31 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:29:31 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:29:31 user nova-compute[73497]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)
Aug 26 23:29:31 user nova-compute[73497]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:29:31 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:29:31 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:29:31 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:29:31 user nova-compute[73497]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)
Aug 26 23:29:31 user nova-compute[73497]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:29:31 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] HCTL ('37', '-', '-', 0) found on session 35 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[426e0176-7863-4274-8941-9c398be6ab02]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lIpBFJvH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG nova.network.neutron [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Updating instance_info_cache with network_info: [{"id": "8e3698bc-dd93-41f1-a767-c634e383a1cb", "address": "fa:16:3e:67:db:0c", "network": {"id": "bc10efbc-a86e-4a1d-8a40-bc508dd2a6db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1634677403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "077c6c937fcc4d8d95eb66d8d7f87167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e3698bc-dd", "ovs_interfaceid": "8e3698bc-dd93-41f1-a767-c634e383a1cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Releasing lock "refresh_cache-e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG nova.compute.manager [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Instance network_info: |[{"id": "8e3698bc-dd93-41f1-a767-c634e383a1cb", "address": "fa:16:3e:67:db:0c", "network": {"id": "bc10efbc-a86e-4a1d-8a40-bc508dd2a6db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1634677403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "077c6c937fcc4d8d95eb66d8d7f87167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e3698bc-dd", "ovs_interfaceid": "8e3698bc-dd93-41f1-a767-c634e383a1cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-bfc4b95b-d073-4de1-adba-3b858f8509e3 req-3422e035-1b50-4c4b-b281-0b1617ffecf3 service nova] Acquired lock "refresh_cache-e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG nova.network.neutron [req-bfc4b95b-d073-4de1-adba-3b858f8509e3 req-3422e035-1b50-4c4b-b281-0b1617ffecf3 service nova] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Refreshing network info cache for port 8e3698bc-dd93-41f1-a767-c634e383a1cb {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Start _get_guest_xml network_info=[{"id": "8e3698bc-dd93-41f1-a767-c634e383a1cb", "address": "fa:16:3e:67:db:0c", "network": {"id": "bc10efbc-a86e-4a1d-8a40-bc508dd2a6db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1634677403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "077c6c937fcc4d8d95eb66d8d7f87167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e3698bc-dd", "ovs_interfaceid": "8e3698bc-dd93-41f1-a767-c634e383a1cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:29:31 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:29:31 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:29:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:29:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1335056796',display_name='tempest-VolumesSnapshotTestJSON-instance-1335056796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1335056796',id=36,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1uXwjtvIGLrJkHawjcGOI+SwB1jES2QTVb3HE0KFkz+Yuz59UEoprubug8vH7yjT2xnWs2izcfAAmyRqkW4AGyFo+lVlEUI0KWuFEJ+uWotCL5QBSEBUhLe4OJY7Pa3g==',key_name='tempest-keypair-1763687090',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='077c6c937fcc4d8d95eb66d8d7f87167',ramdisk_id='',reservation_id='r-z9lkaqj1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1128972653',owner_user_name='tempest-VolumesSnapshotTestJSON-1128972653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:29:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec43dd42316042a4895706726866b103',uuid=e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e3698bc-dd93-41f1-a767-c634e383a1cb", "address": "fa:16:3e:67:db:0c", "network": {"id": "bc10efbc-a86e-4a1d-8a40-bc508dd2a6db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1634677403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "077c6c937fcc4d8d95eb66d8d7f87167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e3698bc-dd", "ovs_interfaceid": "8e3698bc-dd93-41f1-a767-c634e383a1cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Converting VIF {"id": "8e3698bc-dd93-41f1-a767-c634e383a1cb", "address": "fa:16:3e:67:db:0c", "network": {"id": "bc10efbc-a86e-4a1d-8a40-bc508dd2a6db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1634677403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "077c6c937fcc4d8d95eb66d8d7f87167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e3698bc-dd", "ovs_interfaceid": "8e3698bc-dd93-41f1-a767-c634e383a1cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:db:0c,bridge_name='br-int',has_traffic_filtering=True,id=8e3698bc-dd93-41f1-a767-c634e383a1cb,network=Network(bc10efbc-a86e-4a1d-8a40-bc508dd2a6db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e3698bc-dd') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG nova.objects.instance [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lazy-loading 'pci_devices' on Instance uuid e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:29:31 user nova-compute[73497]:   <uuid>e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7</uuid>
Aug 26 23:29:31 user nova-compute[73497]:   <name>instance-00000024</name>
Aug 26 23:29:31 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:29:31 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:29:31 user nova-compute[73497]:   <metadata>
Aug 26 23:29:31 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:29:31 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:29:31 user nova-compute[73497]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1335056796</nova:name>
Aug 26 23:29:31 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:29:31</nova:creationTime>
Aug 26 23:29:31 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:29:31 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:29:31 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:29:31 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:29:31 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:29:31 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:29:31 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:29:31 user nova-compute[73497]:       <nova:owner>
Aug 26 23:29:31 user nova-compute[73497]:         <nova:user uuid="ec43dd42316042a4895706726866b103">tempest-VolumesSnapshotTestJSON-1128972653-project-member</nova:user>
Aug 26 23:29:31 user nova-compute[73497]:         <nova:project uuid="077c6c937fcc4d8d95eb66d8d7f87167">tempest-VolumesSnapshotTestJSON-1128972653</nova:project>
Aug 26 23:29:31 user nova-compute[73497]:       </nova:owner>
Aug 26 23:29:31 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:29:31 user nova-compute[73497]:       <nova:ports>
Aug 26 23:29:31 user nova-compute[73497]:         <nova:port uuid="8e3698bc-dd93-41f1-a767-c634e383a1cb">
Aug 26 23:29:31 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 23:29:31 user nova-compute[73497]:         </nova:port>
Aug 26 23:29:31 user nova-compute[73497]:       </nova:ports>
Aug 26 23:29:31 user nova-compute[73497]:     </nova:instance>
Aug 26 23:29:31 user nova-compute[73497]:   </metadata>
Aug 26 23:29:31 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:29:31 user nova-compute[73497]:     <system>
Aug 26 23:29:31 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:29:31 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:29:31 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:29:31 user nova-compute[73497]:       <entry name="serial">e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7</entry>
Aug 26 23:29:31 user nova-compute[73497]:       <entry name="uuid">e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7</entry>
Aug 26 23:29:31 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:29:31 user nova-compute[73497]:     </system>
Aug 26 23:29:31 user nova-compute[73497]:   </sysinfo>
Aug 26 23:29:31 user nova-compute[73497]:   <os>
Aug 26 23:29:31 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:29:31 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:29:31 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:29:31 user nova-compute[73497]:   </os>
Aug 26 23:29:31 user nova-compute[73497]:   <features>
Aug 26 23:29:31 user nova-compute[73497]:     <acpi/>
Aug 26 23:29:31 user nova-compute[73497]:     <apic/>
Aug 26 23:29:31 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:29:31 user nova-compute[73497]:   </features>
Aug 26 23:29:31 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:29:31 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:29:31 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:29:31 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:29:31 user nova-compute[73497]:   </clock>
Aug 26 23:29:31 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:29:31 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:29:31 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:29:31 user nova-compute[73497]:   </cpu>
Aug 26 23:29:31 user nova-compute[73497]:   <devices>
Aug 26 23:29:31 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:29:31 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:29:31 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7/disk"/>
Aug 26 23:29:31 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:29:31 user nova-compute[73497]:     </disk>
Aug 26 23:29:31 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:29:31 user nova-compute[73497]:       <mac address="fa:16:3e:67:db:0c"/>
Aug 26 23:29:31 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:29:31 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:29:31 user nova-compute[73497]:       <target dev="tap8e3698bc-dd"/>
Aug 26 23:29:31 user nova-compute[73497]:     </interface>
Aug 26 23:29:31 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:29:31 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7/console.log" append="off"/>
Aug 26 23:29:31 user nova-compute[73497]:     </serial>
Aug 26 23:29:31 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:29:31 user nova-compute[73497]:     <video>
Aug 26 23:29:31 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:29:31 user nova-compute[73497]:     </video>
Aug 26 23:29:31 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:29:31 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:29:31 user nova-compute[73497]:     </rng>
Aug 26 23:29:31 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:29:31 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:29:31 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:29:31 user nova-compute[73497]:     </memballoon>
Aug 26 23:29:31 user nova-compute[73497]:   </devices>
Aug 26 23:29:31 user nova-compute[73497]: </domain>
Aug 26 23:29:31 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:29:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1335056796',display_name='tempest-VolumesSnapshotTestJSON-instance-1335056796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1335056796',id=36,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1uXwjtvIGLrJkHawjcGOI+SwB1jES2QTVb3HE0KFkz+Yuz59UEoprubug8vH7yjT2xnWs2izcfAAmyRqkW4AGyFo+lVlEUI0KWuFEJ+uWotCL5QBSEBUhLe4OJY7Pa3g==',key_name='tempest-keypair-1763687090',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='077c6c937fcc4d8d95eb66d8d7f87167',ramdisk_id='',reservation_id='r-z9lkaqj1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1128972653',owner_user_name='tempest-VolumesSnapshotTestJSON-1128972653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:29:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec43dd42316042a4895706726866b103',uuid=e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e3698bc-dd93-41f1-a767-c634e383a1cb", "address": "fa:16:3e:67:db:0c", "network": {"id": "bc10efbc-a86e-4a1d-8a40-bc508dd2a6db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1634677403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "077c6c937fcc4d8d95eb66d8d7f87167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e3698bc-dd", "ovs_interfaceid": "8e3698bc-dd93-41f1-a767-c634e383a1cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Converting VIF {"id": "8e3698bc-dd93-41f1-a767-c634e383a1cb", "address": "fa:16:3e:67:db:0c", "network": {"id": "bc10efbc-a86e-4a1d-8a40-bc508dd2a6db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1634677403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "077c6c937fcc4d8d95eb66d8d7f87167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e3698bc-dd", "ovs_interfaceid": "8e3698bc-dd93-41f1-a767-c634e383a1cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:db:0c,bridge_name='br-int',has_traffic_filtering=True,id=8e3698bc-dd93-41f1-a767-c634e383a1cb,network=Network(bc10efbc-a86e-4a1d-8a40-bc508dd2a6db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e3698bc-dd') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG os_vif [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:db:0c,bridge_name='br-int',has_traffic_filtering=True,id=8e3698bc-dd93-41f1-a767-c634e383a1cb,network=Network(bc10efbc-a86e-4a1d-8a40-bc508dd2a6db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e3698bc-dd') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e3698bc-dd, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e3698bc-dd, col_values=(('external_ids', {'iface-id': '8e3698bc-dd93-41f1-a767-c634e383a1cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:db:0c', 'vm-uuid': 'e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:29:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:32 user nova-compute[73497]: INFO os_vif [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:db:0c,bridge_name='br-int',has_traffic_filtering=True,id=8e3698bc-dd93-41f1-a767-c634e383a1cb,network=Network(bc10efbc-a86e-4a1d-8a40-bc508dd2a6db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e3698bc-dd')
Aug 26 23:29:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:29:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] No VIF found with MAC fa:16:3e:67:db:0c, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:29:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:32 user nova-compute[73497]: DEBUG nova.network.neutron [req-bfc4b95b-d073-4de1-adba-3b858f8509e3 req-3422e035-1b50-4c4b-b281-0b1617ffecf3 service nova] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Updated VIF entry in instance network info cache for port 8e3698bc-dd93-41f1-a767-c634e383a1cb. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:29:32 user nova-compute[73497]: DEBUG nova.network.neutron [req-bfc4b95b-d073-4de1-adba-3b858f8509e3 req-3422e035-1b50-4c4b-b281-0b1617ffecf3 service nova] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Updating instance_info_cache with network_info: [{"id": "8e3698bc-dd93-41f1-a767-c634e383a1cb", "address": "fa:16:3e:67:db:0c", "network": {"id": "bc10efbc-a86e-4a1d-8a40-bc508dd2a6db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1634677403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "077c6c937fcc4d8d95eb66d8d7f87167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e3698bc-dd", "ovs_interfaceid": "8e3698bc-dd93-41f1-a767-c634e383a1cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:29:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-bfc4b95b-d073-4de1-adba-3b858f8509e3 req-3422e035-1b50-4c4b-b281-0b1617ffecf3 service nova] Releasing lock "refresh_cache-e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:29:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:29:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '23835363930386537', 'path': '/dev/sdf'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:29:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835363930386537', 'path': '/dev/sdf'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:29:32 user nova-compute[73497]: DEBUG nova.objects.instance [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lazy-loading 'flavor' on Instance uuid e15ddee6-a642-4638-9534-21e640b3d017 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:29:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 23:29:32 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:29:32 user nova-compute[73497]:   <source dev="/dev/sdf"/>
Aug 26 23:29:32 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:29:32 user nova-compute[73497]:   <serial>c8aa603f-2da2-4539-8010-8eb3eb6fcb13</serial>
Aug 26 23:29:32 user nova-compute[73497]: </disk>
Aug 26 23:29:32 user nova-compute[73497]:  {{(pid=73497) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 23:29:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:29:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:29:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] No VIF found with MAC fa:16:3e:e8:ce:24, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:29:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8af26d98-1dc4-4a05-876b-c005b98fd90a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "e15ddee6-a642-4638-9534-21e640b3d017" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.713s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-014961f2-b93f-4759-b4b7-f97ac5dfecdc req-6485b2e2-9608-49d8-b178-50573da22501 service nova] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Received event network-vif-plugged-8e3698bc-dd93-41f1-a767-c634e383a1cb {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:29:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-014961f2-b93f-4759-b4b7-f97ac5dfecdc req-6485b2e2-9608-49d8-b178-50573da22501 service nova] Acquiring lock "e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-014961f2-b93f-4759-b4b7-f97ac5dfecdc req-6485b2e2-9608-49d8-b178-50573da22501 service nova] Lock "e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-014961f2-b93f-4759-b4b7-f97ac5dfecdc req-6485b2e2-9608-49d8-b178-50573da22501 service nova] Lock "e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-014961f2-b93f-4759-b4b7-f97ac5dfecdc req-6485b2e2-9608-49d8-b178-50573da22501 service nova] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] No waiting events found dispatching network-vif-plugged-8e3698bc-dd93-41f1-a767-c634e383a1cb {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:29:33 user nova-compute[73497]: WARNING nova.compute.manager [req-014961f2-b93f-4759-b4b7-f97ac5dfecdc req-6485b2e2-9608-49d8-b178-50573da22501 service nova] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Received unexpected event network-vif-plugged-8e3698bc-dd93-41f1-a767-c634e383a1cb for instance with vm_state building and task_state spawning.
Aug 26 23:29:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:34 user nova-compute[73497]: INFO nova.compute.manager [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Rescuing
Aug 26 23:29:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "refresh_cache-e15ddee6-a642-4638-9534-21e640b3d017" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:29:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquired lock "refresh_cache-e15ddee6-a642-4638-9534-21e640b3d017" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:29:34 user nova-compute[73497]: DEBUG nova.network.neutron [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:29:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:34 user nova-compute[73497]: DEBUG nova.network.neutron [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Updating instance_info_cache with network_info: [{"id": "8d982123-d2ef-4d00-95d1-bee24f228175", "address": "fa:16:3e:e8:ce:24", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d982123-d2", "ovs_interfaceid": "8d982123-d2ef-4d00-95d1-bee24f228175", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:29:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Releasing lock "refresh_cache-e15ddee6-a642-4638-9534-21e640b3d017" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:29:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:35 user nova-compute[73497]: DEBUG nova.compute.manager [req-e9843402-4237-4b04-8efb-58e0ef6ad47a req-9e4347d5-617d-4dee-8e7c-3e5d7dc7d8fe service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Received event network-vif-unplugged-8d982123-d2ef-4d00-95d1-bee24f228175 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:29:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-e9843402-4237-4b04-8efb-58e0ef6ad47a req-9e4347d5-617d-4dee-8e7c-3e5d7dc7d8fe service nova] Acquiring lock "e15ddee6-a642-4638-9534-21e640b3d017-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-e9843402-4237-4b04-8efb-58e0ef6ad47a req-9e4347d5-617d-4dee-8e7c-3e5d7dc7d8fe service nova] Lock "e15ddee6-a642-4638-9534-21e640b3d017-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-e9843402-4237-4b04-8efb-58e0ef6ad47a req-9e4347d5-617d-4dee-8e7c-3e5d7dc7d8fe service nova] Lock "e15ddee6-a642-4638-9534-21e640b3d017-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:35 user nova-compute[73497]: DEBUG nova.compute.manager [req-e9843402-4237-4b04-8efb-58e0ef6ad47a req-9e4347d5-617d-4dee-8e7c-3e5d7dc7d8fe service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] No waiting events found dispatching network-vif-unplugged-8d982123-d2ef-4d00-95d1-bee24f228175 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:29:35 user nova-compute[73497]: WARNING nova.compute.manager [req-e9843402-4237-4b04-8efb-58e0ef6ad47a req-9e4347d5-617d-4dee-8e7c-3e5d7dc7d8fe service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Received unexpected event network-vif-unplugged-8d982123-d2ef-4d00-95d1-bee24f228175 for instance with vm_state active and task_state rescuing.
Aug 26 23:29:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:35 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Instance destroyed successfully.
Aug 26 23:29:35 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Attempting rescue
Aug 26 23:29:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73497) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 23:29:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Instance directory exists: not creating {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 23:29:35 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Creating image(s)
Aug 26 23:29:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "/opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "/opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "/opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:35 user nova-compute[73497]: DEBUG nova.objects.instance [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lazy-loading 'trusted_certs' on Instance uuid e15ddee6-a642-4638-9534-21e640b3d017 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:29:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.179s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk.rescue {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.compute.manager [req-ff64d0b8-893e-43ad-bfb6-aab2d205c2b2 req-fa05cc9d-82bd-4a80-8ee0-826b6f5a190b service nova] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Received event network-vif-plugged-8e3698bc-dd93-41f1-a767-c634e383a1cb {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ff64d0b8-893e-43ad-bfb6-aab2d205c2b2 req-fa05cc9d-82bd-4a80-8ee0-826b6f5a190b service nova] Acquiring lock "e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ff64d0b8-893e-43ad-bfb6-aab2d205c2b2 req-fa05cc9d-82bd-4a80-8ee0-826b6f5a190b service nova] Lock "e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ff64d0b8-893e-43ad-bfb6-aab2d205c2b2 req-fa05cc9d-82bd-4a80-8ee0-826b6f5a190b service nova] Lock "e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.compute.manager [req-ff64d0b8-893e-43ad-bfb6-aab2d205c2b2 req-fa05cc9d-82bd-4a80-8ee0-826b6f5a190b service nova] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] No waiting events found dispatching network-vif-plugged-8e3698bc-dd93-41f1-a767-c634e383a1cb {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:29:36 user nova-compute[73497]: WARNING nova.compute.manager [req-ff64d0b8-893e-43ad-bfb6-aab2d205c2b2 req-fa05cc9d-82bd-4a80-8ee0-826b6f5a190b service nova] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Received unexpected event network-vif-plugged-8e3698bc-dd93-41f1-a767-c634e383a1cb for instance with vm_state building and task_state spawning.
Aug 26 23:29:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk.rescue" returned: 0 in 0.056s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.objects.instance [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lazy-loading 'migration_context' on Instance uuid e15ddee6-a642-4638-9534-21e640b3d017 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.objects.base [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Object Instance<e15ddee6-a642-4638-9534-21e640b3d017> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Start _get_guest_xml network_info=[{"id": "8d982123-d2ef-4d00-95d1-bee24f228175", "address": "fa:16:3e:e8:ce:24", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "vif_mac": "fa:16:3e:e8:ce:24"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d982123-d2", "ovs_interfaceid": "8d982123-d2ef-4d00-95d1-bee24f228175", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.objects.instance [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lazy-loading 'resources' on Instance uuid e15ddee6-a642-4638-9534-21e640b3d017 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.objects.base [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Object Instance<e15ddee6-a642-4638-9534-21e640b3d017> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.objects.instance [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lazy-loading 'numa_topology' on Instance uuid e15ddee6-a642-4638-9534-21e640b3d017 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092576.1493065, e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:29:36 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] VM Resumed (Lifecycle Event)
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.objects.base [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Object Instance<e15ddee6-a642-4638-9534-21e640b3d017> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.compute.manager [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:29:36 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Instance spawned successfully.
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:29:36 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:29:36 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.objects.instance [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lazy-loading 'vcpu_model' on Instance uuid e15ddee6-a642-4638-9534-21e640b3d017 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:29:36 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092576.1599882, e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:29:36 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] VM Started (Lifecycle Event)
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.objects.base [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Object Instance<e15ddee6-a642-4638-9534-21e640b3d017> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:27:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-493508388',display_name='tempest-ServerRescueNegativeTestJSON-server-493508388',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-493508388',id=33,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINj3seD7LQAkaX0wYOG1fS3idoL99uw4+1lVHlG8bZ0rOjqkGpGnEUfwVCpDQwjz4kP4hFSLF4r/El5/40r8+otqhjInnqtJnBnHrwpLdvAuBQM4cvraqsvSlrODkbriA==',key_name='tempest-keypair-198397446',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:27:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c4ca787dd33440d98779668507369ee',ramdisk_id='',reservation_id='r-on4mu606',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1946187856',owner_user_name='tempest-ServerRescueNegativeTestJSON-1946187856-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:27:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='af64aa253eec41a0976c3e527fe41831',uuid=e15ddee6-a642-4638-9534-21e640b3d017,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d982123-d2ef-4d00-95d1-bee24f228175", "address": "fa:16:3e:e8:ce:24", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "vif_mac": "fa:16:3e:e8:ce:24"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d982123-d2", "ovs_interfaceid": "8d982123-d2ef-4d00-95d1-bee24f228175", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Converting VIF {"id": "8d982123-d2ef-4d00-95d1-bee24f228175", "address": "fa:16:3e:e8:ce:24", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "vif_mac": "fa:16:3e:e8:ce:24"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d982123-d2", "ovs_interfaceid": "8d982123-d2ef-4d00-95d1-bee24f228175", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:ce:24,bridge_name='br-int',has_traffic_filtering=True,id=8d982123-d2ef-4d00-95d1-bee24f228175,network=Network(6f13f07f-104d-4d8d-b5fa-afa402402a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d982123-d2') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.objects.instance [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lazy-loading 'pci_devices' on Instance uuid e15ddee6-a642-4638-9534-21e640b3d017 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.objects.base [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Object Instance<e15ddee6-a642-4638-9534-21e640b3d017> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:29:36 user nova-compute[73497]:   <uuid>e15ddee6-a642-4638-9534-21e640b3d017</uuid>
Aug 26 23:29:36 user nova-compute[73497]:   <name>instance-00000021</name>
Aug 26 23:29:36 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:29:36 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:29:36 user nova-compute[73497]:   <metadata>
Aug 26 23:29:36 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:29:36 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:29:36 user nova-compute[73497]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-493508388</nova:name>
Aug 26 23:29:36 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:29:36</nova:creationTime>
Aug 26 23:29:36 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:29:36 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:29:36 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:29:36 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:29:36 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:29:36 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:29:36 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:29:36 user nova-compute[73497]:       <nova:owner>
Aug 26 23:29:36 user nova-compute[73497]:         <nova:user uuid="af64aa253eec41a0976c3e527fe41831">tempest-ServerRescueNegativeTestJSON-1946187856-project-member</nova:user>
Aug 26 23:29:36 user nova-compute[73497]:         <nova:project uuid="0c4ca787dd33440d98779668507369ee">tempest-ServerRescueNegativeTestJSON-1946187856</nova:project>
Aug 26 23:29:36 user nova-compute[73497]:       </nova:owner>
Aug 26 23:29:36 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:29:36 user nova-compute[73497]:       <nova:ports>
Aug 26 23:29:36 user nova-compute[73497]:         <nova:port uuid="8d982123-d2ef-4d00-95d1-bee24f228175">
Aug 26 23:29:36 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 23:29:36 user nova-compute[73497]:         </nova:port>
Aug 26 23:29:36 user nova-compute[73497]:       </nova:ports>
Aug 26 23:29:36 user nova-compute[73497]:     </nova:instance>
Aug 26 23:29:36 user nova-compute[73497]:   </metadata>
Aug 26 23:29:36 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:29:36 user nova-compute[73497]:     <system>
Aug 26 23:29:36 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:29:36 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:29:36 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:29:36 user nova-compute[73497]:       <entry name="serial">e15ddee6-a642-4638-9534-21e640b3d017</entry>
Aug 26 23:29:36 user nova-compute[73497]:       <entry name="uuid">e15ddee6-a642-4638-9534-21e640b3d017</entry>
Aug 26 23:29:36 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:29:36 user nova-compute[73497]:     </system>
Aug 26 23:29:36 user nova-compute[73497]:   </sysinfo>
Aug 26 23:29:36 user nova-compute[73497]:   <os>
Aug 26 23:29:36 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:29:36 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:29:36 user nova-compute[73497]:   </os>
Aug 26 23:29:36 user nova-compute[73497]:   <features>
Aug 26 23:29:36 user nova-compute[73497]:     <acpi/>
Aug 26 23:29:36 user nova-compute[73497]:     <apic/>
Aug 26 23:29:36 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:29:36 user nova-compute[73497]:   </features>
Aug 26 23:29:36 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:29:36 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:29:36 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:29:36 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:29:36 user nova-compute[73497]:   </clock>
Aug 26 23:29:36 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:29:36 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:29:36 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:29:36 user nova-compute[73497]:   </cpu>
Aug 26 23:29:36 user nova-compute[73497]:   <devices>
Aug 26 23:29:36 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:29:36 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:29:36 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk.rescue"/>
Aug 26 23:29:36 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:29:36 user nova-compute[73497]:     </disk>
Aug 26 23:29:36 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:29:36 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:29:36 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk"/>
Aug 26 23:29:36 user nova-compute[73497]:       <target dev="vdb" bus="virtio"/>
Aug 26 23:29:36 user nova-compute[73497]:     </disk>
Aug 26 23:29:36 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:29:36 user nova-compute[73497]:       <mac address="fa:16:3e:e8:ce:24"/>
Aug 26 23:29:36 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:29:36 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:29:36 user nova-compute[73497]:       <target dev="tap8d982123-d2"/>
Aug 26 23:29:36 user nova-compute[73497]:     </interface>
Aug 26 23:29:36 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:29:36 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/console.log" append="off"/>
Aug 26 23:29:36 user nova-compute[73497]:     </serial>
Aug 26 23:29:36 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:29:36 user nova-compute[73497]:     <video>
Aug 26 23:29:36 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:29:36 user nova-compute[73497]:     </video>
Aug 26 23:29:36 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:29:36 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:29:36 user nova-compute[73497]:     </rng>
Aug 26 23:29:36 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:29:36 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:29:36 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:29:36 user nova-compute[73497]:     </memballoon>
Aug 26 23:29:36 user nova-compute[73497]:   </devices>
Aug 26 23:29:36 user nova-compute[73497]: </domain>
Aug 26 23:29:36 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:29:36 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Instance destroyed successfully.
Aug 26 23:29:36 user nova-compute[73497]: INFO nova.compute.manager [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Took 6.79 seconds to spawn the instance on the hypervisor.
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.compute.manager [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:29:36 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] No VIF found with MAC fa:16:3e:e8:ce:24, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:29:36 user nova-compute[73497]: INFO nova.compute.manager [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Took 7.74 seconds to build instance.
Aug 26 23:29:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-83296ee3-8a53-482c-95a7-2045bcda9ee4 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.837s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:37 user nova-compute[73497]: DEBUG nova.compute.manager [req-250c4ced-4fff-4dd8-b319-5c7ec440f535 req-aec0267b-b28a-474a-ac8a-a02a0548d3f0 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Received event network-vif-plugged-8d982123-d2ef-4d00-95d1-bee24f228175 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:29:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-250c4ced-4fff-4dd8-b319-5c7ec440f535 req-aec0267b-b28a-474a-ac8a-a02a0548d3f0 service nova] Acquiring lock "e15ddee6-a642-4638-9534-21e640b3d017-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-250c4ced-4fff-4dd8-b319-5c7ec440f535 req-aec0267b-b28a-474a-ac8a-a02a0548d3f0 service nova] Lock "e15ddee6-a642-4638-9534-21e640b3d017-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-250c4ced-4fff-4dd8-b319-5c7ec440f535 req-aec0267b-b28a-474a-ac8a-a02a0548d3f0 service nova] Lock "e15ddee6-a642-4638-9534-21e640b3d017-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:37 user nova-compute[73497]: DEBUG nova.compute.manager [req-250c4ced-4fff-4dd8-b319-5c7ec440f535 req-aec0267b-b28a-474a-ac8a-a02a0548d3f0 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] No waiting events found dispatching network-vif-plugged-8d982123-d2ef-4d00-95d1-bee24f228175 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:29:37 user nova-compute[73497]: WARNING nova.compute.manager [req-250c4ced-4fff-4dd8-b319-5c7ec440f535 req-aec0267b-b28a-474a-ac8a-a02a0548d3f0 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Received unexpected event network-vif-plugged-8d982123-d2ef-4d00-95d1-bee24f228175 for instance with vm_state active and task_state rescuing.
Aug 26 23:29:37 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_power_states {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:29:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Triggering sync for uuid 994093f0-e6b2-4c96-b259-c559ef2b1fbc {{(pid=73497) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Triggering sync for uuid 171985a3-358d-4b26-a66c-372b9b99b386 {{(pid=73497) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Triggering sync for uuid aebaeda6-23d1-43a1-afc8-bdc8992067e5 {{(pid=73497) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Triggering sync for uuid 043294e5-0618-4a31-bb19-1227ef1f5d39 {{(pid=73497) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Triggering sync for uuid e9e5c83f-0678-48d4-a81f-1a3f959aabcf {{(pid=73497) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Triggering sync for uuid c601f97e-9e52-40c6-9085-45f38e709721 {{(pid=73497) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Triggering sync for uuid c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c {{(pid=73497) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Triggering sync for uuid 40afa348-8391-4643-977c-e67eab5c9476 {{(pid=73497) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Triggering sync for uuid f7c83073-fadc-4e41-a4a9-df0bbe11aa28 {{(pid=73497) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Triggering sync for uuid e15ddee6-a642-4638-9534-21e640b3d017 {{(pid=73497) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Triggering sync for uuid b7506745-ace5-45e2-bc1d-883f2c51f1c4 {{(pid=73497) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Triggering sync for uuid 853bd672-97af-4e36-9bd4-5cc428b83765 {{(pid=73497) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Triggering sync for uuid e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7 {{(pid=73497) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "994093f0-e6b2-4c96-b259-c559ef2b1fbc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "994093f0-e6b2-4c96-b259-c559ef2b1fbc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "171985a3-358d-4b26-a66c-372b9b99b386" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "171985a3-358d-4b26-a66c-372b9b99b386" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "043294e5-0618-4a31-bb19-1227ef1f5d39" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "043294e5-0618-4a31-bb19-1227ef1f5d39" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "c601f97e-9e52-40c6-9085-45f38e709721" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "c601f97e-9e52-40c6-9085-45f38e709721" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "40afa348-8391-4643-977c-e67eab5c9476" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "40afa348-8391-4643-977c-e67eab5c9476" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "e15ddee6-a642-4638-9534-21e640b3d017" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "e15ddee6-a642-4638-9534-21e640b3d017" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:38 user nova-compute[73497]: INFO nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: e15ddee6-a642-4638-9534-21e640b3d017] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "e15ddee6-a642-4638-9534-21e640b3d017" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "853bd672-97af-4e36-9bd4-5cc428b83765" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "853bd672-97af-4e36-9bd4-5cc428b83765" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "171985a3-358d-4b26-a66c-372b9b99b386" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "994093f0-e6b2-4c96-b259-c559ef2b1fbc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "043294e5-0618-4a31-bb19-1227ef1f5d39" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "c601f97e-9e52-40c6-9085-45f38e709721" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "40afa348-8391-4643-977c-e67eab5c9476" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.116s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.126s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "853bd672-97af-4e36-9bd4-5cc428b83765" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.124s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.127s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:39 user nova-compute[73497]: DEBUG nova.compute.manager [req-265b18d5-44db-4964-a487-644fa9bc628a req-40f72429-8e98-4951-851d-2cfbadcd1f68 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Received event network-vif-plugged-8d982123-d2ef-4d00-95d1-bee24f228175 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:29:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-265b18d5-44db-4964-a487-644fa9bc628a req-40f72429-8e98-4951-851d-2cfbadcd1f68 service nova] Acquiring lock "e15ddee6-a642-4638-9534-21e640b3d017-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-265b18d5-44db-4964-a487-644fa9bc628a req-40f72429-8e98-4951-851d-2cfbadcd1f68 service nova] Lock "e15ddee6-a642-4638-9534-21e640b3d017-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-265b18d5-44db-4964-a487-644fa9bc628a req-40f72429-8e98-4951-851d-2cfbadcd1f68 service nova] Lock "e15ddee6-a642-4638-9534-21e640b3d017-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:39 user nova-compute[73497]: DEBUG nova.compute.manager [req-265b18d5-44db-4964-a487-644fa9bc628a req-40f72429-8e98-4951-851d-2cfbadcd1f68 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] No waiting events found dispatching network-vif-plugged-8d982123-d2ef-4d00-95d1-bee24f228175 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:29:39 user nova-compute[73497]: WARNING nova.compute.manager [req-265b18d5-44db-4964-a487-644fa9bc628a req-40f72429-8e98-4951-851d-2cfbadcd1f68 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Received unexpected event network-vif-plugged-8d982123-d2ef-4d00-95d1-bee24f228175 for instance with vm_state active and task_state rescuing.
Aug 26 23:29:39 user nova-compute[73497]: DEBUG nova.compute.manager [req-265b18d5-44db-4964-a487-644fa9bc628a req-40f72429-8e98-4951-851d-2cfbadcd1f68 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Received event network-vif-plugged-8d982123-d2ef-4d00-95d1-bee24f228175 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:29:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-265b18d5-44db-4964-a487-644fa9bc628a req-40f72429-8e98-4951-851d-2cfbadcd1f68 service nova] Acquiring lock "e15ddee6-a642-4638-9534-21e640b3d017-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-265b18d5-44db-4964-a487-644fa9bc628a req-40f72429-8e98-4951-851d-2cfbadcd1f68 service nova] Lock "e15ddee6-a642-4638-9534-21e640b3d017-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-265b18d5-44db-4964-a487-644fa9bc628a req-40f72429-8e98-4951-851d-2cfbadcd1f68 service nova] Lock "e15ddee6-a642-4638-9534-21e640b3d017-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:39 user nova-compute[73497]: DEBUG nova.compute.manager [req-265b18d5-44db-4964-a487-644fa9bc628a req-40f72429-8e98-4951-851d-2cfbadcd1f68 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] No waiting events found dispatching network-vif-plugged-8d982123-d2ef-4d00-95d1-bee24f228175 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:29:39 user nova-compute[73497]: WARNING nova.compute.manager [req-265b18d5-44db-4964-a487-644fa9bc628a req-40f72429-8e98-4951-851d-2cfbadcd1f68 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Received unexpected event network-vif-plugged-8d982123-d2ef-4d00-95d1-bee24f228175 for instance with vm_state active and task_state rescuing.
Aug 26 23:29:40 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Removed pending event for e15ddee6-a642-4638-9534-21e640b3d017 due to event {{(pid=73497) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 23:29:40 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092580.1046045, e15ddee6-a642-4638-9534-21e640b3d017 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:29:40 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e15ddee6-a642-4638-9534-21e640b3d017] VM Resumed (Lifecycle Event)
Aug 26 23:29:40 user nova-compute[73497]: DEBUG nova.compute.manager [None req-3614309c-eb95-4a58-b4f8-79d0638f7f2e tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:29:40 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:29:40 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:29:40 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e15ddee6-a642-4638-9534-21e640b3d017] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 23:29:40 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092580.1100962, e15ddee6-a642-4638-9534-21e640b3d017 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:29:40 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e15ddee6-a642-4638-9534-21e640b3d017] VM Started (Lifecycle Event)
Aug 26 23:29:40 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:29:40 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:29:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:45 user nova-compute[73497]: DEBUG nova.objects.instance [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lazy-loading 'flavor' on Instance uuid f7c83073-fadc-4e41-a4a9-df0bbe11aa28 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:29:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "refresh_cache-f7c83073-fadc-4e41-a4a9-df0bbe11aa28" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:29:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquired lock "refresh_cache-f7c83073-fadc-4e41-a4a9-df0bbe11aa28" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:29:45 user nova-compute[73497]: DEBUG nova.network.neutron [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:29:45 user nova-compute[73497]: DEBUG nova.objects.instance [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lazy-loading 'info_cache' on Instance uuid f7c83073-fadc-4e41-a4a9-df0bbe11aa28 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:29:45 user nova-compute[73497]: DEBUG nova.objects.base [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Object Instance<f7c83073-fadc-4e41-a4a9-df0bbe11aa28> lazy-loaded attributes: flavor,info_cache {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG nova.network.neutron [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Updating instance_info_cache with network_info: [{"id": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "address": "fa:16:3e:cf:bd:9e", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74cddf0f-c3", "ovs_interfaceid": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Releasing lock "refresh_cache-f7c83073-fadc-4e41-a4a9-df0bbe11aa28" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:29:46 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Instance destroyed successfully.
Aug 26 23:29:46 user nova-compute[73497]: DEBUG nova.objects.instance [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lazy-loading 'resources' on Instance uuid f7c83073-fadc-4e41-a4a9-df0bbe11aa28 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG nova.objects.base [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Object Instance<f7c83073-fadc-4e41-a4a9-df0bbe11aa28> lazy-loaded attributes: flavor,info_cache,resources {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:25:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1284261730',display_name='tempest-AttachVolumeTestJSON-server-1284261730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1284261730',id=31,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtZgj4CGRRq60nfzAmpM6NX6cbyiNr74c5vhKfLzmguuh54ComCQsitet6gqTOyy+exSU8a+OQZBMej3fWkPoWF9yZ7g9PDakdqjlJxgeAQgaLAVOiZs3e4Hh+0HK9qHg==',key_name='tempest-keypair-1578893874',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:25:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e10f2d1336284b42a8dcbb05e509e9bd',ramdisk_id='',reservation_id='r-awwb3svr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1929388969',owner_user_name='tempest-AttachVolumeTestJSON-1929388969-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:27:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e2c1f8d06854e579ee634e33e6de920',uuid=f7c83073-fadc-4e41-a4a9-df0bbe11aa28,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "address": "fa:16:3e:cf:bd:9e", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74cddf0f-c3", "ovs_interfaceid": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Converting VIF {"id": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "address": "fa:16:3e:cf:bd:9e", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74cddf0f-c3", "ovs_interfaceid": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:bd:9e,bridge_name='br-int',has_traffic_filtering=True,id=74cddf0f-c302-4ae4-8142-cee5764c7c4f,network=Network(77d468df-32fe-45fb-afe7-7ebf9b6b428f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74cddf0f-c3') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG os_vif [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:bd:9e,bridge_name='br-int',has_traffic_filtering=True,id=74cddf0f-c302-4ae4-8142-cee5764c7c4f,network=Network(77d468df-32fe-45fb-afe7-7ebf9b6b428f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74cddf0f-c3') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74cddf0f-c3, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:46 user nova-compute[73497]: INFO os_vif [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:bd:9e,bridge_name='br-int',has_traffic_filtering=True,id=74cddf0f-c302-4ae4-8142-cee5764c7c4f,network=Network(77d468df-32fe-45fb-afe7-7ebf9b6b428f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74cddf0f-c3')
Aug 26 23:29:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YGgkMVsT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:29:46 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:29:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9d1b3d-bb55-4a34-b95d-232853c52573]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[beea0471-17e5-4978-920b-c71aad9494c8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:29:46 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:29:46 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:29:46 user nova-compute[73497]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)
Aug 26 23:29:46 user nova-compute[73497]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:29:46 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:29:46 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:29:46 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:29:46 user nova-compute[73497]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)
Aug 26 23:29:46 user nova-compute[73497]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:29:46 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281c4c1480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177'): ({'sde'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Removing single pathed devices sde {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5c503d-91d1-40dc-b035-7740decf0c9e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d738cb-1bb6-4b90-a293-4d9d8fc93d12]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Flushing IO for device /dev/sde {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5df2fa-d503-4651-96c8-0c5a9b5e6e68]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc0ba39-444c-4575-8183-6aa0e8e53ba3]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] SCSI volumes sde have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dfcfac-81c2-49b2-ada8-5000a99cd747]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f07fcb1-7e11-42d9-9430-48f3b02eacaf]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177, portal: 172.16.0.220,3260]
Aug 26 23:29:46 user nova-compute[73497]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177, portal: 172.16.0.220,3260] successful.
Aug 26 23:29:46 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c9e288-25b4-408c-b601-3d7957b215fb]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] <== disconnect_volume: return (313ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Start _get_guest_xml network_info=[{"id": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "address": "fa:16:3e:cf:bd:9e", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74cddf0f-c3", "ovs_interfaceid": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a1c188e9-159d-4e95-afe7-1b13f4100169', 'guest_format': None, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YGgkMVsT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'f7c83073-fadc-4e41-a4a9-df0bbe11aa28', 'attached_at': '', 'detached_at': '', 'volume_id': '12c35c25-ba0c-408b-b188-7fc38a5c9177', 'serial': '12c35c25-ba0c-408b-b188-7fc38a5c9177'}, 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG nova.objects.instance [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lazy-loading 'numa_topology' on Instance uuid f7c83073-fadc-4e41-a4a9-df0bbe11aa28 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG nova.objects.base [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Object Instance<f7c83073-fadc-4e41-a4a9-df0bbe11aa28> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:29:46 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:29:46 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:29:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG nova.objects.instance [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lazy-loading 'vcpu_model' on Instance uuid f7c83073-fadc-4e41-a4a9-df0bbe11aa28 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG nova.objects.base [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Object Instance<f7c83073-fadc-4e41-a4a9-df0bbe11aa28> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YGgkMVsT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:29:46 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:29:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:29:46 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:29:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:29:46 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b742834-defd-4432-aeb9-5ffab51dab2b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:29:46 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65af03f-c96f-45dc-8eb0-9a1be5e1ba5e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177] added
Aug 26 23:29:46 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e7813c-71ff-48b3-9f1b-68203e91023d]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b6753a-3c74-4644-b8a9-28e1867a6e78]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YGgkMVsT {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YGgkMVsT" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9140f743-46b1-487c-8399-9fd30e06c62a]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YGgkMVsT'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ed2711-4a66-4ba5-a5f3-18f6a31503a5]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:29:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:29:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:47 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[155a641d-fe7f-4213-931e-3c54d7a8bfe6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:29:47 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:29:47 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:29:47 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:29:47 user nova-compute[73497]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:29:47 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:29:47 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:29:47 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:29:47 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:29:47 user nova-compute[73497]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:29:47 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:29:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:47 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb1c62f-4073-48e3-b09b-14e24f8d5e2a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:29:47 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177, portal: 172.16.0.220,3260]
Aug 26 23:29:47 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177, portal: 172.16.0.220,3260] successful.
Aug 26 23:29:47 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:29:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:47 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f96c80a-b2b1-4f74-ae82-252132891447]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:29:47 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:29:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:47 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebd530f-1180-4236-8b5d-3630ca13fc0f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:29:47 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:29:47 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:29:47 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:29:47 user nova-compute[73497]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:29:47 user nova-compute[73497]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)
Aug 26 23:29:47 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:29:47 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:29:47 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:29:47 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:29:47 user nova-compute[73497]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:29:47 user nova-compute[73497]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)
Aug 26 23:29:47 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:29:47 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:29:47 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:29:47 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:29:47 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:29:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:47 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[be19f1f9-8ade-48b6-abbf-3eba64ef4ef7]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:29:47 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: None {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:29:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:48 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:29:48 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YGgkMVsT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:29:48 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:29:48 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23261646161333233', 'path': '/dev/sde'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:29:48 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261646161333233', 'path': '/dev/sde'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:29:48 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:25:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1284261730',display_name='tempest-AttachVolumeTestJSON-server-1284261730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1284261730',id=31,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtZgj4CGRRq60nfzAmpM6NX6cbyiNr74c5vhKfLzmguuh54ComCQsitet6gqTOyy+exSU8a+OQZBMej3fWkPoWF9yZ7g9PDakdqjlJxgeAQgaLAVOiZs3e4Hh+0HK9qHg==',key_name='tempest-keypair-1578893874',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:25:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e10f2d1336284b42a8dcbb05e509e9bd',ramdisk_id='',reservation_id='r-awwb3svr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1929388969',owner_user_name='tempest-AttachVolumeTestJSON-1929388969-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:27:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e2c1f8d06854e579ee634e33e6de920',uuid=f7c83073-fadc-4e41-a4a9-df0bbe11aa28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "address": "fa:16:3e:cf:bd:9e", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74cddf0f-c3", "ovs_interfaceid": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:29:48 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Converting VIF {"id": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "address": "fa:16:3e:cf:bd:9e", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74cddf0f-c3", "ovs_interfaceid": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:29:48 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:bd:9e,bridge_name='br-int',has_traffic_filtering=True,id=74cddf0f-c302-4ae4-8142-cee5764c7c4f,network=Network(77d468df-32fe-45fb-afe7-7ebf9b6b428f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74cddf0f-c3') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:29:48 user nova-compute[73497]: DEBUG nova.objects.instance [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lazy-loading 'pci_devices' on Instance uuid f7c83073-fadc-4e41-a4a9-df0bbe11aa28 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:29:48 user nova-compute[73497]: DEBUG nova.objects.base [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Object Instance<f7c83073-fadc-4e41-a4a9-df0bbe11aa28> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:29:48 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:29:48 user nova-compute[73497]:   <uuid>f7c83073-fadc-4e41-a4a9-df0bbe11aa28</uuid>
Aug 26 23:29:48 user nova-compute[73497]:   <name>instance-0000001f</name>
Aug 26 23:29:48 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:29:48 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:29:48 user nova-compute[73497]:   <metadata>
Aug 26 23:29:48 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:29:48 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:29:48 user nova-compute[73497]:       <nova:name>tempest-AttachVolumeTestJSON-server-1284261730</nova:name>
Aug 26 23:29:48 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:29:46</nova:creationTime>
Aug 26 23:29:48 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:29:48 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:29:48 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:29:48 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:29:48 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:29:48 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:29:48 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:29:48 user nova-compute[73497]:       <nova:owner>
Aug 26 23:29:48 user nova-compute[73497]:         <nova:user uuid="6e2c1f8d06854e579ee634e33e6de920">tempest-AttachVolumeTestJSON-1929388969-project-member</nova:user>
Aug 26 23:29:48 user nova-compute[73497]:         <nova:project uuid="e10f2d1336284b42a8dcbb05e509e9bd">tempest-AttachVolumeTestJSON-1929388969</nova:project>
Aug 26 23:29:48 user nova-compute[73497]:       </nova:owner>
Aug 26 23:29:48 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:29:48 user nova-compute[73497]:       <nova:ports>
Aug 26 23:29:48 user nova-compute[73497]:         <nova:port uuid="74cddf0f-c302-4ae4-8142-cee5764c7c4f">
Aug 26 23:29:48 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 23:29:48 user nova-compute[73497]:         </nova:port>
Aug 26 23:29:48 user nova-compute[73497]:       </nova:ports>
Aug 26 23:29:48 user nova-compute[73497]:     </nova:instance>
Aug 26 23:29:48 user nova-compute[73497]:   </metadata>
Aug 26 23:29:48 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:29:48 user nova-compute[73497]:     <system>
Aug 26 23:29:48 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:29:48 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:29:48 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:29:48 user nova-compute[73497]:       <entry name="serial">f7c83073-fadc-4e41-a4a9-df0bbe11aa28</entry>
Aug 26 23:29:48 user nova-compute[73497]:       <entry name="uuid">f7c83073-fadc-4e41-a4a9-df0bbe11aa28</entry>
Aug 26 23:29:48 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:29:48 user nova-compute[73497]:     </system>
Aug 26 23:29:48 user nova-compute[73497]:   </sysinfo>
Aug 26 23:29:48 user nova-compute[73497]:   <os>
Aug 26 23:29:48 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:29:48 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:29:48 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:29:48 user nova-compute[73497]:   </os>
Aug 26 23:29:48 user nova-compute[73497]:   <features>
Aug 26 23:29:48 user nova-compute[73497]:     <acpi/>
Aug 26 23:29:48 user nova-compute[73497]:     <apic/>
Aug 26 23:29:48 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:29:48 user nova-compute[73497]:   </features>
Aug 26 23:29:48 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:29:48 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:29:48 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:29:48 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:29:48 user nova-compute[73497]:   </clock>
Aug 26 23:29:48 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:29:48 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:29:48 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:29:48 user nova-compute[73497]:   </cpu>
Aug 26 23:29:48 user nova-compute[73497]:   <devices>
Aug 26 23:29:48 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:29:48 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:29:48 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk"/>
Aug 26 23:29:48 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:29:48 user nova-compute[73497]:     </disk>
Aug 26 23:29:48 user nova-compute[73497]:     <disk type="block" device="disk">
Aug 26 23:29:48 user nova-compute[73497]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:29:48 user nova-compute[73497]:       <source dev="/dev/sde"/>
Aug 26 23:29:48 user nova-compute[73497]:       <target dev="vdb" bus="virtio"/>
Aug 26 23:29:48 user nova-compute[73497]:       <serial>12c35c25-ba0c-408b-b188-7fc38a5c9177</serial>
Aug 26 23:29:48 user nova-compute[73497]:     </disk>
Aug 26 23:29:48 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:29:48 user nova-compute[73497]:       <mac address="fa:16:3e:cf:bd:9e"/>
Aug 26 23:29:48 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:29:48 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:29:48 user nova-compute[73497]:       <target dev="tap74cddf0f-c3"/>
Aug 26 23:29:48 user nova-compute[73497]:     </interface>
Aug 26 23:29:48 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:29:48 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/console.log" append="off"/>
Aug 26 23:29:48 user nova-compute[73497]:     </serial>
Aug 26 23:29:48 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:29:48 user nova-compute[73497]:     <video>
Aug 26 23:29:48 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:29:48 user nova-compute[73497]:     </video>
Aug 26 23:29:48 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:29:48 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:29:48 user nova-compute[73497]:     </rng>
Aug 26 23:29:48 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:29:48 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:29:48 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:29:48 user nova-compute[73497]:     </memballoon>
Aug 26 23:29:48 user nova-compute[73497]:   </devices>
Aug 26 23:29:48 user nova-compute[73497]: </domain>
Aug 26 23:29:48 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:29:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:48 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:29:48 user nova-compute[73497]: DEBUG nova.objects.instance [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lazy-loading 'trusted_certs' on Instance uuid f7c83073-fadc-4e41-a4a9-df0bbe11aa28 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:29:48 user nova-compute[73497]: DEBUG nova.objects.base [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Object Instance<f7c83073-fadc-4e41-a4a9-df0bbe11aa28> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:29:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.168s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:48 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:29:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:29:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:29:48 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Cannot resize image /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:29:48 user nova-compute[73497]: DEBUG nova.objects.instance [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lazy-loading 'migration_context' on Instance uuid f7c83073-fadc-4e41-a4a9-df0bbe11aa28 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:29:48 user nova-compute[73497]: DEBUG nova.objects.base [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Object Instance<f7c83073-fadc-4e41-a4a9-df0bbe11aa28> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:29:48 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:25:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1284261730',display_name='tempest-AttachVolumeTestJSON-server-1284261730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1284261730',id=31,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtZgj4CGRRq60nfzAmpM6NX6cbyiNr74c5vhKfLzmguuh54ComCQsitet6gqTOyy+exSU8a+OQZBMej3fWkPoWF9yZ7g9PDakdqjlJxgeAQgaLAVOiZs3e4Hh+0HK9qHg==',key_name='tempest-keypair-1578893874',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:25:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='e10f2d1336284b42a8dcbb05e509e9bd',ramdisk_id='',reservation_id='r-awwb3svr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1929388969',owner_user_name='tempest-AttachVolumeTestJSON-1929388969-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:27:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e2c1f8d06854e579ee634e33e6de920',uuid=f7c83073-fadc-4e41-a4a9-df0bbe11aa28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "address": "fa:16:3e:cf:bd:9e", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74cddf0f-c3", "ovs_interfaceid": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:29:48 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Converting VIF {"id": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "address": "fa:16:3e:cf:bd:9e", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74cddf0f-c3", "ovs_interfaceid": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:29:48 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:bd:9e,bridge_name='br-int',has_traffic_filtering=True,id=74cddf0f-c302-4ae4-8142-cee5764c7c4f,network=Network(77d468df-32fe-45fb-afe7-7ebf9b6b428f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74cddf0f-c3') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:29:48 user nova-compute[73497]: DEBUG os_vif [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:bd:9e,bridge_name='br-int',has_traffic_filtering=True,id=74cddf0f-c302-4ae4-8142-cee5764c7c4f,network=Network(77d468df-32fe-45fb-afe7-7ebf9b6b428f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74cddf0f-c3') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:29:48 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:48 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:29:48 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:29:48 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:48 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74cddf0f-c3, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:29:48 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap74cddf0f-c3, col_values=(('external_ids', {'iface-id': '74cddf0f-c302-4ae4-8142-cee5764c7c4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:bd:9e', 'vm-uuid': 'f7c83073-fadc-4e41-a4a9-df0bbe11aa28'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:29:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:29:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:49 user nova-compute[73497]: INFO os_vif [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:bd:9e,bridge_name='br-int',has_traffic_filtering=True,id=74cddf0f-c302-4ae4-8142-cee5764c7c4f,network=Network(77d468df-32fe-45fb-afe7-7ebf9b6b428f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74cddf0f-c3')
Aug 26 23:29:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:50 user nova-compute[73497]: DEBUG nova.compute.manager [req-011a20fb-90af-4509-840d-0eb473663f00 req-70ab7e16-7f49-4034-ade4-7ac7339aa25b service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Received event network-vif-plugged-74cddf0f-c302-4ae4-8142-cee5764c7c4f {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:29:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-011a20fb-90af-4509-840d-0eb473663f00 req-70ab7e16-7f49-4034-ade4-7ac7339aa25b service nova] Acquiring lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-011a20fb-90af-4509-840d-0eb473663f00 req-70ab7e16-7f49-4034-ade4-7ac7339aa25b service nova] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-011a20fb-90af-4509-840d-0eb473663f00 req-70ab7e16-7f49-4034-ade4-7ac7339aa25b service nova] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:50 user nova-compute[73497]: DEBUG nova.compute.manager [req-011a20fb-90af-4509-840d-0eb473663f00 req-70ab7e16-7f49-4034-ade4-7ac7339aa25b service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] No waiting events found dispatching network-vif-plugged-74cddf0f-c302-4ae4-8142-cee5764c7c4f {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:29:50 user nova-compute[73497]: WARNING nova.compute.manager [req-011a20fb-90af-4509-840d-0eb473663f00 req-70ab7e16-7f49-4034-ade4-7ac7339aa25b service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Received unexpected event network-vif-plugged-74cddf0f-c302-4ae4-8142-cee5764c7c4f for instance with vm_state stopped and task_state powering-on.
Aug 26 23:29:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:52 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092592.6582527, f7c83073-fadc-4e41-a4a9-df0bbe11aa28 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:29:52 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] VM Resumed (Lifecycle Event)
Aug 26 23:29:52 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:29:52 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Instance rebooted successfully.
Aug 26 23:29:52 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9ee5828a-3cac-4013-b5ab-391c56ce71cd tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:29:52 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:29:52 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:29:52 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 26 23:29:52 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092592.6622748, f7c83073-fadc-4e41-a4a9-df0bbe11aa28 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:29:52 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] VM Started (Lifecycle Event)
Aug 26 23:29:52 user nova-compute[73497]: DEBUG nova.compute.manager [req-d0f79c89-7c00-4b5f-8afd-26b82e5b2a95 req-e8d0081d-5a4e-4f1a-9bdc-e5a2e1fd4a13 service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Received event network-vif-plugged-74cddf0f-c302-4ae4-8142-cee5764c7c4f {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:29:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d0f79c89-7c00-4b5f-8afd-26b82e5b2a95 req-e8d0081d-5a4e-4f1a-9bdc-e5a2e1fd4a13 service nova] Acquiring lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:29:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d0f79c89-7c00-4b5f-8afd-26b82e5b2a95 req-e8d0081d-5a4e-4f1a-9bdc-e5a2e1fd4a13 service nova] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:29:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d0f79c89-7c00-4b5f-8afd-26b82e5b2a95 req-e8d0081d-5a4e-4f1a-9bdc-e5a2e1fd4a13 service nova] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:29:52 user nova-compute[73497]: DEBUG nova.compute.manager [req-d0f79c89-7c00-4b5f-8afd-26b82e5b2a95 req-e8d0081d-5a4e-4f1a-9bdc-e5a2e1fd4a13 service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] No waiting events found dispatching network-vif-plugged-74cddf0f-c302-4ae4-8142-cee5764c7c4f {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:29:52 user nova-compute[73497]: WARNING nova.compute.manager [req-d0f79c89-7c00-4b5f-8afd-26b82e5b2a95 req-e8d0081d-5a4e-4f1a-9bdc-e5a2e1fd4a13 service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Received unexpected event network-vif-plugged-74cddf0f-c302-4ae4-8142-cee5764c7c4f for instance with vm_state stopped and task_state powering-on.
Aug 26 23:29:52 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:29:52 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:29:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:56 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:29:56 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:29:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:29:59 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:30:00 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:30:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:30:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:30:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:30:00 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:30:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk.rescue --force-share --output=json" returned: 0 in 0.257s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk.rescue --force-share --output=json" returned: 0 in 0.239s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk (vdb) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:30:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:30:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:30:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853bd672-97af-4e36-9bd4-5cc428b83765/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853bd672-97af-4e36-9bd4-5cc428b83765/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853bd672-97af-4e36-9bd4-5cc428b83765/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853bd672-97af-4e36-9bd4-5cc428b83765/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:30:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:30:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:30:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:30:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:30:03 user nova-compute[73497]: INFO nova.compute.manager [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Terminating instance
Aug 26 23:30:03 user nova-compute[73497]: DEBUG nova.compute.manager [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:30:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:30:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:30:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-60f1cee2-159d-4968-a81c-604429a992ed req-e477481c-65dd-42b5-b33d-756831e5424f service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Received event network-vif-unplugged-a45f0c9b-48cc-4434-90c9-875c52f402d0 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:30:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-60f1cee2-159d-4968-a81c-604429a992ed req-e477481c-65dd-42b5-b33d-756831e5424f service nova] Acquiring lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:30:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-60f1cee2-159d-4968-a81c-604429a992ed req-e477481c-65dd-42b5-b33d-756831e5424f service nova] Lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:30:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-60f1cee2-159d-4968-a81c-604429a992ed req-e477481c-65dd-42b5-b33d-756831e5424f service nova] Lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:30:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-60f1cee2-159d-4968-a81c-604429a992ed req-e477481c-65dd-42b5-b33d-756831e5424f service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] No waiting events found dispatching network-vif-unplugged-a45f0c9b-48cc-4434-90c9-875c52f402d0 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:30:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-60f1cee2-159d-4968-a81c-604429a992ed req-e477481c-65dd-42b5-b33d-756831e5424f service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Received event network-vif-unplugged-a45f0c9b-48cc-4434-90c9-875c52f402d0 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:04 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Instance destroyed successfully.
Aug 26 23:30:04 user nova-compute[73497]: DEBUG nova.objects.instance [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lazy-loading 'resources' on Instance uuid c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:24:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1461613885',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1461613885',id=27,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:26:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ee8ef1c899342b38a624c1c28309d41',ramdisk_id='',reservation_id='r-2h2ics8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1276656289',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:28:19Z,user_data=None,user_id='83005131fdc2411abe7a198157910743',uuid=c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a45f0c9b-48cc-4434-90c9-875c52f402d0", "address": "fa:16:3e:87:b8:93", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa45f0c9b-48", "ovs_interfaceid": "a45f0c9b-48cc-4434-90c9-875c52f402d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Converting VIF {"id": "a45f0c9b-48cc-4434-90c9-875c52f402d0", "address": "fa:16:3e:87:b8:93", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa45f0c9b-48", "ovs_interfaceid": "a45f0c9b-48cc-4434-90c9-875c52f402d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:b8:93,bridge_name='br-int',has_traffic_filtering=True,id=a45f0c9b-48cc-4434-90c9-875c52f402d0,network=Network(f8ba0a6b-e4fc-4236-9df3-90ffab8824fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa45f0c9b-48') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG os_vif [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:b8:93,bridge_name='br-int',has_traffic_filtering=True,id=a45f0c9b-48cc-4434-90c9-875c52f402d0,network=Network(f8ba0a6b-e4fc-4236-9df3-90ffab8824fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa45f0c9b-48') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa45f0c9b-48, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:30:04 user nova-compute[73497]: INFO os_vif [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:b8:93,bridge_name='br-int',has_traffic_filtering=True,id=a45f0c9b-48cc-4434-90c9-875c52f402d0,network=Network(f8ba0a6b-e4fc-4236-9df3-90ffab8824fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa45f0c9b-48')
Aug 26 23:30:04 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LNBxIeFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:30:04 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:30:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2b5d19-8e3b-43ec-b71e-de11f58311cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df7ea38-5f40-46ae-85be-490b59640bde]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:30:04 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:30:04 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:30:04 user nova-compute[73497]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:30:04 user nova-compute[73497]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)
Aug 26 23:30:04 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:30:04 user nova-compute[73497]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 (non-flash)
Aug 26 23:30:04 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:30:04 user nova-compute[73497]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:30:04 user nova-compute[73497]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)
Aug 26 23:30:04 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281c301900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3'): ({'sdb'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Removing single pathed devices sdb {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe9dca2-03d2-4656-aabe-306c9134ac37]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d7237d-ec3e-4de0-bf1a-3811b775af6b]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Flushing IO for device /dev/sdb {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df62134-d524-440e-8cd0-66931b18ed3e]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.110s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9691c76f-53ce-4cf6-bd21-eb89aa4b54de]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_cf6548e2', '/dev/disk/by-id/scsi-26639313662326666', '/dev/disk/by-id/scsi-1SCST_BIOcf6548e2-f916b2ff5b20fa6c') {{(pid=84617) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73d0850-992b-44b9-8e83-e6cd8ae2ca2e]: (4, None) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2570b055-5344-425b-8640-b62aa8fb0c39]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:30:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.214s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:05 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d402e93-fbb2-45aa-925c-47cb2fc0bfb7]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:30:05 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3, portal: 172.16.0.220,3260]
Aug 26 23:30:05 user nova-compute[73497]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3, portal: 172.16.0.220,3260] successful.
Aug 26 23:30:05 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:30:05 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:30:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e051d168-f209-4421-b5b7-a94f198803e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:05 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb46ba4-d436-4e4b-9b69-6432fc488258]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:30:05 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:30:05 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.654s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:30:05 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] <== disconnect_volume: return (658ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:30:05 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:30:05 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Deleting instance files /opt/stack/data/nova/instances/c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c_del
Aug 26 23:30:05 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Deletion of /opt/stack/data/nova/instances/c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c_del complete
Aug 26 23:30:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:05 user nova-compute[73497]: INFO nova.compute.manager [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Took 1.83 seconds to destroy the instance on the hypervisor.
Aug 26 23:30:05 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:30:05 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:30:05 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:30:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:05 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:30:06 user nova-compute[73497]: DEBUG nova.compute.manager [req-afdcdf7e-1606-4191-9b79-07e482534843 req-46829122-e6d9-4728-b628-08a872ed04c8 service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Received event network-vif-plugged-a45f0c9b-48cc-4434-90c9-875c52f402d0 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:30:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-afdcdf7e-1606-4191-9b79-07e482534843 req-46829122-e6d9-4728-b628-08a872ed04c8 service nova] Acquiring lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:30:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-afdcdf7e-1606-4191-9b79-07e482534843 req-46829122-e6d9-4728-b628-08a872ed04c8 service nova] Lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:30:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-afdcdf7e-1606-4191-9b79-07e482534843 req-46829122-e6d9-4728-b628-08a872ed04c8 service nova] Lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:30:06 user nova-compute[73497]: DEBUG nova.compute.manager [req-afdcdf7e-1606-4191-9b79-07e482534843 req-46829122-e6d9-4728-b628-08a872ed04c8 service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] No waiting events found dispatching network-vif-plugged-a45f0c9b-48cc-4434-90c9-875c52f402d0 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:30:06 user nova-compute[73497]: WARNING nova.compute.manager [req-afdcdf7e-1606-4191-9b79-07e482534843 req-46829122-e6d9-4728-b628-08a872ed04c8 service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Received unexpected event network-vif-plugged-a45f0c9b-48cc-4434-90c9-875c52f402d0 for instance with vm_state active and task_state deleting.
Aug 26 23:30:06 user nova-compute[73497]: DEBUG nova.compute.manager [req-577ddf31-d55a-4d92-a6fa-b0b1913d2990 req-a7282c5a-8762-4a18-89f8-f78d4bd066ff service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Received event network-vif-deleted-a45f0c9b-48cc-4434-90c9-875c52f402d0 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:30:06 user nova-compute[73497]: INFO nova.compute.manager [req-577ddf31-d55a-4d92-a6fa-b0b1913d2990 req-a7282c5a-8762-4a18-89f8-f78d4bd066ff service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Neutron deleted interface a45f0c9b-48cc-4434-90c9-875c52f402d0; detaching it from the instance and deleting it from the info cache
Aug 26 23:30:06 user nova-compute[73497]: DEBUG nova.network.neutron [req-577ddf31-d55a-4d92-a6fa-b0b1913d2990 req-a7282c5a-8762-4a18-89f8-f78d4bd066ff service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:30:06 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:30:06 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:30:06 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:30:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=6966MB free_disk=24.87005615234375GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:30:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:30:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:30:06 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Took 1.09 seconds to deallocate network for instance.
Aug 26 23:30:06 user nova-compute[73497]: DEBUG nova.compute.manager [req-577ddf31-d55a-4d92-a6fa-b0b1913d2990 req-a7282c5a-8762-4a18-89f8-f78d4bd066ff service nova] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Detach interface failed, port_id=a45f0c9b-48cc-4434-90c9-875c52f402d0, reason: Instance c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c could not be found. {{(pid=73497) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 23:30:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 994093f0-e6b2-4c96-b259-c559ef2b1fbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:30:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 171985a3-358d-4b26-a66c-372b9b99b386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:30:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance aebaeda6-23d1-43a1-afc8-bdc8992067e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:30:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 043294e5-0618-4a31-bb19-1227ef1f5d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:30:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance e9e5c83f-0678-48d4-a81f-1a3f959aabcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:30:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance c601f97e-9e52-40c6-9085-45f38e709721 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:30:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:30:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance f7c83073-fadc-4e41-a4a9-df0bbe11aa28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:30:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 40afa348-8391-4643-977c-e67eab5c9476 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:30:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance e15ddee6-a642-4638-9534-21e640b3d017 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:30:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance b7506745-ace5-45e2-bc1d-883f2c51f1c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:30:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 853bd672-97af-4e36-9bd4-5cc428b83765 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:30:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:30:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:30:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:30:06 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Refreshing inventories for resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 23:30:06 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Updating ProviderTree inventory for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 23:30:06 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Updating inventory in ProviderTree for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 23:30:06 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Refreshing aggregate associations for resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1, aggregates: None {{(pid=73497) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 23:30:06 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Refreshing trait associations for resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING {{(pid=73497) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 23:30:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:30:07 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:30:07 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:30:07 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:30:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.827s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:30:07 user nova-compute[73497]: INFO nova.compute.manager [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Took 0.83 seconds to detach 1 volumes for instance.
Aug 26 23:30:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:30:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:30:07 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:30:07 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:30:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.429s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:30:07 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Deleted allocations for instance c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c
Aug 26 23:30:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1b222ad2-443f-4af6-8294-9707371deb77 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.437s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:30:08 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:30:08 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:30:08 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:30:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-aebaeda6-23d1-43a1-afc8-bdc8992067e5" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:30:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-aebaeda6-23d1-43a1-afc8-bdc8992067e5" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:30:08 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:30:09 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Updating instance_info_cache with network_info: [{"id": "2fdb126c-c800-488a-9879-08a65e646325", "address": "fa:16:3e:e0:28:c4", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fdb126c-c8", "ovs_interfaceid": "2fdb126c-c800-488a-9879-08a65e646325", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:30:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-aebaeda6-23d1-43a1-afc8-bdc8992067e5" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:30:09 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:30:09 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:30:09 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:30:09 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:30:09 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:30:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:30:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:30:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:30:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:30:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:30:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:30:18 user nova-compute[73497]: DEBUG nova.objects.instance [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lazy-loading 'flavor' on Instance uuid b7506745-ace5-45e2-bc1d-883f2c51f1c4 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:30:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:30:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:30:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:30:19 user nova-compute[73497]: INFO nova.compute.manager [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Attaching volume 69263bc9-1275-443e-8f69-79a2098f3345 to /dev/vdb
Aug 26 23:30:19 user nova-compute[73497]: DEBUG os_brick.utils [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:30:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5ea8cf-971b-49ee-8367-c68a4d5d6037]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:30:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47ca9b6-340b-4be8-9e7d-06c7aa393ef2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:30:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ce458a-556c-4aa2-a484-495ea525ab6e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:30:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[343eb29c-c565-41f2-8d83-dfa6d2928189]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:30:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:30:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:30:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:30:19 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:30:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05f2665-4a68-44fb-a191-960de4c00e38]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:30:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:30:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:30:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:30:19 user nova-compute[73497]: DEBUG os_brick.utils [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:30:19 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Updating existing volume attachment record: ef0e37fe-f031-428e-a009-a5e8768c021b {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:30:19 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693092604.4681265, c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:30:19 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] VM Stopped (Lifecycle Event)
Aug 26 23:30:19 user nova-compute[73497]: DEBUG nova.compute.manager [None req-8fdefc00-0772-4cc2-a218-6ddcc8dec041 None None] [instance: c7f0e852-8aaa-47f4-9ff0-f5bc68cecc4c] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:30:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:30:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:30:22 user nova-compute[73497]: INFO nova.compute.manager [None req-8dce3416-9f85-4af3-b617-2b4041ef1aba tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Get console output
Aug 26 23:30:22 user nova-compute[73497]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 26 23:30:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:30:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:30:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:30:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:30:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xcfGFVCj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:30:32 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:30:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:30:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:30:32 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:30:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:30:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:30:32 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:30:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260" returned: 21 in 0.089s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19a4772-21dc-4767-bd5d-f224831b3480]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:30:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:30:32 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:30:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.296s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c3caf4-eb7d-462e-8f0d-6a3c193e25d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:30:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345] added
Aug 26 23:30:32 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:30:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.074s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb092da0-ef64-4425-bfc9-6be4ad3115c4]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:30:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:30:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e52807a-24f5-4a54-86b9-54f1a974a477]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:30:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:30:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xcfGFVCj {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xcfGFVCj" returned: 0 in 0.031s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5578d83c-0b20-4306-8ed7-178a1f221b56]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:30:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xcfGFVCj'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:30:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.071s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:33 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efd2bf8-17a2-418c-99f1-27a3c20a44d4]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:30:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:30:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:33 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a02a8e-103f-4a80-aa1e-c32160aa18a4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7101c563-d84b-4e4a-86e6-4fab052759d0 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:30:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:30:33 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:30:33 user nova-compute[73497]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:30:33 user nova-compute[73497]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)
Aug 26 23:30:33 user nova-compute[73497]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7101c563-d84b-4e4a-86e6-4fab052759d0 (non-flash)
Aug 26 23:30:33 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:30:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:30:33 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:30:33 user nova-compute[73497]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:30:33 user nova-compute[73497]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)
Aug 26 23:30:33 user nova-compute[73497]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7101c563-d84b-4e4a-86e6-4fab052759d0 (non-flash)
Aug 26 23:30:33 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:30:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --login" returned: 0 in 1.152s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:34 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c57f1b6-5046-4ef1-8ed1-f73562490adf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:30:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345, portal: 172.16.0.220,3260]
Aug 26 23:30:34 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345, portal: 172.16.0.220,3260] successful.
Aug 26 23:30:34 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:30:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:34 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[794e0432-26f8-4aaf-bb3f-0da35a48caf9]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:30:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:30:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:34 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e0d136-e69d-47e2-8fa5-3c597aec0264]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7101c563-d84b-4e4a-86e6-4fab052759d0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:30:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:30:34 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:30:34 user nova-compute[73497]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:30:34 user nova-compute[73497]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)
Aug 26 23:30:34 user nova-compute[73497]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7101c563-d84b-4e4a-86e6-4fab052759d0 (non-flash)
Aug 26 23:30:34 user nova-compute[73497]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)
Aug 26 23:30:34 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:30:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:30:34 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:30:34 user nova-compute[73497]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:30:34 user nova-compute[73497]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)
Aug 26 23:30:34 user nova-compute[73497]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7101c563-d84b-4e4a-86e6-4fab052759d0 (non-flash)
Aug 26 23:30:34 user nova-compute[73497]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)
Aug 26 23:30:34 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:30:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.891s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:30:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:30:34 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] HCTL ('38', '-', '-', 0) found on session 38 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:30:34 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:30:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:30:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.062s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:30:34 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e4f6fa-8078-4253-8248-13ded269370b]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:30:34 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Searching for a device in session 38 and hctl ['38', '*', '*', 0] yield: None {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:30:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:30:35 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Searching for a device in session 38 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:30:35 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xcfGFVCj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:30:35 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.968s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:30:35 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] <== connect_volume: return (2970ms) {'type': 'block', 'scsi_wwn': '26135646236326630', 'path': '/dev/sdg'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:30:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135646236326630', 'path': '/dev/sdg'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:30:35 user nova-compute[73497]: DEBUG nova.objects.instance [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lazy-loading 'flavor' on Instance uuid b7506745-ace5-45e2-bc1d-883f2c51f1c4 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:30:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 23:30:35 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:30:35 user nova-compute[73497]:   <source dev="/dev/sdg"/>
Aug 26 23:30:35 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:30:35 user nova-compute[73497]:   <serial>69263bc9-1275-443e-8f69-79a2098f3345</serial>
Aug 26 23:30:35 user nova-compute[73497]: </disk>
Aug 26 23:30:35 user nova-compute[73497]:  {{(pid=73497) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 23:30:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:30:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:30:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] No VIF found with MAC fa:16:3e:7e:a1:4c, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:30:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-102b9b57-592c-464d-8b12-d284c8ff5e27 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.436s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:30:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:30:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:30:48 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:30:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:30:49 user nova-compute[73497]: DEBUG nova.compute.manager [req-fe502250-426f-4c43-8d21-cad3950f2418 req-51f55f87-9b45-4003-acc6-b535dccbfd0b service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Received event network-changed-9993c7ac-e4a2-41c8-97d9-75c681d68a6a {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:30:49 user nova-compute[73497]: DEBUG nova.compute.manager [req-fe502250-426f-4c43-8d21-cad3950f2418 req-51f55f87-9b45-4003-acc6-b535dccbfd0b service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Refreshing instance network info cache due to event network-changed-9993c7ac-e4a2-41c8-97d9-75c681d68a6a. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:30:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-fe502250-426f-4c43-8d21-cad3950f2418 req-51f55f87-9b45-4003-acc6-b535dccbfd0b service nova] Acquiring lock "refresh_cache-b7506745-ace5-45e2-bc1d-883f2c51f1c4" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:30:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-fe502250-426f-4c43-8d21-cad3950f2418 req-51f55f87-9b45-4003-acc6-b535dccbfd0b service nova] Acquired lock "refresh_cache-b7506745-ace5-45e2-bc1d-883f2c51f1c4" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:30:49 user nova-compute[73497]: DEBUG nova.network.neutron [req-fe502250-426f-4c43-8d21-cad3950f2418 req-51f55f87-9b45-4003-acc6-b535dccbfd0b service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Refreshing network info cache for port 9993c7ac-e4a2-41c8-97d9-75c681d68a6a {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:30:50 user nova-compute[73497]: DEBUG nova.network.neutron [req-fe502250-426f-4c43-8d21-cad3950f2418 req-51f55f87-9b45-4003-acc6-b535dccbfd0b service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Updated VIF entry in instance network info cache for port 9993c7ac-e4a2-41c8-97d9-75c681d68a6a. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:30:50 user nova-compute[73497]: DEBUG nova.network.neutron [req-fe502250-426f-4c43-8d21-cad3950f2418 req-51f55f87-9b45-4003-acc6-b535dccbfd0b service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Updating instance_info_cache with network_info: [{"id": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "address": "fa:16:3e:7e:a1:4c", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9993c7ac-e4", "ovs_interfaceid": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:30:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-fe502250-426f-4c43-8d21-cad3950f2418 req-51f55f87-9b45-4003-acc6-b535dccbfd0b service nova] Releasing lock "refresh_cache-b7506745-ace5-45e2-bc1d-883f2c51f1c4" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:30:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:30:52 user nova-compute[73497]: DEBUG nova.compute.manager [req-419eb048-c0a4-465b-907f-f0639c87db91 req-600685bf-27ef-442c-8d6c-4c7a44aba4ef service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Received event network-changed-9993c7ac-e4a2-41c8-97d9-75c681d68a6a {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:30:52 user nova-compute[73497]: DEBUG nova.compute.manager [req-419eb048-c0a4-465b-907f-f0639c87db91 req-600685bf-27ef-442c-8d6c-4c7a44aba4ef service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Refreshing instance network info cache due to event network-changed-9993c7ac-e4a2-41c8-97d9-75c681d68a6a. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:30:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-419eb048-c0a4-465b-907f-f0639c87db91 req-600685bf-27ef-442c-8d6c-4c7a44aba4ef service nova] Acquiring lock "refresh_cache-b7506745-ace5-45e2-bc1d-883f2c51f1c4" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:30:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-419eb048-c0a4-465b-907f-f0639c87db91 req-600685bf-27ef-442c-8d6c-4c7a44aba4ef service nova] Acquired lock "refresh_cache-b7506745-ace5-45e2-bc1d-883f2c51f1c4" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:30:52 user nova-compute[73497]: DEBUG nova.network.neutron [req-419eb048-c0a4-465b-907f-f0639c87db91 req-600685bf-27ef-442c-8d6c-4c7a44aba4ef service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Refreshing network info cache for port 9993c7ac-e4a2-41c8-97d9-75c681d68a6a {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:30:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:30:52 user nova-compute[73497]: DEBUG nova.network.neutron [req-419eb048-c0a4-465b-907f-f0639c87db91 req-600685bf-27ef-442c-8d6c-4c7a44aba4ef service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Updated VIF entry in instance network info cache for port 9993c7ac-e4a2-41c8-97d9-75c681d68a6a. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:30:52 user nova-compute[73497]: DEBUG nova.network.neutron [req-419eb048-c0a4-465b-907f-f0639c87db91 req-600685bf-27ef-442c-8d6c-4c7a44aba4ef service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Updating instance_info_cache with network_info: [{"id": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "address": "fa:16:3e:7e:a1:4c", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9993c7ac-e4", "ovs_interfaceid": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:30:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-419eb048-c0a4-465b-907f-f0639c87db91 req-600685bf-27ef-442c-8d6c-4c7a44aba4ef service nova] Releasing lock "refresh_cache-b7506745-ace5-45e2-bc1d-883f2c51f1c4" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:30:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-66f4c50a-42e0-4d22-a30f-012beb8ad666 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "c601f97e-9e52-40c6-9085-45f38e709721" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:30:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-66f4c50a-42e0-4d22-a30f-012beb8ad666 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "c601f97e-9e52-40c6-9085-45f38e709721" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:30:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-66f4c50a-42e0-4d22-a30f-012beb8ad666 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "c601f97e-9e52-40c6-9085-45f38e709721-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:30:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-66f4c50a-42e0-4d22-a30f-012beb8ad666 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "c601f97e-9e52-40c6-9085-45f38e709721-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:30:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-66f4c50a-42e0-4d22-a30f-012beb8ad666 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "c601f97e-9e52-40c6-9085-45f38e709721-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:30:54 user nova-compute[73497]: INFO nova.compute.manager [None req-66f4c50a-42e0-4d22-a30f-012beb8ad666 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Terminating instance
Aug 26 23:30:54 user nova-compute[73497]: DEBUG nova.compute.manager [None req-66f4c50a-42e0-4d22-a30f-012beb8ad666 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:30:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:30:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:30:54 user nova-compute[73497]: DEBUG nova.compute.manager [req-aef3e325-3bf4-4cc6-b7ad-062f3cf08d98 req-5ff23105-3674-4cab-ae77-f9eb8e1dad33 service nova] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Received event network-vif-unplugged-628385fc-dbf3-4ae6-87d8-fe1678966a73 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:30:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-aef3e325-3bf4-4cc6-b7ad-062f3cf08d98 req-5ff23105-3674-4cab-ae77-f9eb8e1dad33 service nova] Acquiring lock "c601f97e-9e52-40c6-9085-45f38e709721-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:30:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-aef3e325-3bf4-4cc6-b7ad-062f3cf08d98 req-5ff23105-3674-4cab-ae77-f9eb8e1dad33 service nova] Lock "c601f97e-9e52-40c6-9085-45f38e709721-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:30:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-aef3e325-3bf4-4cc6-b7ad-062f3cf08d98 req-5ff23105-3674-4cab-ae77-f9eb8e1dad33 service nova] Lock "c601f97e-9e52-40c6-9085-45f38e709721-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:30:54 user nova-compute[73497]: DEBUG nova.compute.manager [req-aef3e325-3bf4-4cc6-b7ad-062f3cf08d98 req-5ff23105-3674-4cab-ae77-f9eb8e1dad33 service nova] [instance: c601f97e-9e52-40c6-9085-45f38e709721] No waiting events found dispatching network-vif-unplugged-628385fc-dbf3-4ae6-87d8-fe1678966a73 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:30:54 user nova-compute[73497]: DEBUG nova.compute.manager [req-aef3e325-3bf4-4cc6-b7ad-062f3cf08d98 req-5ff23105-3674-4cab-ae77-f9eb8e1dad33 service nova] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Received event network-vif-unplugged-628385fc-dbf3-4ae6-87d8-fe1678966a73 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:30:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:30:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:30:55 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Instance destroyed successfully.
Aug 26 23:30:55 user nova-compute[73497]: DEBUG nova.objects.instance [None req-66f4c50a-42e0-4d22-a30f-012beb8ad666 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lazy-loading 'resources' on Instance uuid c601f97e-9e52-40c6-9085-45f38e709721 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:30:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-66f4c50a-42e0-4d22-a30f-012beb8ad666 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:21:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1232471816',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1232471816',id=24,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:21:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ee8ef1c899342b38a624c1c28309d41',ramdisk_id='',reservation_id='r-offwgzp4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1276656289',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:23:28Z,user_data=None,user_id='83005131fdc2411abe7a198157910743',uuid=c601f97e-9e52-40c6-9085-45f38e709721,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "628385fc-dbf3-4ae6-87d8-fe1678966a73", "address": "fa:16:3e:c0:51:9f", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap628385fc-db", "ovs_interfaceid": "628385fc-dbf3-4ae6-87d8-fe1678966a73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:30:55 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-66f4c50a-42e0-4d22-a30f-012beb8ad666 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Converting VIF {"id": "628385fc-dbf3-4ae6-87d8-fe1678966a73", "address": "fa:16:3e:c0:51:9f", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap628385fc-db", "ovs_interfaceid": "628385fc-dbf3-4ae6-87d8-fe1678966a73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:30:55 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-66f4c50a-42e0-4d22-a30f-012beb8ad666 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:51:9f,bridge_name='br-int',has_traffic_filtering=True,id=628385fc-dbf3-4ae6-87d8-fe1678966a73,network=Network(f8ba0a6b-e4fc-4236-9df3-90ffab8824fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap628385fc-db') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:30:55 user nova-compute[73497]: DEBUG os_vif [None req-66f4c50a-42e0-4d22-a30f-012beb8ad666 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:51:9f,bridge_name='br-int',has_traffic_filtering=True,id=628385fc-dbf3-4ae6-87d8-fe1678966a73,network=Network(f8ba0a6b-e4fc-4236-9df3-90ffab8824fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap628385fc-db') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:30:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:30:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap628385fc-db, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:30:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:30:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:30:55 user nova-compute[73497]: INFO os_vif [None req-66f4c50a-42e0-4d22-a30f-012beb8ad666 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:51:9f,bridge_name='br-int',has_traffic_filtering=True,id=628385fc-dbf3-4ae6-87d8-fe1678966a73,network=Network(f8ba0a6b-e4fc-4236-9df3-90ffab8824fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap628385fc-db')
Aug 26 23:30:55 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-66f4c50a-42e0-4d22-a30f-012beb8ad666 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Deleting instance files /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721_del
Aug 26 23:30:55 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-66f4c50a-42e0-4d22-a30f-012beb8ad666 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Deletion of /opt/stack/data/nova/instances/c601f97e-9e52-40c6-9085-45f38e709721_del complete
Aug 26 23:30:55 user nova-compute[73497]: INFO nova.compute.manager [None req-66f4c50a-42e0-4d22-a30f-012beb8ad666 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 26 23:30:55 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-66f4c50a-42e0-4d22-a30f-012beb8ad666 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:30:55 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:30:55 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: c601f97e-9e52-40c6-9085-45f38e709721] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:30:55 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:30:55 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Took 0.54 seconds to deallocate network for instance.
Aug 26 23:30:55 user nova-compute[73497]: DEBUG nova.compute.manager [req-af2d0fdd-6814-41e7-8c9d-8824ab4ddd02 req-5446647e-bc67-446a-bbc9-1e086923f69c service nova] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Received event network-vif-deleted-628385fc-dbf3-4ae6-87d8-fe1678966a73 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:30:55 user nova-compute[73497]: INFO nova.compute.manager [req-af2d0fdd-6814-41e7-8c9d-8824ab4ddd02 req-5446647e-bc67-446a-bbc9-1e086923f69c service nova] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Neutron deleted interface 628385fc-dbf3-4ae6-87d8-fe1678966a73; detaching it from the instance and deleting it from the info cache
Aug 26 23:30:55 user nova-compute[73497]: DEBUG nova.network.neutron [req-af2d0fdd-6814-41e7-8c9d-8824ab4ddd02 req-5446647e-bc67-446a-bbc9-1e086923f69c service nova] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:30:55 user nova-compute[73497]: DEBUG nova.compute.manager [req-af2d0fdd-6814-41e7-8c9d-8824ab4ddd02 req-5446647e-bc67-446a-bbc9-1e086923f69c service nova] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Detach interface failed, port_id=628385fc-dbf3-4ae6-87d8-fe1678966a73, reason: Instance c601f97e-9e52-40c6-9085-45f38e709721 could not be found. {{(pid=73497) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 23:30:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-66f4c50a-42e0-4d22-a30f-012beb8ad666 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:30:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-66f4c50a-42e0-4d22-a30f-012beb8ad666 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:30:56 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-66f4c50a-42e0-4d22-a30f-012beb8ad666 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:30:56 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-66f4c50a-42e0-4d22-a30f-012beb8ad666 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:30:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-66f4c50a-42e0-4d22-a30f-012beb8ad666 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:30:56 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-66f4c50a-42e0-4d22-a30f-012beb8ad666 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Deleted allocations for instance c601f97e-9e52-40c6-9085-45f38e709721
Aug 26 23:30:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-66f4c50a-42e0-4d22-a30f-012beb8ad666 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "c601f97e-9e52-40c6-9085-45f38e709721" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.026s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:30:56 user nova-compute[73497]: DEBUG nova.compute.manager [req-894db4fe-f9f7-42d2-b020-721e6f75719a req-421589de-c2e1-466b-ab7b-dda3deac8e60 service nova] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Received event network-vif-plugged-628385fc-dbf3-4ae6-87d8-fe1678966a73 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:30:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-894db4fe-f9f7-42d2-b020-721e6f75719a req-421589de-c2e1-466b-ab7b-dda3deac8e60 service nova] Acquiring lock "c601f97e-9e52-40c6-9085-45f38e709721-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:30:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-894db4fe-f9f7-42d2-b020-721e6f75719a req-421589de-c2e1-466b-ab7b-dda3deac8e60 service nova] Lock "c601f97e-9e52-40c6-9085-45f38e709721-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:30:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-894db4fe-f9f7-42d2-b020-721e6f75719a req-421589de-c2e1-466b-ab7b-dda3deac8e60 service nova] Lock "c601f97e-9e52-40c6-9085-45f38e709721-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:30:56 user nova-compute[73497]: DEBUG nova.compute.manager [req-894db4fe-f9f7-42d2-b020-721e6f75719a req-421589de-c2e1-466b-ab7b-dda3deac8e60 service nova] [instance: c601f97e-9e52-40c6-9085-45f38e709721] No waiting events found dispatching network-vif-plugged-628385fc-dbf3-4ae6-87d8-fe1678966a73 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:30:56 user nova-compute[73497]: WARNING nova.compute.manager [req-894db4fe-f9f7-42d2-b020-721e6f75719a req-421589de-c2e1-466b-ab7b-dda3deac8e60 service nova] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Received unexpected event network-vif-plugged-628385fc-dbf3-4ae6-87d8-fe1678966a73 for instance with vm_state deleted and task_state None.
Aug 26 23:30:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:30:58 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:30:58 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:30:59 user nova-compute[73497]: DEBUG nova.compute.manager [req-2168e9ae-8e0a-4fa1-b553-785a291d2219 req-9bd9969c-d4ab-4afa-b10d-60f7d62449f2 service nova] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Received event network-changed-55f5d62f-e069-45a4-953f-d3ec033c3ba1 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:30:59 user nova-compute[73497]: DEBUG nova.compute.manager [req-2168e9ae-8e0a-4fa1-b553-785a291d2219 req-9bd9969c-d4ab-4afa-b10d-60f7d62449f2 service nova] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Refreshing instance network info cache due to event network-changed-55f5d62f-e069-45a4-953f-d3ec033c3ba1. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:30:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2168e9ae-8e0a-4fa1-b553-785a291d2219 req-9bd9969c-d4ab-4afa-b10d-60f7d62449f2 service nova] Acquiring lock "refresh_cache-853bd672-97af-4e36-9bd4-5cc428b83765" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:30:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2168e9ae-8e0a-4fa1-b553-785a291d2219 req-9bd9969c-d4ab-4afa-b10d-60f7d62449f2 service nova] Acquired lock "refresh_cache-853bd672-97af-4e36-9bd4-5cc428b83765" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:30:59 user nova-compute[73497]: DEBUG nova.network.neutron [req-2168e9ae-8e0a-4fa1-b553-785a291d2219 req-9bd9969c-d4ab-4afa-b10d-60f7d62449f2 service nova] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Refreshing network info cache for port 55f5d62f-e069-45a4-953f-d3ec033c3ba1 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:31:00 user nova-compute[73497]: DEBUG nova.network.neutron [req-2168e9ae-8e0a-4fa1-b553-785a291d2219 req-9bd9969c-d4ab-4afa-b10d-60f7d62449f2 service nova] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Updated VIF entry in instance network info cache for port 55f5d62f-e069-45a4-953f-d3ec033c3ba1. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:31:00 user nova-compute[73497]: DEBUG nova.network.neutron [req-2168e9ae-8e0a-4fa1-b553-785a291d2219 req-9bd9969c-d4ab-4afa-b10d-60f7d62449f2 service nova] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Updating instance_info_cache with network_info: [{"id": "55f5d62f-e069-45a4-953f-d3ec033c3ba1", "address": "fa:16:3e:75:d8:38", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55f5d62f-e0", "ovs_interfaceid": "55f5d62f-e069-45a4-953f-d3ec033c3ba1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:31:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2168e9ae-8e0a-4fa1-b553-785a291d2219 req-9bd9969c-d4ab-4afa-b10d-60f7d62449f2 service nova] Releasing lock "refresh_cache-853bd672-97af-4e36-9bd4-5cc428b83765" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:31:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:31:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:31:00 user nova-compute[73497]: INFO nova.compute.manager [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Rebooting instance
Aug 26 23:31:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "refresh_cache-b7506745-ace5-45e2-bc1d-883f2c51f1c4" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:31:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquired lock "refresh_cache-b7506745-ace5-45e2-bc1d-883f2c51f1c4" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:31:00 user nova-compute[73497]: DEBUG nova.network.neutron [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:31:00 user nova-compute[73497]: DEBUG nova.network.neutron [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Updating instance_info_cache with network_info: [{"id": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "address": "fa:16:3e:7e:a1:4c", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9993c7ac-e4", "ovs_interfaceid": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:31:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Releasing lock "refresh_cache-b7506745-ace5-45e2-bc1d-883f2c51f1c4" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:31:00 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:31:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:01 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:31:01 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:31:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:31:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:31:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:31:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:31:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:01 user nova-compute[73497]: DEBUG nova.compute.manager [req-3403a85b-1be2-4405-8dfe-45c2ca427f8a req-b297c564-18b7-4129-a0d6-789ffbaca589 service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Received event network-vif-unplugged-9993c7ac-e4a2-41c8-97d9-75c681d68a6a {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:31:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3403a85b-1be2-4405-8dfe-45c2ca427f8a req-b297c564-18b7-4129-a0d6-789ffbaca589 service nova] Acquiring lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:31:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3403a85b-1be2-4405-8dfe-45c2ca427f8a req-b297c564-18b7-4129-a0d6-789ffbaca589 service nova] Lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:31:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3403a85b-1be2-4405-8dfe-45c2ca427f8a req-b297c564-18b7-4129-a0d6-789ffbaca589 service nova] Lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:31:01 user nova-compute[73497]: DEBUG nova.compute.manager [req-3403a85b-1be2-4405-8dfe-45c2ca427f8a req-b297c564-18b7-4129-a0d6-789ffbaca589 service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] No waiting events found dispatching network-vif-unplugged-9993c7ac-e4a2-41c8-97d9-75c681d68a6a {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:31:01 user nova-compute[73497]: WARNING nova.compute.manager [req-3403a85b-1be2-4405-8dfe-45c2ca427f8a req-b297c564-18b7-4129-a0d6-789ffbaca589 service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Received unexpected event network-vif-unplugged-9993c7ac-e4a2-41c8-97d9-75c681d68a6a for instance with vm_state active and task_state reboot_started_hard.
Aug 26 23:31:01 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Instance destroyed successfully.
Aug 26 23:31:01 user nova-compute[73497]: DEBUG nova.objects.instance [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lazy-loading 'resources' on Instance uuid b7506745-ace5-45e2-bc1d-883f2c51f1c4 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:28:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1357907004',display_name='tempest-TestMinimumBasicScenario-server-1357907004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1357907004',id=34,image_ref='4953616c-6ab8-44e7-9644-490160ff0ba9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHawhLjVpHObEM1sejmZUdYQSEnONqYB9L2Qv/axMeT5kKxPx9/QuS/i5jErqR53WVLlmHVIBUw7Z4Scv0xP68Y1o8+EymV6cmPgQpjbZL+arFhxVBB0cTzGv9OLKbkK5Q==',key_name='tempest-TestMinimumBasicScenario-1395022215',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:28:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ae441ca35d847e89eb99397fe167960',ramdisk_id='',reservation_id='r-qslnut47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4953616c-6ab8-44e7-9644-490160ff0ba9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1836970755',owner_user_name='tempest-TestMinimumBasicScenario-1836970755-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:31:01Z,user_data=None,user_id='948c44e55c7c404fb660394a747cf162',uuid=b7506745-ace5-45e2-bc1d-883f2c51f1c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "address": "fa:16:3e:7e:a1:4c", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9993c7ac-e4", "ovs_interfaceid": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Converting VIF {"id": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "address": "fa:16:3e:7e:a1:4c", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9993c7ac-e4", "ovs_interfaceid": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:a1:4c,bridge_name='br-int',has_traffic_filtering=True,id=9993c7ac-e4a2-41c8-97d9-75c681d68a6a,network=Network(f11c42be-cba6-4e59-80b1-6fdd90a41c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9993c7ac-e4') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_vif [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:a1:4c,bridge_name='br-int',has_traffic_filtering=True,id=9993c7ac-e4a2-41c8-97d9-75c681d68a6a,network=Network(f11c42be-cba6-4e59-80b1-6fdd90a41c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9993c7ac-e4') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9993c7ac-e4, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:31:02 user nova-compute[73497]: INFO os_vif [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:a1:4c,bridge_name='br-int',has_traffic_filtering=True,id=9993c7ac-e4a2-41c8-97d9-75c681d68a6a,network=Network(f11c42be-cba6-4e59-80b1-6fdd90a41c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9993c7ac-e4')
Aug 26 23:31:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xcfGFVCj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:31:02 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a245e48-14a4-4439-ac0d-f7d76b63b861]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0195cde-65b9-4836-88dd-63e06dc0db3d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:31:02 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:31:02 user nova-compute[73497]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:31:02 user nova-compute[73497]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)
Aug 26 23:31:02 user nova-compute[73497]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)
Aug 26 23:31:02 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:31:02 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:31:02 user nova-compute[73497]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:31:02 user nova-compute[73497]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)
Aug 26 23:31:02 user nova-compute[73497]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)
Aug 26 23:31:02 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281c4177f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345'): ({'sdg'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Removing single pathed devices sdg {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[393c839e-6296-47ed-8d54-d45b9d43b479]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7320d944-8dfd-46fe-a899-8fdc924c6e4c]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Flushing IO for device /dev/sdg {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d0de22-b9f9-451a-90c5-74fe222061cf]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.046s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ffd823-3790-47bc-822b-e715048b2122]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] SCSI volumes sdg have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1d68de-4938-4090-a03f-c0c009f0cd90]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd236354-6cc5-465a-9e48-55a9bd240001]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345, portal: 172.16.0.220,3260]
Aug 26 23:31:02 user nova-compute[73497]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345, portal: 172.16.0.220,3260] successful.
Aug 26 23:31:02 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[715cea04-1492-471b-8223-e3a75fabee80]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.423s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] <== disconnect_volume: return (425ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Start _get_guest_xml network_info=[{"id": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "address": "fa:16:3e:7e:a1:4c", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9993c7ac-e4", "ovs_interfaceid": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4953616c-6ab8-44e7-9644-490160ff0ba9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '4953616c-6ab8-44e7-9644-490160ff0ba9'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ef0e37fe-f031-428e-a009-a5e8768c021b', 'guest_format': None, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xcfGFVCj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'b7506745-ace5-45e2-bc1d-883f2c51f1c4', 'attached_at': '', 'detached_at': '', 'volume_id': '69263bc9-1275-443e-8f69-79a2098f3345', 'serial': '69263bc9-1275-443e-8f69-79a2098f3345'}, 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:31:02 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:31:02 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:31:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4953616c-6ab8-44e7-9644-490160ff0ba9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG nova.objects.instance [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lazy-loading 'vcpu_model' on Instance uuid b7506745-ace5-45e2-bc1d-883f2c51f1c4 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG nova.objects.base [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Object Instance<b7506745-ace5-45e2-bc1d-883f2c51f1c4> lazy-loaded attributes: resources,vcpu_model {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xcfGFVCj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:31:02 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:31:02 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:31:02 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf879318-9d65-4b24-9bad-05006f36d3ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:31:02 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57fad43-3049-4796-a785-40647396c337]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345] added
Aug 26 23:31:02 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk.rescue --force-share --output=json" returned: 0 in 0.228s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk (vdb) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2ca423-84ad-4ee4-8428-f40ced9ab004]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[906d6337-07f4-4a94-8523-85f1bb78fd8d]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xcfGFVCj {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xcfGFVCj" returned: 0 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba7b157-457c-4439-9ce6-6f253f97c083]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xcfGFVCj'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dacb433-4681-4cca-87b4-f920d4768b43]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[667d841d-a093-42dc-8b10-e12ec494f268]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:31:02 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:31:02 user nova-compute[73497]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:31:02 user nova-compute[73497]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)
Aug 26 23:31:02 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:31:02 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:31:02 user nova-compute[73497]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:31:02 user nova-compute[73497]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)
Aug 26 23:31:02 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[071efdac-07a1-4fab-8385-b0d0a2dbea01]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345, portal: 172.16.0.220,3260]
Aug 26 23:31:02 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345, portal: 172.16.0.220,3260] successful.
Aug 26 23:31:02 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa835aa-ff1e-4217-b539-d65b6960dce1]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2b82c5-53a2-49a1-87be-8641a2837540]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:31:02 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:31:02 user nova-compute[73497]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:31:02 user nova-compute[73497]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)
Aug 26 23:31:02 user nova-compute[73497]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)
Aug 26 23:31:02 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:31:02 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:31:02 user nova-compute[73497]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:31:02 user nova-compute[73497]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)
Aug 26 23:31:02 user nova-compute[73497]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)
Aug 26 23:31:02 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae76585e-3175-42be-a761-2e8689848723]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:31:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xcfGFVCj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:31:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json" returned: 0 in 0.268s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-82b13f20-9a48-444f-b69d-bb0a1c102458 req-3b294e76-74f0-4eac-bbaa-bf6ca7098706 service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Received event network-vif-plugged-9993c7ac-e4a2-41c8-97d9-75c681d68a6a {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:31:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-82b13f20-9a48-444f-b69d-bb0a1c102458 req-3b294e76-74f0-4eac-bbaa-bf6ca7098706 service nova] Acquiring lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:31:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-82b13f20-9a48-444f-b69d-bb0a1c102458 req-3b294e76-74f0-4eac-bbaa-bf6ca7098706 service nova] Lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:31:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-82b13f20-9a48-444f-b69d-bb0a1c102458 req-3b294e76-74f0-4eac-bbaa-bf6ca7098706 service nova] Lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:31:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-82b13f20-9a48-444f-b69d-bb0a1c102458 req-3b294e76-74f0-4eac-bbaa-bf6ca7098706 service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] No waiting events found dispatching network-vif-plugged-9993c7ac-e4a2-41c8-97d9-75c681d68a6a {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:31:03 user nova-compute[73497]: WARNING nova.compute.manager [req-82b13f20-9a48-444f-b69d-bb0a1c102458 req-3b294e76-74f0-4eac-bbaa-bf6ca7098706 service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Received unexpected event network-vif-plugged-9993c7ac-e4a2-41c8-97d9-75c681d68a6a for instance with vm_state active and task_state reboot_started_hard.
Aug 26 23:31:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:31:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] <== connect_volume: return (1416ms) {'type': 'block', 'scsi_wwn': '26135646236326630', 'path': '/dev/sdb'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:31:03 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135646236326630', 'path': '/dev/sdb'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:31:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:04 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:28:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1357907004',display_name='tempest-TestMinimumBasicScenario-server-1357907004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1357907004',id=34,image_ref='4953616c-6ab8-44e7-9644-490160ff0ba9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHawhLjVpHObEM1sejmZUdYQSEnONqYB9L2Qv/axMeT5kKxPx9/QuS/i5jErqR53WVLlmHVIBUw7Z4Scv0xP68Y1o8+EymV6cmPgQpjbZL+arFhxVBB0cTzGv9OLKbkK5Q==',key_name='tempest-TestMinimumBasicScenario-1395022215',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:28:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ae441ca35d847e89eb99397fe167960',ramdisk_id='',reservation_id='r-qslnut47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4953616c-6ab8-44e7-9644-490160ff0ba9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1836970755',owner_user_name='tempest-TestMinimumBasicScenario-1836970755-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:31:01Z,user_data=None,user_id='948c44e55c7c404fb660394a747cf162',uuid=b7506745-ace5-45e2-bc1d-883f2c51f1c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "address": "fa:16:3e:7e:a1:4c", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9993c7ac-e4", "ovs_interfaceid": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:31:04 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Converting VIF {"id": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "address": "fa:16:3e:7e:a1:4c", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9993c7ac-e4", "ovs_interfaceid": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:31:04 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:a1:4c,bridge_name='br-int',has_traffic_filtering=True,id=9993c7ac-e4a2-41c8-97d9-75c681d68a6a,network=Network(f11c42be-cba6-4e59-80b1-6fdd90a41c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9993c7ac-e4') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:31:04 user nova-compute[73497]: DEBUG nova.objects.instance [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lazy-loading 'pci_devices' on Instance uuid b7506745-ace5-45e2-bc1d-883f2c51f1c4 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:31:04 user nova-compute[73497]: DEBUG nova.objects.base [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Object Instance<b7506745-ace5-45e2-bc1d-883f2c51f1c4> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:31:04 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:31:04 user nova-compute[73497]:   <uuid>b7506745-ace5-45e2-bc1d-883f2c51f1c4</uuid>
Aug 26 23:31:04 user nova-compute[73497]:   <name>instance-00000022</name>
Aug 26 23:31:04 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:31:04 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:31:04 user nova-compute[73497]:   <metadata>
Aug 26 23:31:04 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:31:04 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:31:04 user nova-compute[73497]:       <nova:name>tempest-TestMinimumBasicScenario-server-1357907004</nova:name>
Aug 26 23:31:04 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:31:02</nova:creationTime>
Aug 26 23:31:04 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:31:04 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:31:04 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:31:04 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:31:04 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:31:04 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:31:04 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:31:04 user nova-compute[73497]:       <nova:owner>
Aug 26 23:31:04 user nova-compute[73497]:         <nova:user uuid="948c44e55c7c404fb660394a747cf162">tempest-TestMinimumBasicScenario-1836970755-project-member</nova:user>
Aug 26 23:31:04 user nova-compute[73497]:         <nova:project uuid="9ae441ca35d847e89eb99397fe167960">tempest-TestMinimumBasicScenario-1836970755</nova:project>
Aug 26 23:31:04 user nova-compute[73497]:       </nova:owner>
Aug 26 23:31:04 user nova-compute[73497]:       <nova:root type="image" uuid="4953616c-6ab8-44e7-9644-490160ff0ba9"/>
Aug 26 23:31:04 user nova-compute[73497]:       <nova:ports>
Aug 26 23:31:04 user nova-compute[73497]:         <nova:port uuid="9993c7ac-e4a2-41c8-97d9-75c681d68a6a">
Aug 26 23:31:04 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 23:31:04 user nova-compute[73497]:         </nova:port>
Aug 26 23:31:04 user nova-compute[73497]:       </nova:ports>
Aug 26 23:31:04 user nova-compute[73497]:     </nova:instance>
Aug 26 23:31:04 user nova-compute[73497]:   </metadata>
Aug 26 23:31:04 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:31:04 user nova-compute[73497]:     <system>
Aug 26 23:31:04 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:31:04 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:31:04 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:31:04 user nova-compute[73497]:       <entry name="serial">b7506745-ace5-45e2-bc1d-883f2c51f1c4</entry>
Aug 26 23:31:04 user nova-compute[73497]:       <entry name="uuid">b7506745-ace5-45e2-bc1d-883f2c51f1c4</entry>
Aug 26 23:31:04 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:31:04 user nova-compute[73497]:     </system>
Aug 26 23:31:04 user nova-compute[73497]:   </sysinfo>
Aug 26 23:31:04 user nova-compute[73497]:   <os>
Aug 26 23:31:04 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:31:04 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:31:04 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:31:04 user nova-compute[73497]:   </os>
Aug 26 23:31:04 user nova-compute[73497]:   <features>
Aug 26 23:31:04 user nova-compute[73497]:     <acpi/>
Aug 26 23:31:04 user nova-compute[73497]:     <apic/>
Aug 26 23:31:04 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:31:04 user nova-compute[73497]:   </features>
Aug 26 23:31:04 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:31:04 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:31:04 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:31:04 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:31:04 user nova-compute[73497]:   </clock>
Aug 26 23:31:04 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:31:04 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:31:04 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:31:04 user nova-compute[73497]:   </cpu>
Aug 26 23:31:04 user nova-compute[73497]:   <devices>
Aug 26 23:31:04 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:31:04 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:31:04 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/disk"/>
Aug 26 23:31:04 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:31:04 user nova-compute[73497]:     </disk>
Aug 26 23:31:04 user nova-compute[73497]:     <disk type="block" device="disk">
Aug 26 23:31:04 user nova-compute[73497]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:31:04 user nova-compute[73497]:       <source dev="/dev/sdb"/>
Aug 26 23:31:04 user nova-compute[73497]:       <target dev="vdb" bus="virtio"/>
Aug 26 23:31:04 user nova-compute[73497]:       <serial>69263bc9-1275-443e-8f69-79a2098f3345</serial>
Aug 26 23:31:04 user nova-compute[73497]:     </disk>
Aug 26 23:31:04 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:31:04 user nova-compute[73497]:       <mac address="fa:16:3e:7e:a1:4c"/>
Aug 26 23:31:04 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:31:04 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:31:04 user nova-compute[73497]:       <target dev="tap9993c7ac-e4"/>
Aug 26 23:31:04 user nova-compute[73497]:     </interface>
Aug 26 23:31:04 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:31:04 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/console.log" append="off"/>
Aug 26 23:31:04 user nova-compute[73497]:     </serial>
Aug 26 23:31:04 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:31:04 user nova-compute[73497]:     <video>
Aug 26 23:31:04 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:31:04 user nova-compute[73497]:     </video>
Aug 26 23:31:04 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:31:04 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:31:04 user nova-compute[73497]:     </rng>
Aug 26 23:31:04 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:31:04 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:31:04 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:31:04 user nova-compute[73497]:     </memballoon>
Aug 26 23:31:04 user nova-compute[73497]:   </devices>
Aug 26 23:31:04 user nova-compute[73497]: </domain>
Aug 26 23:31:04 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:31:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:04 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:31:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853bd672-97af-4e36-9bd4-5cc428b83765/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:04 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:31:04 user nova-compute[73497]: DEBUG nova.objects.instance [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lazy-loading 'trusted_certs' on Instance uuid b7506745-ace5-45e2-bc1d-883f2c51f1c4 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:31:04 user nova-compute[73497]: DEBUG nova.objects.base [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Object Instance<b7506745-ace5-45e2-bc1d-883f2c51f1c4> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:31:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d10355a36084f1abecfd1941abf367c9cbe44fa7 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853bd672-97af-4e36-9bd4-5cc428b83765/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853bd672-97af-4e36-9bd4-5cc428b83765/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d10355a36084f1abecfd1941abf367c9cbe44fa7 --force-share --output=json" returned: 0 in 0.260s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "853bd672-97af-4e36-9bd4-5cc428b83765" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:31:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "853bd672-97af-4e36-9bd4-5cc428b83765" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:31:04 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:31:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:04 user nova-compute[73497]: DEBUG nova.objects.instance [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lazy-loading 'flavor' on Instance uuid 853bd672-97af-4e36-9bd4-5cc428b83765 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:31:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853bd672-97af-4e36-9bd4-5cc428b83765/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:04 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Error from libvirt while getting description of instance-00000022: [Error Code 42] Domain not found: no domain with matching uuid 'b7506745-ace5-45e2-bc1d-883f2c51f1c4' (instance-00000022): libvirt.libvirtError: Domain not found: no domain with matching uuid 'b7506745-ace5-45e2-bc1d-883f2c51f1c4' (instance-00000022)
Aug 26 23:31:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "853bd672-97af-4e36-9bd4-5cc428b83765" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.152s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Cannot resize image /opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG nova.objects.instance [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lazy-loading 'migration_context' on Instance uuid b7506745-ace5-45e2-bc1d-883f2c51f1c4 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG nova.objects.base [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Object Instance<b7506745-ace5-45e2-bc1d-883f2c51f1c4> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:28:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1357907004',display_name='tempest-TestMinimumBasicScenario-server-1357907004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1357907004',id=34,image_ref='4953616c-6ab8-44e7-9644-490160ff0ba9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHawhLjVpHObEM1sejmZUdYQSEnONqYB9L2Qv/axMeT5kKxPx9/QuS/i5jErqR53WVLlmHVIBUw7Z4Scv0xP68Y1o8+EymV6cmPgQpjbZL+arFhxVBB0cTzGv9OLKbkK5Q==',key_name='tempest-TestMinimumBasicScenario-1395022215',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:28:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='9ae441ca35d847e89eb99397fe167960',ramdisk_id='',reservation_id='r-qslnut47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4953616c-6ab8-44e7-9644-490160ff0ba9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1836970755',owner_user_name='tempest-TestMinimumBasicScenario-1836970755-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:31:01Z,user_data=None,user_id='948c44e55c7c404fb660394a747cf162',uuid=b7506745-ace5-45e2-bc1d-883f2c51f1c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "address": "fa:16:3e:7e:a1:4c", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9993c7ac-e4", "ovs_interfaceid": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Converting VIF {"id": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "address": "fa:16:3e:7e:a1:4c", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9993c7ac-e4", "ovs_interfaceid": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:a1:4c,bridge_name='br-int',has_traffic_filtering=True,id=9993c7ac-e4a2-41c8-97d9-75c681d68a6a,network=Network(f11c42be-cba6-4e59-80b1-6fdd90a41c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9993c7ac-e4') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG os_vif [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:a1:4c,bridge_name='br-int',has_traffic_filtering=True,id=9993c7ac-e4a2-41c8-97d9-75c681d68a6a,network=Network(f11c42be-cba6-4e59-80b1-6fdd90a41c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9993c7ac-e4') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9993c7ac-e4, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9993c7ac-e4, col_values=(('external_ids', {'iface-id': '9993c7ac-e4a2-41c8-97d9-75c681d68a6a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:a1:4c', 'vm-uuid': 'b7506745-ace5-45e2-bc1d-883f2c51f1c4'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:05 user nova-compute[73497]: INFO os_vif [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:a1:4c,bridge_name='br-int',has_traffic_filtering=True,id=9993c7ac-e4a2-41c8-97d9-75c681d68a6a,network=Network(f11c42be-cba6-4e59-80b1-6fdd90a41c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9993c7ac-e4')
Aug 26 23:31:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "853bd672-97af-4e36-9bd4-5cc428b83765" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "853bd672-97af-4e36-9bd4-5cc428b83765" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:31:05 user nova-compute[73497]: INFO nova.compute.manager [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Attaching volume aa7890a7-30d4-442b-bb34-01dafe802a6f to /dev/vdb
Aug 26 23:31:05 user nova-compute[73497]: DEBUG os_brick.utils [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a16f52-8b16-4552-bdf5-94020906e563]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c095f4af-a885-4e79-9f03-65092c647b36]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ec597d-35a2-4234-8b14-f5211c75f87a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[519e67f7-d7e2-457a-8d53-474e7ef9f7fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:31:05 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:31:05 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b216f2-d117-4298-9970-96dfe0d9cfbe]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG os_brick.utils [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Updating existing volume attachment record: 66224119-1b96-4e6d-88e0-56d2311b4620 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:31:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:09 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Removed pending event for b7506745-ace5-45e2-bc1d-883f2c51f1c4 due to event {{(pid=73497) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 23:31:09 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092669.0953348, b7506745-ace5-45e2-bc1d-883f2c51f1c4 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:31:09 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] VM Resumed (Lifecycle Event)
Aug 26 23:31:09 user nova-compute[73497]: DEBUG nova.compute.manager [req-4c14dbaf-46bd-4a6d-b0d8-ef32363fdf50 req-558347c7-d0f2-4e32-85aa-fd9f14cdd7dc service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Received event network-vif-plugged-9993c7ac-e4a2-41c8-97d9-75c681d68a6a {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:31:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4c14dbaf-46bd-4a6d-b0d8-ef32363fdf50 req-558347c7-d0f2-4e32-85aa-fd9f14cdd7dc service nova] Acquiring lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:31:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4c14dbaf-46bd-4a6d-b0d8-ef32363fdf50 req-558347c7-d0f2-4e32-85aa-fd9f14cdd7dc service nova] Lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:31:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4c14dbaf-46bd-4a6d-b0d8-ef32363fdf50 req-558347c7-d0f2-4e32-85aa-fd9f14cdd7dc service nova] Lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:31:09 user nova-compute[73497]: DEBUG nova.compute.manager [req-4c14dbaf-46bd-4a6d-b0d8-ef32363fdf50 req-558347c7-d0f2-4e32-85aa-fd9f14cdd7dc service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] No waiting events found dispatching network-vif-plugged-9993c7ac-e4a2-41c8-97d9-75c681d68a6a {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:31:09 user nova-compute[73497]: WARNING nova.compute.manager [req-4c14dbaf-46bd-4a6d-b0d8-ef32363fdf50 req-558347c7-d0f2-4e32-85aa-fd9f14cdd7dc service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Received unexpected event network-vif-plugged-9993c7ac-e4a2-41c8-97d9-75c681d68a6a for instance with vm_state active and task_state reboot_started_hard.
Aug 26 23:31:09 user nova-compute[73497]: DEBUG nova.compute.manager [req-2527eb0b-9a19-4243-8967-b24f7fffac93 req-34153bd6-b463-4883-905a-5def36aae200 service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Received event network-vif-plugged-9993c7ac-e4a2-41c8-97d9-75c681d68a6a {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:31:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2527eb0b-9a19-4243-8967-b24f7fffac93 req-34153bd6-b463-4883-905a-5def36aae200 service nova] Acquiring lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:31:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2527eb0b-9a19-4243-8967-b24f7fffac93 req-34153bd6-b463-4883-905a-5def36aae200 service nova] Lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:31:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2527eb0b-9a19-4243-8967-b24f7fffac93 req-34153bd6-b463-4883-905a-5def36aae200 service nova] Lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:31:09 user nova-compute[73497]: DEBUG nova.compute.manager [req-2527eb0b-9a19-4243-8967-b24f7fffac93 req-34153bd6-b463-4883-905a-5def36aae200 service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] No waiting events found dispatching network-vif-plugged-9993c7ac-e4a2-41c8-97d9-75c681d68a6a {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:31:09 user nova-compute[73497]: WARNING nova.compute.manager [req-2527eb0b-9a19-4243-8967-b24f7fffac93 req-34153bd6-b463-4883-905a-5def36aae200 service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Received unexpected event network-vif-plugged-9993c7ac-e4a2-41c8-97d9-75c681d68a6a for instance with vm_state active and task_state reboot_started_hard.
Aug 26 23:31:09 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:31:09 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Instance rebooted successfully.
Aug 26 23:31:09 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:31:09 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:31:09 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:31:09 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=7318MB free_disk=24.98318099975586GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:31:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:31:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:31:09 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:31:09 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:31:09 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 26 23:31:09 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092669.0971622, b7506745-ace5-45e2-bc1d-883f2c51f1c4 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:31:09 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] VM Started (Lifecycle Event)
Aug 26 23:31:09 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:31:09 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:31:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c60456f9-bf94-4830-9696-ccf0fc44dcb6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 9.363s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:31:09 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 994093f0-e6b2-4c96-b259-c559ef2b1fbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:31:09 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 171985a3-358d-4b26-a66c-372b9b99b386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:31:09 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance aebaeda6-23d1-43a1-afc8-bdc8992067e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:31:09 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 043294e5-0618-4a31-bb19-1227ef1f5d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:31:09 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance e9e5c83f-0678-48d4-a81f-1a3f959aabcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:31:09 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance f7c83073-fadc-4e41-a4a9-df0bbe11aa28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:31:09 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 40afa348-8391-4643-977c-e67eab5c9476 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:31:09 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance e15ddee6-a642-4638-9534-21e640b3d017 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:31:09 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance b7506745-ace5-45e2-bc1d-883f2c51f1c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:31:09 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 853bd672-97af-4e36-9bd4-5cc428b83765 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:31:09 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:31:09 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:31:09 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:31:10 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:10 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693092655.2790575, c601f97e-9e52-40c6-9085-45f38e709721 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:31:10 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: c601f97e-9e52-40c6-9085-45f38e709721] VM Stopped (Lifecycle Event)
Aug 26 23:31:10 user nova-compute[73497]: DEBUG nova.compute.manager [None req-d79b04b6-6a7b-4bc3-a7e7-1d649902f6f9 None None] [instance: c601f97e-9e52-40c6-9085-45f38e709721] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:31:10 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:31:10 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:31:10 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:31:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.943s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:31:11 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:31:11 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:31:11 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:31:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-043294e5-0618-4a31-bb19-1227ef1f5d39" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:31:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-043294e5-0618-4a31-bb19-1227ef1f5d39" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:31:11 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:31:12 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Updating instance_info_cache with network_info: [{"id": "de273950-9851-448e-8ca2-ac699c12994e", "address": "fa:16:3e:fe:2b:69", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde273950-98", "ovs_interfaceid": "de273950-9851-448e-8ca2-ac699c12994e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:31:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-043294e5-0618-4a31-bb19-1227ef1f5d39" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:31:12 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:31:12 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:31:12 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:31:12 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:31:12 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:31:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:13 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:31:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Acquiring lock "b0e68638-bc72-4dd5-8399-7bf207b84b9e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:31:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Lock "b0e68638-bc72-4dd5-8399-7bf207b84b9e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:31:15 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:31:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:31:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:31:15 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:31:15 user nova-compute[73497]: INFO nova.compute.claims [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Claim successful on node user
Aug 26 23:31:15 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:31:15 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:31:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.682s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:31:15 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:31:16 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:31:16 user nova-compute[73497]: DEBUG nova.network.neutron [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:31:16 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:31:16 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:31:16 user nova-compute[73497]: DEBUG nova.policy [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b74def2c45ed436fa80455e81d501ed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20af6632e6144c14b9467a2fe40b177c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:31:16 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:31:16 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:31:16 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Creating image(s)
Aug 26 23:31:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Acquiring lock "/opt/stack/data/nova/instances/b0e68638-bc72-4dd5-8399-7bf207b84b9e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:31:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Lock "/opt/stack/data/nova/instances/b0e68638-bc72-4dd5-8399-7bf207b84b9e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:31:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Lock "/opt/stack/data/nova/instances/b0e68638-bc72-4dd5-8399-7bf207b84b9e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:31:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.200s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:31:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:31:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.183s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/b0e68638-bc72-4dd5-8399-7bf207b84b9e/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/b0e68638-bc72-4dd5-8399-7bf207b84b9e/disk 1073741824" returned: 0 in 0.050s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:31:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:16 user nova-compute[73497]: DEBUG nova.network.neutron [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Successfully created port: 21638ebe-d593-4c59-9448-e636a441ef73 {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:31:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.205s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:16 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b0e68638-bc72-4dd5-8399-7bf207b84b9e/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:31:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0e68638-bc72-4dd5-8399-7bf207b84b9e/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0e68638-bc72-4dd5-8399-7bf207b84b9e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:17 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Cannot resize image /opt/stack/data/nova/instances/b0e68638-bc72-4dd5-8399-7bf207b84b9e/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:31:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:31:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Ensure instance console log exists: /opt/stack/data/nova/instances/b0e68638-bc72-4dd5-8399-7bf207b84b9e/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:31:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:31:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:31:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:31:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:17 user nova-compute[73497]: DEBUG nova.network.neutron [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Successfully updated port: 21638ebe-d593-4c59-9448-e636a441ef73 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:31:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Acquiring lock "refresh_cache-b0e68638-bc72-4dd5-8399-7bf207b84b9e" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:31:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Acquired lock "refresh_cache-b0e68638-bc72-4dd5-8399-7bf207b84b9e" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:31:17 user nova-compute[73497]: DEBUG nova.network.neutron [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:31:17 user nova-compute[73497]: DEBUG nova.compute.manager [req-3594fcd9-74a6-491d-aa8e-6a767ea8a4cc req-dc22a92d-8d5a-428b-9e6e-024cfbb5e74f service nova] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Received event network-changed-21638ebe-d593-4c59-9448-e636a441ef73 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:31:17 user nova-compute[73497]: DEBUG nova.compute.manager [req-3594fcd9-74a6-491d-aa8e-6a767ea8a4cc req-dc22a92d-8d5a-428b-9e6e-024cfbb5e74f service nova] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Refreshing instance network info cache due to event network-changed-21638ebe-d593-4c59-9448-e636a441ef73. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:31:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3594fcd9-74a6-491d-aa8e-6a767ea8a4cc req-dc22a92d-8d5a-428b-9e6e-024cfbb5e74f service nova] Acquiring lock "refresh_cache-b0e68638-bc72-4dd5-8399-7bf207b84b9e" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:31:17 user nova-compute[73497]: DEBUG nova.network.neutron [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:31:17 user nova-compute[73497]: DEBUG nova.network.neutron [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Updating instance_info_cache with network_info: [{"id": "21638ebe-d593-4c59-9448-e636a441ef73", "address": "fa:16:3e:5d:12:d6", "network": {"id": "6b9c64ec-dcbd-4e55-8afe-ea10643d3640", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a72e239cc180405f8d119376217b6f9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21638ebe-d5", "ovs_interfaceid": "21638ebe-d593-4c59-9448-e636a441ef73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:31:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Releasing lock "refresh_cache-b0e68638-bc72-4dd5-8399-7bf207b84b9e" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:31:17 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Instance network_info: |[{"id": "21638ebe-d593-4c59-9448-e636a441ef73", "address": "fa:16:3e:5d:12:d6", "network": {"id": "6b9c64ec-dcbd-4e55-8afe-ea10643d3640", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a72e239cc180405f8d119376217b6f9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21638ebe-d5", "ovs_interfaceid": "21638ebe-d593-4c59-9448-e636a441ef73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:31:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3594fcd9-74a6-491d-aa8e-6a767ea8a4cc req-dc22a92d-8d5a-428b-9e6e-024cfbb5e74f service nova] Acquired lock "refresh_cache-b0e68638-bc72-4dd5-8399-7bf207b84b9e" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:31:17 user nova-compute[73497]: DEBUG nova.network.neutron [req-3594fcd9-74a6-491d-aa8e-6a767ea8a4cc req-dc22a92d-8d5a-428b-9e6e-024cfbb5e74f service nova] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Refreshing network info cache for port 21638ebe-d593-4c59-9448-e636a441ef73 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Start _get_guest_xml network_info=[{"id": "21638ebe-d593-4c59-9448-e636a441ef73", "address": "fa:16:3e:5d:12:d6", "network": {"id": "6b9c64ec-dcbd-4e55-8afe-ea10643d3640", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a72e239cc180405f8d119376217b6f9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21638ebe-d5", "ovs_interfaceid": "21638ebe-d593-4c59-9448-e636a441ef73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:31:18 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:31:18 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:31:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:31:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-981347675',display_name='tempest-VolumesNegativeTest-instance-981347675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-981347675',id=37,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20af6632e6144c14b9467a2fe40b177c',ramdisk_id='',reservation_id='r-1io6cube',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1933908261',owner_user_name='tempest-VolumesNegativeTest-1933908261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:31:16Z,user_data=None,user_id='b74def2c45ed436fa80455e81d501ed8',uuid=b0e68638-bc72-4dd5-8399-7bf207b84b9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21638ebe-d593-4c59-9448-e636a441ef73", "address": "fa:16:3e:5d:12:d6", "network": {"id": "6b9c64ec-dcbd-4e55-8afe-ea10643d3640", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a72e239cc180405f8d119376217b6f9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21638ebe-d5", "ovs_interfaceid": "21638ebe-d593-4c59-9448-e636a441ef73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Converting VIF {"id": "21638ebe-d593-4c59-9448-e636a441ef73", "address": "fa:16:3e:5d:12:d6", "network": {"id": "6b9c64ec-dcbd-4e55-8afe-ea10643d3640", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a72e239cc180405f8d119376217b6f9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21638ebe-d5", "ovs_interfaceid": "21638ebe-d593-4c59-9448-e636a441ef73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:12:d6,bridge_name='br-int',has_traffic_filtering=True,id=21638ebe-d593-4c59-9448-e636a441ef73,network=Network(6b9c64ec-dcbd-4e55-8afe-ea10643d3640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21638ebe-d5') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG nova.objects.instance [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Lazy-loading 'pci_devices' on Instance uuid b0e68638-bc72-4dd5-8399-7bf207b84b9e {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:31:18 user nova-compute[73497]:   <uuid>b0e68638-bc72-4dd5-8399-7bf207b84b9e</uuid>
Aug 26 23:31:18 user nova-compute[73497]:   <name>instance-00000025</name>
Aug 26 23:31:18 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:31:18 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:31:18 user nova-compute[73497]:   <metadata>
Aug 26 23:31:18 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:31:18 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:31:18 user nova-compute[73497]:       <nova:name>tempest-VolumesNegativeTest-instance-981347675</nova:name>
Aug 26 23:31:18 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:31:18</nova:creationTime>
Aug 26 23:31:18 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:31:18 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:31:18 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:31:18 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:31:18 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:31:18 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:31:18 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:31:18 user nova-compute[73497]:       <nova:owner>
Aug 26 23:31:18 user nova-compute[73497]:         <nova:user uuid="b74def2c45ed436fa80455e81d501ed8">tempest-VolumesNegativeTest-1933908261-project-member</nova:user>
Aug 26 23:31:18 user nova-compute[73497]:         <nova:project uuid="20af6632e6144c14b9467a2fe40b177c">tempest-VolumesNegativeTest-1933908261</nova:project>
Aug 26 23:31:18 user nova-compute[73497]:       </nova:owner>
Aug 26 23:31:18 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:31:18 user nova-compute[73497]:       <nova:ports>
Aug 26 23:31:18 user nova-compute[73497]:         <nova:port uuid="21638ebe-d593-4c59-9448-e636a441ef73">
Aug 26 23:31:18 user nova-compute[73497]:           <nova:ip type="fixed" address="192.168.233.138" ipVersion="4"/>
Aug 26 23:31:18 user nova-compute[73497]:         </nova:port>
Aug 26 23:31:18 user nova-compute[73497]:       </nova:ports>
Aug 26 23:31:18 user nova-compute[73497]:     </nova:instance>
Aug 26 23:31:18 user nova-compute[73497]:   </metadata>
Aug 26 23:31:18 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:31:18 user nova-compute[73497]:     <system>
Aug 26 23:31:18 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:31:18 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:31:18 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:31:18 user nova-compute[73497]:       <entry name="serial">b0e68638-bc72-4dd5-8399-7bf207b84b9e</entry>
Aug 26 23:31:18 user nova-compute[73497]:       <entry name="uuid">b0e68638-bc72-4dd5-8399-7bf207b84b9e</entry>
Aug 26 23:31:18 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:31:18 user nova-compute[73497]:     </system>
Aug 26 23:31:18 user nova-compute[73497]:   </sysinfo>
Aug 26 23:31:18 user nova-compute[73497]:   <os>
Aug 26 23:31:18 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:31:18 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:31:18 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:31:18 user nova-compute[73497]:   </os>
Aug 26 23:31:18 user nova-compute[73497]:   <features>
Aug 26 23:31:18 user nova-compute[73497]:     <acpi/>
Aug 26 23:31:18 user nova-compute[73497]:     <apic/>
Aug 26 23:31:18 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:31:18 user nova-compute[73497]:   </features>
Aug 26 23:31:18 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:31:18 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:31:18 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:31:18 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:31:18 user nova-compute[73497]:   </clock>
Aug 26 23:31:18 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:31:18 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:31:18 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:31:18 user nova-compute[73497]:   </cpu>
Aug 26 23:31:18 user nova-compute[73497]:   <devices>
Aug 26 23:31:18 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:31:18 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:31:18 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/b0e68638-bc72-4dd5-8399-7bf207b84b9e/disk"/>
Aug 26 23:31:18 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:31:18 user nova-compute[73497]:     </disk>
Aug 26 23:31:18 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:31:18 user nova-compute[73497]:       <mac address="fa:16:3e:5d:12:d6"/>
Aug 26 23:31:18 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:31:18 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:31:18 user nova-compute[73497]:       <target dev="tap21638ebe-d5"/>
Aug 26 23:31:18 user nova-compute[73497]:     </interface>
Aug 26 23:31:18 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:31:18 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/b0e68638-bc72-4dd5-8399-7bf207b84b9e/console.log" append="off"/>
Aug 26 23:31:18 user nova-compute[73497]:     </serial>
Aug 26 23:31:18 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:31:18 user nova-compute[73497]:     <video>
Aug 26 23:31:18 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:31:18 user nova-compute[73497]:     </video>
Aug 26 23:31:18 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:31:18 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:31:18 user nova-compute[73497]:     </rng>
Aug 26 23:31:18 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:31:18 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:31:18 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:31:18 user nova-compute[73497]:     </memballoon>
Aug 26 23:31:18 user nova-compute[73497]:   </devices>
Aug 26 23:31:18 user nova-compute[73497]: </domain>
Aug 26 23:31:18 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:31:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-981347675',display_name='tempest-VolumesNegativeTest-instance-981347675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-981347675',id=37,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20af6632e6144c14b9467a2fe40b177c',ramdisk_id='',reservation_id='r-1io6cube',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1933908261',owner_user_name='tempest-VolumesNegativeTest-1933908261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:31:16Z,user_data=None,user_id='b74def2c45ed436fa80455e81d501ed8',uuid=b0e68638-bc72-4dd5-8399-7bf207b84b9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21638ebe-d593-4c59-9448-e636a441ef73", "address": "fa:16:3e:5d:12:d6", "network": {"id": "6b9c64ec-dcbd-4e55-8afe-ea10643d3640", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a72e239cc180405f8d119376217b6f9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21638ebe-d5", "ovs_interfaceid": "21638ebe-d593-4c59-9448-e636a441ef73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Converting VIF {"id": "21638ebe-d593-4c59-9448-e636a441ef73", "address": "fa:16:3e:5d:12:d6", "network": {"id": "6b9c64ec-dcbd-4e55-8afe-ea10643d3640", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a72e239cc180405f8d119376217b6f9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21638ebe-d5", "ovs_interfaceid": "21638ebe-d593-4c59-9448-e636a441ef73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:12:d6,bridge_name='br-int',has_traffic_filtering=True,id=21638ebe-d593-4c59-9448-e636a441ef73,network=Network(6b9c64ec-dcbd-4e55-8afe-ea10643d3640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21638ebe-d5') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG os_vif [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:12:d6,bridge_name='br-int',has_traffic_filtering=True,id=21638ebe-d593-4c59-9448-e636a441ef73,network=Network(6b9c64ec-dcbd-4e55-8afe-ea10643d3640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21638ebe-d5') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21638ebe-d5, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap21638ebe-d5, col_values=(('external_ids', {'iface-id': '21638ebe-d593-4c59-9448-e636a441ef73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:12:d6', 'vm-uuid': 'b0e68638-bc72-4dd5-8399-7bf207b84b9e'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:18 user nova-compute[73497]: INFO os_vif [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:12:d6,bridge_name='br-int',has_traffic_filtering=True,id=21638ebe-d593-4c59-9448-e636a441ef73,network=Network(6b9c64ec-dcbd-4e55-8afe-ea10643d3640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21638ebe-d5')
Aug 26 23:31:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] No VIF found with MAC fa:16:3e:5d:12:d6, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG nova.network.neutron [req-3594fcd9-74a6-491d-aa8e-6a767ea8a4cc req-dc22a92d-8d5a-428b-9e6e-024cfbb5e74f service nova] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Updated VIF entry in instance network info cache for port 21638ebe-d593-4c59-9448-e636a441ef73. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG nova.network.neutron [req-3594fcd9-74a6-491d-aa8e-6a767ea8a4cc req-dc22a92d-8d5a-428b-9e6e-024cfbb5e74f service nova] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Updating instance_info_cache with network_info: [{"id": "21638ebe-d593-4c59-9448-e636a441ef73", "address": "fa:16:3e:5d:12:d6", "network": {"id": "6b9c64ec-dcbd-4e55-8afe-ea10643d3640", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a72e239cc180405f8d119376217b6f9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21638ebe-d5", "ovs_interfaceid": "21638ebe-d593-4c59-9448-e636a441ef73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:31:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3594fcd9-74a6-491d-aa8e-6a767ea8a4cc req-dc22a92d-8d5a-428b-9e6e-024cfbb5e74f service nova] Releasing lock "refresh_cache-b0e68638-bc72-4dd5-8399-7bf207b84b9e" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KTztlGWn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:31:19 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:31:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:31:19 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:31:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:31:19 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f682a690-deec-4016-830a-a2edd5a042b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:31:19 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0936b3-8887-4293-8541-0319904b1e93]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f] added
Aug 26 23:31:19 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.068s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19cfa57-ca68-43ff-8c3a-310b96795939]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[935e7af2-ac0a-42a5-aea9-b9707b81787e]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KTztlGWn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KTztlGWn" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60da668-0dc8-4e79-9814-d6ccc1d932b5]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KTztlGWn'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d75cb39-c5d1-496c-8115-f7409675660e]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3a8551-2893-4a51-b663-72602ae081a1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:31:19 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:31:19 user nova-compute[73497]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:31:19 user nova-compute[73497]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)
Aug 26 23:31:19 user nova-compute[73497]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)
Aug 26 23:31:19 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:31:19 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:31:19 user nova-compute[73497]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:31:19 user nova-compute[73497]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)
Aug 26 23:31:19 user nova-compute[73497]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)
Aug 26 23:31:19 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b580850-ddc1-40b6-89c4-922e7ae89913]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f, portal: 172.16.0.220,3260]
Aug 26 23:31:19 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f, portal: 172.16.0.220,3260] successful.
Aug 26 23:31:19 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b18e4a-30bf-49d4-84ac-8f103fb072f6]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[362c57d2-03c8-4a68-98e1-3115cc965726]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:31:19 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:31:19 user nova-compute[73497]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:31:19 user nova-compute[73497]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)
Aug 26 23:31:19 user nova-compute[73497]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)
Aug 26 23:31:19 user nova-compute[73497]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f (non-flash)
Aug 26 23:31:19 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:31:19 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:31:19 user nova-compute[73497]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:31:19 user nova-compute[73497]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)
Aug 26 23:31:19 user nova-compute[73497]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)
Aug 26 23:31:19 user nova-compute[73497]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f (non-flash)
Aug 26 23:31:19 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.399s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] HCTL ('38', '-', '-', 0) found on session 40 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[539fe802-c198-4c78-a1a6-8c762f7ec76c]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Searching for a device in session 40 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KTztlGWn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG nova.compute.manager [req-6d0cea8f-7939-42ce-b1b0-f4832802805b req-103fedae-8664-4d89-8557-b85a3f7ce6f5 service nova] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Received event network-changed-8e3698bc-dd93-41f1-a767-c634e383a1cb {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG nova.compute.manager [req-6d0cea8f-7939-42ce-b1b0-f4832802805b req-103fedae-8664-4d89-8557-b85a3f7ce6f5 service nova] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Refreshing instance network info cache due to event network-changed-8e3698bc-dd93-41f1-a767-c634e383a1cb. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6d0cea8f-7939-42ce-b1b0-f4832802805b req-103fedae-8664-4d89-8557-b85a3f7ce6f5 service nova] Acquiring lock "refresh_cache-e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6d0cea8f-7939-42ce-b1b0-f4832802805b req-103fedae-8664-4d89-8557-b85a3f7ce6f5 service nova] Acquired lock "refresh_cache-e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG nova.network.neutron [req-6d0cea8f-7939-42ce-b1b0-f4832802805b req-103fedae-8664-4d89-8557-b85a3f7ce6f5 service nova] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Refreshing network info cache for port 8e3698bc-dd93-41f1-a767-c634e383a1cb {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG nova.compute.manager [req-9454cf90-5cde-4d5f-b8dc-8fffa1abafde req-abe8446e-c9d8-4aec-8623-1cfe7e4b0e6d service nova] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Received event network-vif-plugged-21638ebe-d593-4c59-9448-e636a441ef73 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9454cf90-5cde-4d5f-b8dc-8fffa1abafde req-abe8446e-c9d8-4aec-8623-1cfe7e4b0e6d service nova] Acquiring lock "b0e68638-bc72-4dd5-8399-7bf207b84b9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9454cf90-5cde-4d5f-b8dc-8fffa1abafde req-abe8446e-c9d8-4aec-8623-1cfe7e4b0e6d service nova] Lock "b0e68638-bc72-4dd5-8399-7bf207b84b9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9454cf90-5cde-4d5f-b8dc-8fffa1abafde req-abe8446e-c9d8-4aec-8623-1cfe7e4b0e6d service nova] Lock "b0e68638-bc72-4dd5-8399-7bf207b84b9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:31:19 user nova-compute[73497]: DEBUG nova.compute.manager [req-9454cf90-5cde-4d5f-b8dc-8fffa1abafde req-abe8446e-c9d8-4aec-8623-1cfe7e4b0e6d service nova] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] No waiting events found dispatching network-vif-plugged-21638ebe-d593-4c59-9448-e636a441ef73 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:31:19 user nova-compute[73497]: WARNING nova.compute.manager [req-9454cf90-5cde-4d5f-b8dc-8fffa1abafde req-abe8446e-c9d8-4aec-8623-1cfe7e4b0e6d service nova] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Received unexpected event network-vif-plugged-21638ebe-d593-4c59-9448-e636a441ef73 for instance with vm_state building and task_state spawning.
Aug 26 23:31:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Acquiring lock "e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG nova.objects.instance [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lazy-loading 'flavor' on Instance uuid e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:31:20 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Ignoring supplied device name: /dev/vdb
Aug 26 23:31:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Acquiring lock "e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:31:20 user nova-compute[73497]: INFO nova.compute.manager [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Attaching volume 617b4eeb-6d93-4ed8-8765-cab4ccf86ef5 to /dev/vdb
Aug 26 23:31:20 user nova-compute[73497]: DEBUG os_brick.utils [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.443s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] <== connect_volume: return (1444ms) {'type': 'block', 'scsi_wwn': '26338326534323565', 'path': '/dev/sdg'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338326534323565', 'path': '/dev/sdg'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG nova.objects.instance [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lazy-loading 'flavor' on Instance uuid 853bd672-97af-4e36-9bd4-5cc428b83765 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e08a88-f3df-4f49-a0ce-61706f5afb0e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7289ba7c-e118-4d8d-a261-ce1ad0bda123]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 23:31:20 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:31:20 user nova-compute[73497]:   <source dev="/dev/sdg"/>
Aug 26 23:31:20 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:31:20 user nova-compute[73497]:   <serial>aa7890a7-30d4-442b-bb34-01dafe802a6f</serial>
Aug 26 23:31:20 user nova-compute[73497]: </disk>
Aug 26 23:31:20 user nova-compute[73497]:  {{(pid=73497) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d01618d-5488-4ab2-8321-e7d240efff31]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e68f71-8549-44b3-883c-4e485f0fa233]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:31:20 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:31:20 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6750ed7-0ba1-4179-bf83-8578ce20039d]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG os_brick.utils [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Updating existing volume attachment record: 3d8db4da-dc78-488b-8c6c-0d094159cfb1 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG nova.network.neutron [req-6d0cea8f-7939-42ce-b1b0-f4832802805b req-103fedae-8664-4d89-8557-b85a3f7ce6f5 service nova] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Updated VIF entry in instance network info cache for port 8e3698bc-dd93-41f1-a767-c634e383a1cb. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG nova.network.neutron [req-6d0cea8f-7939-42ce-b1b0-f4832802805b req-103fedae-8664-4d89-8557-b85a3f7ce6f5 service nova] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Updating instance_info_cache with network_info: [{"id": "8e3698bc-dd93-41f1-a767-c634e383a1cb", "address": "fa:16:3e:67:db:0c", "network": {"id": "bc10efbc-a86e-4a1d-8a40-bc508dd2a6db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1634677403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "077c6c937fcc4d8d95eb66d8d7f87167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e3698bc-dd", "ovs_interfaceid": "8e3698bc-dd93-41f1-a767-c634e383a1cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] No VIF found with MAC fa:16:3e:75:d8:38, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:31:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6d0cea8f-7939-42ce-b1b0-f4832802805b req-103fedae-8664-4d89-8557-b85a3f7ce6f5 service nova] Releasing lock "refresh_cache-e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:31:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8a764382-6a40-48db-8399-1380de2655da tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "853bd672-97af-4e36-9bd4-5cc428b83765" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.954s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:31:21 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092681.8834767, b0e68638-bc72-4dd5-8399-7bf207b84b9e => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:31:21 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] VM Resumed (Lifecycle Event)
Aug 26 23:31:21 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:31:21 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:31:21 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Instance spawned successfully.
Aug 26 23:31:21 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:31:21 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:31:21 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:31:21 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:31:21 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:31:21 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:31:21 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:31:21 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:31:21 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:31:21 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:31:21 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092681.8869076, b0e68638-bc72-4dd5-8399-7bf207b84b9e => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:31:21 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] VM Started (Lifecycle Event)
Aug 26 23:31:21 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:31:21 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:31:21 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:31:21 user nova-compute[73497]: DEBUG nova.compute.manager [req-6928d0c6-405f-441c-af69-8c2a4b9c1bdd req-2d1d94e7-614c-4976-a291-8ad0a2d2076f service nova] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Received event network-vif-plugged-21638ebe-d593-4c59-9448-e636a441ef73 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:31:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6928d0c6-405f-441c-af69-8c2a4b9c1bdd req-2d1d94e7-614c-4976-a291-8ad0a2d2076f service nova] Acquiring lock "b0e68638-bc72-4dd5-8399-7bf207b84b9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:31:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6928d0c6-405f-441c-af69-8c2a4b9c1bdd req-2d1d94e7-614c-4976-a291-8ad0a2d2076f service nova] Lock "b0e68638-bc72-4dd5-8399-7bf207b84b9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:31:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6928d0c6-405f-441c-af69-8c2a4b9c1bdd req-2d1d94e7-614c-4976-a291-8ad0a2d2076f service nova] Lock "b0e68638-bc72-4dd5-8399-7bf207b84b9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:31:21 user nova-compute[73497]: DEBUG nova.compute.manager [req-6928d0c6-405f-441c-af69-8c2a4b9c1bdd req-2d1d94e7-614c-4976-a291-8ad0a2d2076f service nova] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] No waiting events found dispatching network-vif-plugged-21638ebe-d593-4c59-9448-e636a441ef73 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:31:21 user nova-compute[73497]: WARNING nova.compute.manager [req-6928d0c6-405f-441c-af69-8c2a4b9c1bdd req-2d1d94e7-614c-4976-a291-8ad0a2d2076f service nova] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Received unexpected event network-vif-plugged-21638ebe-d593-4c59-9448-e636a441ef73 for instance with vm_state building and task_state spawning.
Aug 26 23:31:22 user nova-compute[73497]: INFO nova.compute.manager [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Took 5.76 seconds to spawn the instance on the hypervisor.
Aug 26 23:31:22 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:31:22 user nova-compute[73497]: INFO nova.compute.manager [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Took 6.82 seconds to build instance.
Aug 26 23:31:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c1176111-b541-4bd5-8f59-9f3e3e1bedcf tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Lock "b0e68638-bc72-4dd5-8399-7bf207b84b9e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.923s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:31:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-68785acf-d4f9-4dd2-92bc-3b22aa9e8838 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "853bd672-97af-4e36-9bd4-5cc428b83765" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:31:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-68785acf-d4f9-4dd2-92bc-3b22aa9e8838 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "853bd672-97af-4e36-9bd4-5cc428b83765" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:31:22 user nova-compute[73497]: INFO nova.compute.manager [None req-68785acf-d4f9-4dd2-92bc-3b22aa9e8838 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Detaching volume aa7890a7-30d4-442b-bb34-01dafe802a6f
Aug 26 23:31:22 user nova-compute[73497]: INFO nova.virt.block_device [None req-68785acf-d4f9-4dd2-92bc-3b22aa9e8838 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Attempting to driver detach volume aa7890a7-30d4-442b-bb34-01dafe802a6f from mountpoint /dev/vdb
Aug 26 23:31:22 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-68785acf-d4f9-4dd2-92bc-3b22aa9e8838 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Attempting to detach device vdb from instance 853bd672-97af-4e36-9bd4-5cc428b83765 from the persistent domain config. {{(pid=73497) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 23:31:22 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-68785acf-d4f9-4dd2-92bc-3b22aa9e8838 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:31:22 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:31:22 user nova-compute[73497]:   <source dev="/dev/sdg"/>
Aug 26 23:31:22 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:31:22 user nova-compute[73497]:   <serial>aa7890a7-30d4-442b-bb34-01dafe802a6f</serial>
Aug 26 23:31:22 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:31:22 user nova-compute[73497]: </disk>
Aug 26 23:31:22 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:31:22 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-68785acf-d4f9-4dd2-92bc-3b22aa9e8838 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Successfully detached device vdb from instance 853bd672-97af-4e36-9bd4-5cc428b83765 from the persistent domain config.
Aug 26 23:31:22 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-68785acf-d4f9-4dd2-92bc-3b22aa9e8838 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 853bd672-97af-4e36-9bd4-5cc428b83765 from the live domain config. {{(pid=73497) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 23:31:22 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-68785acf-d4f9-4dd2-92bc-3b22aa9e8838 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:31:22 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:31:22 user nova-compute[73497]:   <source dev="/dev/sdg"/>
Aug 26 23:31:22 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:31:22 user nova-compute[73497]:   <serial>aa7890a7-30d4-442b-bb34-01dafe802a6f</serial>
Aug 26 23:31:22 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:31:22 user nova-compute[73497]: </disk>
Aug 26 23:31:22 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Received event <DeviceRemovedEvent: 1693092683.2532313, 853bd672-97af-4e36-9bd4-5cc428b83765 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73497) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-68785acf-d4f9-4dd2-92bc-3b22aa9e8838 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 853bd672-97af-4e36-9bd4-5cc428b83765 {{(pid=73497) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 23:31:23 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-68785acf-d4f9-4dd2-92bc-3b22aa9e8838 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Successfully detached device vdb from instance 853bd672-97af-4e36-9bd4-5cc428b83765 from the live domain config.
Aug 26 23:31:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68785acf-d4f9-4dd2-92bc-3b22aa9e8838 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-68785acf-d4f9-4dd2-92bc-3b22aa9e8838 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KTztlGWn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:31:23 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-68785acf-d4f9-4dd2-92bc-3b22aa9e8838 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:31:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-68785acf-d4f9-4dd2-92bc-3b22aa9e8838 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-68785acf-d4f9-4dd2-92bc-3b22aa9e8838 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-68785acf-d4f9-4dd2-92bc-3b22aa9e8838 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4c5dee-ed13-42db-a6d3-5ad233b599af]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a100c1a-b81f-4b48-aa44-4fab92e92bab]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-68785acf-d4f9-4dd2-92bc-3b22aa9e8838 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:31:23 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:31:23 user nova-compute[73497]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:31:23 user nova-compute[73497]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)
Aug 26 23:31:23 user nova-compute[73497]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)
Aug 26 23:31:23 user nova-compute[73497]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f (non-flash)
Aug 26 23:31:23 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-68785acf-d4f9-4dd2-92bc-3b22aa9e8838 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:31:23 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:31:23 user nova-compute[73497]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:31:23 user nova-compute[73497]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)
Aug 26 23:31:23 user nova-compute[73497]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)
Aug 26 23:31:23 user nova-compute[73497]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f (non-flash)
Aug 26 23:31:23 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-68785acf-d4f9-4dd2-92bc-3b22aa9e8838 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281c56dd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f'): ({'sdg'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-68785acf-d4f9-4dd2-92bc-3b22aa9e8838 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Removing single pathed devices sdg {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[823c5e66-2fe3-4c84-8f3d-3ad08d170be9]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33d2046-0342-4fef-9bc4-5668d096ec1f]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-68785acf-d4f9-4dd2-92bc-3b22aa9e8838 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Flushing IO for device /dev/sdg {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf20ff0-2068-489a-94bf-3bacd930f3ab]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-68785acf-d4f9-4dd2-92bc-3b22aa9e8838 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "40afa348-8391-4643-977c-e67eab5c9476" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "40afa348-8391-4643-977c-e67eab5c9476" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "40afa348-8391-4643-977c-e67eab5c9476-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "40afa348-8391-4643-977c-e67eab5c9476-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "40afa348-8391-4643-977c-e67eab5c9476-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:31:23 user nova-compute[73497]: INFO nova.compute.manager [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Terminating instance
Aug 26 23:31:23 user nova-compute[73497]: DEBUG nova.compute.manager [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.050s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbb31dc-1500-4ce3-a899-9af14fa6912c]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-68785acf-d4f9-4dd2-92bc-3b22aa9e8838 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-68785acf-d4f9-4dd2-92bc-3b22aa9e8838 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] SCSI volumes sdg have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-68785acf-d4f9-4dd2-92bc-3b22aa9e8838 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.041s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd35c48-7f9d-4127-8c86-b601554237a8]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-68785acf-d4f9-4dd2-92bc-3b22aa9e8838 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[62582ecc-195b-4512-86aa-cf132d464067]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-68785acf-d4f9-4dd2-92bc-3b22aa9e8838 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f, portal: 172.16.0.220,3260]
Aug 26 23:31:23 user nova-compute[73497]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f, portal: 172.16.0.220,3260] successful.
Aug 26 23:31:23 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa7890a7-30d4-442b-bb34-01dafe802a6f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6946fa-96b7-4e4b-b6ac-9c95344a63d0]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-68785acf-d4f9-4dd2-92bc-3b22aa9e8838 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-68785acf-d4f9-4dd2-92bc-3b22aa9e8838 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-68785acf-d4f9-4dd2-92bc-3b22aa9e8838 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] <== disconnect_volume: return (379ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68785acf-d4f9-4dd2-92bc-3b22aa9e8838 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:23 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG nova.compute.manager [req-536056cd-3637-4303-a948-73e32f2add8c req-c50f98ac-96f5-4d16-aeb3-3ee73baef2ff service nova] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Received event network-vif-unplugged-1839e5ce-756d-4e0c-bf8c-f8a63976cb79 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-536056cd-3637-4303-a948-73e32f2add8c req-c50f98ac-96f5-4d16-aeb3-3ee73baef2ff service nova] Acquiring lock "40afa348-8391-4643-977c-e67eab5c9476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-536056cd-3637-4303-a948-73e32f2add8c req-c50f98ac-96f5-4d16-aeb3-3ee73baef2ff service nova] Lock "40afa348-8391-4643-977c-e67eab5c9476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-536056cd-3637-4303-a948-73e32f2add8c req-c50f98ac-96f5-4d16-aeb3-3ee73baef2ff service nova] Lock "40afa348-8391-4643-977c-e67eab5c9476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG nova.compute.manager [req-536056cd-3637-4303-a948-73e32f2add8c req-c50f98ac-96f5-4d16-aeb3-3ee73baef2ff service nova] [instance: 40afa348-8391-4643-977c-e67eab5c9476] No waiting events found dispatching network-vif-unplugged-1839e5ce-756d-4e0c-bf8c-f8a63976cb79 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG nova.compute.manager [req-536056cd-3637-4303-a948-73e32f2add8c req-c50f98ac-96f5-4d16-aeb3-3ee73baef2ff service nova] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Received event network-vif-unplugged-1839e5ce-756d-4e0c-bf8c-f8a63976cb79 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG nova.compute.manager [req-536056cd-3637-4303-a948-73e32f2add8c req-c50f98ac-96f5-4d16-aeb3-3ee73baef2ff service nova] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Received event network-vif-plugged-1839e5ce-756d-4e0c-bf8c-f8a63976cb79 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-536056cd-3637-4303-a948-73e32f2add8c req-c50f98ac-96f5-4d16-aeb3-3ee73baef2ff service nova] Acquiring lock "40afa348-8391-4643-977c-e67eab5c9476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-536056cd-3637-4303-a948-73e32f2add8c req-c50f98ac-96f5-4d16-aeb3-3ee73baef2ff service nova] Lock "40afa348-8391-4643-977c-e67eab5c9476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-536056cd-3637-4303-a948-73e32f2add8c req-c50f98ac-96f5-4d16-aeb3-3ee73baef2ff service nova] Lock "40afa348-8391-4643-977c-e67eab5c9476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG nova.compute.manager [req-536056cd-3637-4303-a948-73e32f2add8c req-c50f98ac-96f5-4d16-aeb3-3ee73baef2ff service nova] [instance: 40afa348-8391-4643-977c-e67eab5c9476] No waiting events found dispatching network-vif-plugged-1839e5ce-756d-4e0c-bf8c-f8a63976cb79 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:31:24 user nova-compute[73497]: WARNING nova.compute.manager [req-536056cd-3637-4303-a948-73e32f2add8c req-c50f98ac-96f5-4d16-aeb3-3ee73baef2ff service nova] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Received unexpected event network-vif-plugged-1839e5ce-756d-4e0c-bf8c-f8a63976cb79 for instance with vm_state active and task_state deleting.
Aug 26 23:31:24 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Instance destroyed successfully.
Aug 26 23:31:24 user nova-compute[73497]: DEBUG nova.objects.instance [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lazy-loading 'resources' on Instance uuid 40afa348-8391-4643-977c-e67eab5c9476 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:24:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2022799057',display_name='tempest-ServerActionsTestOtherA-server-2022799057',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2022799057',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkEfHl6zG9yr5sr9jutwV2XJmeMlhN65J2njpgcQb6mCyEUk0cV6s9h2VdW+/plwoOss4vho5+nme8j0/zabYBtL74xkosuFNe1bIAfxbSswJHdqiCv1/r8WNi7pn3DAQ==',key_name='tempest-keypair-1008924037',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:27:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80c212cbb083450ea15ec54a96f12510',ramdisk_id='',reservation_id='r-8ixi3cop',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-81910947',owner_user_name='tempest-ServerActionsTestOtherA-81910947-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:28:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='935b8635557949cfba9b6528b97da95f',uuid=40afa348-8391-4643-977c-e67eab5c9476,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "address": "fa:16:3e:c5:a7:fc", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1839e5ce-75", "ovs_interfaceid": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Converting VIF {"id": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "address": "fa:16:3e:c5:a7:fc", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1839e5ce-75", "ovs_interfaceid": "1839e5ce-756d-4e0c-bf8c-f8a63976cb79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:a7:fc,bridge_name='br-int',has_traffic_filtering=True,id=1839e5ce-756d-4e0c-bf8c-f8a63976cb79,network=Network(bf99a38a-faaf-4f1e-a161-736ce9089919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1839e5ce-75') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG os_vif [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:a7:fc,bridge_name='br-int',has_traffic_filtering=True,id=1839e5ce-756d-4e0c-bf8c-f8a63976cb79,network=Network(bf99a38a-faaf-4f1e-a161-736ce9089919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1839e5ce-75') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1839e5ce-75, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:31:24 user nova-compute[73497]: INFO os_vif [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:a7:fc,bridge_name='br-int',has_traffic_filtering=True,id=1839e5ce-756d-4e0c-bf8c-f8a63976cb79,network=Network(bf99a38a-faaf-4f1e-a161-736ce9089919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1839e5ce-75')
Aug 26 23:31:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbLpraVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:31:24 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:31:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db88267-ce70-4b1a-b636-e58dea7652c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7a6d53-b4e1-4e91-8277-fa7f0f747cb2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:31:24 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:31:24 user nova-compute[73497]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:31:24 user nova-compute[73497]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)
Aug 26 23:31:24 user nova-compute[73497]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)
Aug 26 23:31:24 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:31:24 user nova-compute[73497]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 (non-flash)
Aug 26 23:31:24 user nova-compute[73497]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:31:24 user nova-compute[73497]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)
Aug 26 23:31:24 user nova-compute[73497]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)
Aug 26 23:31:24 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282c45a560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61'): ({'sdd'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Removing single pathed devices sdd {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13ab8ed-2242-41df-86d3-bd6c8812cd6b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdebed5d-6e4c-441f-8283-8644418247cc]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Flushing IO for device /dev/sdd {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c84fe2-5d5d-4033-93cc-f65513cfd7c3]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdca2827-e0b5-4cf1-8c0c-9a1ec221b64c]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] SCSI volumes sdd have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a89f0e2-68d8-4ddf-a104-0f068b98b7ce]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab87e81-d23b-4834-9269-0f8c3e153b63]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61, portal: 172.16.0.220,3260]
Aug 26 23:31:24 user nova-compute[73497]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61, portal: 172.16.0.220,3260] successful.
Aug 26 23:31:24 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cc4471-9aff-4907-8edf-fb34125e8c61 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff16607e-4b6b-4169-8d96-0d47bc1fe925]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] <== disconnect_volume: return (341ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:31:24 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Deleting instance files /opt/stack/data/nova/instances/40afa348-8391-4643-977c-e67eab5c9476_del
Aug 26 23:31:24 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Deletion of /opt/stack/data/nova/instances/40afa348-8391-4643-977c-e67eab5c9476_del complete
Aug 26 23:31:24 user nova-compute[73497]: INFO nova.compute.manager [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 26 23:31:24 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 40afa348-8391-4643-977c-e67eab5c9476] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG nova.objects.instance [None req-68785acf-d4f9-4dd2-92bc-3b22aa9e8838 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lazy-loading 'flavor' on Instance uuid 853bd672-97af-4e36-9bd4-5cc428b83765 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:31:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-68785acf-d4f9-4dd2-92bc-3b22aa9e8838 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "853bd672-97af-4e36-9bd4-5cc428b83765" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.217s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:31:25 user nova-compute[73497]: INFO nova.compute.manager [None req-536a9fdc-50af-48ab-990f-cd6b0e060eb4 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Unrescuing
Aug 26 23:31:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-536a9fdc-50af-48ab-990f-cd6b0e060eb4 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "refresh_cache-e15ddee6-a642-4638-9534-21e640b3d017" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:31:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-536a9fdc-50af-48ab-990f-cd6b0e060eb4 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquired lock "refresh_cache-e15ddee6-a642-4638-9534-21e640b3d017" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:31:25 user nova-compute[73497]: DEBUG nova.network.neutron [None req-536a9fdc-50af-48ab-990f-cd6b0e060eb4 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:31:25 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:31:26 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Took 1.30 seconds to deallocate network for instance.
Aug 26 23:31:26 user nova-compute[73497]: DEBUG nova.compute.manager [req-83cf344b-76f7-4ce2-a0e1-71222cf9e636 req-6ac6c394-b564-45ed-96aa-271e27d215d5 service nova] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Received event network-vif-deleted-1839e5ce-756d-4e0c-bf8c-f8a63976cb79 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:31:26 user nova-compute[73497]: DEBUG nova.network.neutron [None req-536a9fdc-50af-48ab-990f-cd6b0e060eb4 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Updating instance_info_cache with network_info: [{"id": "8d982123-d2ef-4d00-95d1-bee24f228175", "address": "fa:16:3e:e8:ce:24", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d982123-d2", "ovs_interfaceid": "8d982123-d2ef-4d00-95d1-bee24f228175", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:31:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-536a9fdc-50af-48ab-990f-cd6b0e060eb4 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Releasing lock "refresh_cache-e15ddee6-a642-4638-9534-21e640b3d017" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:31:26 user nova-compute[73497]: DEBUG nova.objects.instance [None req-536a9fdc-50af-48ab-990f-cd6b0e060eb4 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lazy-loading 'flavor' on Instance uuid e15ddee6-a642-4638-9534-21e640b3d017 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:31:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:26 user nova-compute[73497]: INFO nova.compute.manager [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Took 0.91 seconds to detach 1 volumes for instance.
Aug 26 23:31:26 user nova-compute[73497]: DEBUG nova.compute.manager [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Deleting volume: b5cc4471-9aff-4907-8edf-fb34125e8c61 {{(pid=73497) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 23:31:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:31:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:31:27 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Instance destroyed successfully.
Aug 26 23:31:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:27 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:31:27 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:31:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.442s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:31:27 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Deleted allocations for instance 40afa348-8391-4643-977c-e67eab5c9476
Aug 26 23:31:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ca656551-d389-4f74-8849-568bb9e72b36 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "40afa348-8391-4643-977c-e67eab5c9476" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.238s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:31:28 user nova-compute[73497]: DEBUG nova.compute.manager [req-233d7c08-68a5-44aa-8215-58573347750c req-9ea5715a-ce6d-4099-932f-cef43e490ce5 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Received event network-vif-unplugged-8d982123-d2ef-4d00-95d1-bee24f228175 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:31:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-233d7c08-68a5-44aa-8215-58573347750c req-9ea5715a-ce6d-4099-932f-cef43e490ce5 service nova] Acquiring lock "e15ddee6-a642-4638-9534-21e640b3d017-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:31:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-233d7c08-68a5-44aa-8215-58573347750c req-9ea5715a-ce6d-4099-932f-cef43e490ce5 service nova] Lock "e15ddee6-a642-4638-9534-21e640b3d017-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:31:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-233d7c08-68a5-44aa-8215-58573347750c req-9ea5715a-ce6d-4099-932f-cef43e490ce5 service nova] Lock "e15ddee6-a642-4638-9534-21e640b3d017-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:31:28 user nova-compute[73497]: DEBUG nova.compute.manager [req-233d7c08-68a5-44aa-8215-58573347750c req-9ea5715a-ce6d-4099-932f-cef43e490ce5 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] No waiting events found dispatching network-vif-unplugged-8d982123-d2ef-4d00-95d1-bee24f228175 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:31:28 user nova-compute[73497]: WARNING nova.compute.manager [req-233d7c08-68a5-44aa-8215-58573347750c req-9ea5715a-ce6d-4099-932f-cef43e490ce5 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Received unexpected event network-vif-unplugged-8d982123-d2ef-4d00-95d1-bee24f228175 for instance with vm_state rescued and task_state unrescuing.
Aug 26 23:31:28 user nova-compute[73497]: DEBUG nova.compute.manager [req-233d7c08-68a5-44aa-8215-58573347750c req-9ea5715a-ce6d-4099-932f-cef43e490ce5 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Received event network-vif-plugged-8d982123-d2ef-4d00-95d1-bee24f228175 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:31:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-233d7c08-68a5-44aa-8215-58573347750c req-9ea5715a-ce6d-4099-932f-cef43e490ce5 service nova] Acquiring lock "e15ddee6-a642-4638-9534-21e640b3d017-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:31:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-233d7c08-68a5-44aa-8215-58573347750c req-9ea5715a-ce6d-4099-932f-cef43e490ce5 service nova] Lock "e15ddee6-a642-4638-9534-21e640b3d017-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:31:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-233d7c08-68a5-44aa-8215-58573347750c req-9ea5715a-ce6d-4099-932f-cef43e490ce5 service nova] Lock "e15ddee6-a642-4638-9534-21e640b3d017-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:31:28 user nova-compute[73497]: DEBUG nova.compute.manager [req-233d7c08-68a5-44aa-8215-58573347750c req-9ea5715a-ce6d-4099-932f-cef43e490ce5 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] No waiting events found dispatching network-vif-plugged-8d982123-d2ef-4d00-95d1-bee24f228175 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:31:28 user nova-compute[73497]: WARNING nova.compute.manager [req-233d7c08-68a5-44aa-8215-58573347750c req-9ea5715a-ce6d-4099-932f-cef43e490ce5 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Received unexpected event network-vif-plugged-8d982123-d2ef-4d00-95d1-bee24f228175 for instance with vm_state rescued and task_state unrescuing.
Aug 26 23:31:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:30 user nova-compute[73497]: DEBUG nova.compute.manager [req-ec3332d9-e1d6-4030-a937-794a29a4d9b6 req-8ff27be8-d31f-4791-89af-59c5b83c11e1 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Received event network-vif-plugged-8d982123-d2ef-4d00-95d1-bee24f228175 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:31:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ec3332d9-e1d6-4030-a937-794a29a4d9b6 req-8ff27be8-d31f-4791-89af-59c5b83c11e1 service nova] Acquiring lock "e15ddee6-a642-4638-9534-21e640b3d017-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:31:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ec3332d9-e1d6-4030-a937-794a29a4d9b6 req-8ff27be8-d31f-4791-89af-59c5b83c11e1 service nova] Lock "e15ddee6-a642-4638-9534-21e640b3d017-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:31:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ec3332d9-e1d6-4030-a937-794a29a4d9b6 req-8ff27be8-d31f-4791-89af-59c5b83c11e1 service nova] Lock "e15ddee6-a642-4638-9534-21e640b3d017-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:31:30 user nova-compute[73497]: DEBUG nova.compute.manager [req-ec3332d9-e1d6-4030-a937-794a29a4d9b6 req-8ff27be8-d31f-4791-89af-59c5b83c11e1 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] No waiting events found dispatching network-vif-plugged-8d982123-d2ef-4d00-95d1-bee24f228175 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:31:30 user nova-compute[73497]: WARNING nova.compute.manager [req-ec3332d9-e1d6-4030-a937-794a29a4d9b6 req-8ff27be8-d31f-4791-89af-59c5b83c11e1 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Received unexpected event network-vif-plugged-8d982123-d2ef-4d00-95d1-bee24f228175 for instance with vm_state rescued and task_state unrescuing.
Aug 26 23:31:30 user nova-compute[73497]: DEBUG nova.compute.manager [req-ec3332d9-e1d6-4030-a937-794a29a4d9b6 req-8ff27be8-d31f-4791-89af-59c5b83c11e1 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Received event network-vif-plugged-8d982123-d2ef-4d00-95d1-bee24f228175 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:31:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ec3332d9-e1d6-4030-a937-794a29a4d9b6 req-8ff27be8-d31f-4791-89af-59c5b83c11e1 service nova] Acquiring lock "e15ddee6-a642-4638-9534-21e640b3d017-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:31:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ec3332d9-e1d6-4030-a937-794a29a4d9b6 req-8ff27be8-d31f-4791-89af-59c5b83c11e1 service nova] Lock "e15ddee6-a642-4638-9534-21e640b3d017-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:31:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ec3332d9-e1d6-4030-a937-794a29a4d9b6 req-8ff27be8-d31f-4791-89af-59c5b83c11e1 service nova] Lock "e15ddee6-a642-4638-9534-21e640b3d017-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:31:30 user nova-compute[73497]: DEBUG nova.compute.manager [req-ec3332d9-e1d6-4030-a937-794a29a4d9b6 req-8ff27be8-d31f-4791-89af-59c5b83c11e1 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] No waiting events found dispatching network-vif-plugged-8d982123-d2ef-4d00-95d1-bee24f228175 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:31:30 user nova-compute[73497]: WARNING nova.compute.manager [req-ec3332d9-e1d6-4030-a937-794a29a4d9b6 req-8ff27be8-d31f-4791-89af-59c5b83c11e1 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Received unexpected event network-vif-plugged-8d982123-d2ef-4d00-95d1-bee24f228175 for instance with vm_state rescued and task_state unrescuing.
Aug 26 23:31:30 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Removed pending event for e15ddee6-a642-4638-9534-21e640b3d017 due to event {{(pid=73497) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 23:31:30 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092690.9510806, e15ddee6-a642-4638-9534-21e640b3d017 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:31:30 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e15ddee6-a642-4638-9534-21e640b3d017] VM Resumed (Lifecycle Event)
Aug 26 23:31:30 user nova-compute[73497]: DEBUG nova.compute.manager [None req-536a9fdc-50af-48ab-990f-cd6b0e060eb4 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:31:30 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:31:30 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:31:31 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e15ddee6-a642-4638-9534-21e640b3d017] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 23:31:31 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092690.9554658, e15ddee6-a642-4638-9534-21e640b3d017 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:31:31 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e15ddee6-a642-4638-9534-21e640b3d017] VM Started (Lifecycle Event)
Aug 26 23:31:31 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:31:31 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:31:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:31:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'skrhieCz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:31:33 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:31:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:31:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:31:33 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:31:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:31:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:31:33 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:31:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:33 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[431bb5b5-b62f-4d9e-aaf4-6aed555dd281]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:31:33 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:33 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b83740-7217-4a51-ae39-c86153d36077]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5] added
Aug 26 23:31:33 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:33 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac7a7a7-30e6-428b-919d-7cc1751d501a]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:33 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a7c98a-0337-4dfc-993d-7f9857e3417c]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v skrhieCz {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v skrhieCz" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:33 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21f5f5b-70b2-4023-8843-57480352da90]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'skrhieCz'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:34 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4fa19b-1e31-40a2-9fcb-ce5ac7123843]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:34 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[461f9181-337f-402f-a2f0-15df2e5c5cd4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:31:34 user nova-compute[73497]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:31:34 user nova-compute[73497]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)
Aug 26 23:31:34 user nova-compute[73497]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)
Aug 26 23:31:34 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:31:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:31:34 user nova-compute[73497]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:31:34 user nova-compute[73497]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)
Aug 26 23:31:34 user nova-compute[73497]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)
Aug 26 23:31:34 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:31:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:34 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a407f714-b502-4230-8869-acd58a9e137e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5, portal: 172.16.0.220,3260]
Aug 26 23:31:34 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5, portal: 172.16.0.220,3260] successful.
Aug 26 23:31:34 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:34 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb52be7-7dcc-4831-a5f4-c566ef5727c0]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:34 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b16aa9-c482-42cb-b158-e055f58fe943]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:31:34 user nova-compute[73497]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:31:34 user nova-compute[73497]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)
Aug 26 23:31:34 user nova-compute[73497]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)
Aug 26 23:31:34 user nova-compute[73497]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5 (non-flash)
Aug 26 23:31:34 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:31:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:31:34 user nova-compute[73497]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:31:34 user nova-compute[73497]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)
Aug 26 23:31:34 user nova-compute[73497]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)
Aug 26 23:31:34 user nova-compute[73497]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5 (non-flash)
Aug 26 23:31:34 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:31:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:31:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:31:34 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:31:34 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:31:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:34 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5a16b4-c0f9-4d4d-a34f-bb351eb7ef1b]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:34 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:31:34 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'skrhieCz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:31:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:35 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:31:35 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '23338613566376434', 'path': '/dev/sdd'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:31:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338613566376434', 'path': '/dev/sdd'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:31:35 user nova-compute[73497]: DEBUG nova.objects.instance [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lazy-loading 'flavor' on Instance uuid e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:31:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 23:31:35 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:31:35 user nova-compute[73497]:   <source dev="/dev/sdd"/>
Aug 26 23:31:35 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:31:35 user nova-compute[73497]:   <serial>617b4eeb-6d93-4ed8-8765-cab4ccf86ef5</serial>
Aug 26 23:31:35 user nova-compute[73497]: </disk>
Aug 26 23:31:35 user nova-compute[73497]:  {{(pid=73497) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 23:31:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:31:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:31:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] No VIF found with MAC fa:16:3e:67:db:0c, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:31:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4de1e916-cf9d-4de4-89c1-612b00fa8b12 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.509s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:31:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5331ecbc-a1fc-4618-b849-d4acc4750b00 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:31:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5331ecbc-a1fc-4618-b849-d4acc4750b00 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:31:37 user nova-compute[73497]: INFO nova.compute.manager [None req-5331ecbc-a1fc-4618-b849-d4acc4750b00 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Detaching volume 12c35c25-ba0c-408b-b188-7fc38a5c9177
Aug 26 23:31:37 user nova-compute[73497]: INFO nova.virt.block_device [None req-5331ecbc-a1fc-4618-b849-d4acc4750b00 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Attempting to driver detach volume 12c35c25-ba0c-408b-b188-7fc38a5c9177 from mountpoint /dev/vdb
Aug 26 23:31:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-5331ecbc-a1fc-4618-b849-d4acc4750b00 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Attempting to detach device vdb from instance f7c83073-fadc-4e41-a4a9-df0bbe11aa28 from the persistent domain config. {{(pid=73497) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 23:31:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-5331ecbc-a1fc-4618-b849-d4acc4750b00 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:31:37 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:31:37 user nova-compute[73497]:   <source dev="/dev/sde"/>
Aug 26 23:31:37 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:31:37 user nova-compute[73497]:   <serial>12c35c25-ba0c-408b-b188-7fc38a5c9177</serial>
Aug 26 23:31:37 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 23:31:37 user nova-compute[73497]: </disk>
Aug 26 23:31:37 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:31:37 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-5331ecbc-a1fc-4618-b849-d4acc4750b00 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Successfully detached device vdb from instance f7c83073-fadc-4e41-a4a9-df0bbe11aa28 from the persistent domain config.
Aug 26 23:31:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-5331ecbc-a1fc-4618-b849-d4acc4750b00 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f7c83073-fadc-4e41-a4a9-df0bbe11aa28 from the live domain config. {{(pid=73497) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 23:31:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-5331ecbc-a1fc-4618-b849-d4acc4750b00 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:31:37 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:31:37 user nova-compute[73497]:   <source dev="/dev/sde"/>
Aug 26 23:31:37 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:31:37 user nova-compute[73497]:   <serial>12c35c25-ba0c-408b-b188-7fc38a5c9177</serial>
Aug 26 23:31:37 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 23:31:37 user nova-compute[73497]: </disk>
Aug 26 23:31:37 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Received event <DeviceRemovedEvent: 1693092698.103942, f7c83073-fadc-4e41-a4a9-df0bbe11aa28 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73497) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-5331ecbc-a1fc-4618-b849-d4acc4750b00 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f7c83073-fadc-4e41-a4a9-df0bbe11aa28 {{(pid=73497) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 23:31:38 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-5331ecbc-a1fc-4618-b849-d4acc4750b00 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Successfully detached device vdb from instance f7c83073-fadc-4e41-a4a9-df0bbe11aa28 from the live domain config.
Aug 26 23:31:38 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5331ecbc-a1fc-4618-b849-d4acc4750b00 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5331ecbc-a1fc-4618-b849-d4acc4750b00 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YGgkMVsT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:31:38 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-5331ecbc-a1fc-4618-b849-d4acc4750b00 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:31:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-5331ecbc-a1fc-4618-b849-d4acc4750b00 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-5331ecbc-a1fc-4618-b849-d4acc4750b00 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5331ecbc-a1fc-4618-b849-d4acc4750b00 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b83300-3109-4afe-944b-299d88b2774a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf8e764-c8e7-4109-83c8-ee4630970a8c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5331ecbc-a1fc-4618-b849-d4acc4750b00 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:31:38 user nova-compute[73497]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:31:38 user nova-compute[73497]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)
Aug 26 23:31:38 user nova-compute[73497]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)
Aug 26 23:31:38 user nova-compute[73497]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5 (non-flash)
Aug 26 23:31:38 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5331ecbc-a1fc-4618-b849-d4acc4750b00 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:31:38 user nova-compute[73497]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:31:38 user nova-compute[73497]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 (non-flash)
Aug 26 23:31:38 user nova-compute[73497]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)
Aug 26 23:31:38 user nova-compute[73497]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5 (non-flash)
Aug 26 23:31:38 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5331ecbc-a1fc-4618-b849-d4acc4750b00 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281c3815a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177'): ({'sde'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-5331ecbc-a1fc-4618-b849-d4acc4750b00 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Removing single pathed devices sde {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f151e1-fa5b-4e8f-8bb3-4db0429312bb]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16c19f4-7b49-4435-a2b4-9db06ad7a2d2]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-5331ecbc-a1fc-4618-b849-d4acc4750b00 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Flushing IO for device /dev/sde {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a096ec-0f1f-46dc-9bed-ce5aa327ef8e]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-5331ecbc-a1fc-4618-b849-d4acc4750b00 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[056f6968-2ed3-43d0-82d6-7533df107f2d]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-5331ecbc-a1fc-4618-b849-d4acc4750b00 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-5331ecbc-a1fc-4618-b849-d4acc4750b00 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] SCSI volumes sde have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5331ecbc-a1fc-4618-b849-d4acc4750b00 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e03a49-356e-4760-aa2d-66ac6ca3d3e9]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5331ecbc-a1fc-4618-b849-d4acc4750b00 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5e8ccb-c12f-44c5-af34-098c1cd523ef]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5331ecbc-a1fc-4618-b849-d4acc4750b00 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177, portal: 172.16.0.220,3260]
Aug 26 23:31:38 user nova-compute[73497]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177, portal: 172.16.0.220,3260] successful.
Aug 26 23:31:38 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c35c25-ba0c-408b-b188-7fc38a5c9177 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[94817384-0ccc-47ae-a48e-8cf530e63833]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5331ecbc-a1fc-4618-b849-d4acc4750b00 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-5331ecbc-a1fc-4618-b849-d4acc4750b00 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5331ecbc-a1fc-4618-b849-d4acc4750b00 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] <== disconnect_volume: return (299ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:31:38 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5331ecbc-a1fc-4618-b849-d4acc4750b00 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:31:39 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693092684.2470672, 40afa348-8391-4643-977c-e67eab5c9476 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:31:39 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 40afa348-8391-4643-977c-e67eab5c9476] VM Stopped (Lifecycle Event)
Aug 26 23:31:39 user nova-compute[73497]: DEBUG nova.compute.manager [None req-1e9adf53-14e0-4842-a07d-e2a7f4818a9c None None] [instance: 40afa348-8391-4643-977c-e67eab5c9476] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:31:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:39 user nova-compute[73497]: DEBUG nova.objects.instance [None req-5331ecbc-a1fc-4618-b849-d4acc4750b00 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lazy-loading 'flavor' on Instance uuid f7c83073-fadc-4e41-a4a9-df0bbe11aa28 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:31:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5331ecbc-a1fc-4618-b849-d4acc4750b00 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.865s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:31:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-93b8ce5a-7fb1-4512-ace4-689fb3f4e2f1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:31:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-93b8ce5a-7fb1-4512-ace4-689fb3f4e2f1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:31:39 user nova-compute[73497]: DEBUG nova.compute.manager [None req-93b8ce5a-7fb1-4512-ace4-689fb3f4e2f1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:31:39 user nova-compute[73497]: DEBUG nova.compute.manager [None req-93b8ce5a-7fb1-4512-ace4-689fb3f4e2f1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73497) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 26 23:31:39 user nova-compute[73497]: DEBUG nova.objects.instance [None req-93b8ce5a-7fb1-4512-ace4-689fb3f4e2f1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lazy-loading 'flavor' on Instance uuid f7c83073-fadc-4e41-a4a9-df0bbe11aa28 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:31:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:40 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:40 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:40 user nova-compute[73497]: DEBUG nova.compute.manager [req-a2d2ce93-a5f7-4a72-a448-125e1b11b245 req-d04cb955-3017-4632-ae25-54aea5d9c239 service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Received event network-vif-unplugged-74cddf0f-c302-4ae4-8142-cee5764c7c4f {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:31:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a2d2ce93-a5f7-4a72-a448-125e1b11b245 req-d04cb955-3017-4632-ae25-54aea5d9c239 service nova] Acquiring lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:31:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a2d2ce93-a5f7-4a72-a448-125e1b11b245 req-d04cb955-3017-4632-ae25-54aea5d9c239 service nova] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:31:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a2d2ce93-a5f7-4a72-a448-125e1b11b245 req-d04cb955-3017-4632-ae25-54aea5d9c239 service nova] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:31:40 user nova-compute[73497]: DEBUG nova.compute.manager [req-a2d2ce93-a5f7-4a72-a448-125e1b11b245 req-d04cb955-3017-4632-ae25-54aea5d9c239 service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] No waiting events found dispatching network-vif-unplugged-74cddf0f-c302-4ae4-8142-cee5764c7c4f {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:31:40 user nova-compute[73497]: WARNING nova.compute.manager [req-a2d2ce93-a5f7-4a72-a448-125e1b11b245 req-d04cb955-3017-4632-ae25-54aea5d9c239 service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Received unexpected event network-vif-unplugged-74cddf0f-c302-4ae4-8142-cee5764c7c4f for instance with vm_state active and task_state powering-off.
Aug 26 23:31:40 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Instance destroyed successfully.
Aug 26 23:31:40 user nova-compute[73497]: DEBUG nova.compute.manager [None req-93b8ce5a-7fb1-4512-ace4-689fb3f4e2f1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:31:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-93b8ce5a-7fb1-4512-ace4-689fb3f4e2f1 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.864s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:31:42 user nova-compute[73497]: DEBUG nova.compute.manager [req-a548d65c-c05a-410a-af7b-2b865bceace4 req-fba401e2-4f97-4051-b442-411a8b3fb075 service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Received event network-vif-plugged-74cddf0f-c302-4ae4-8142-cee5764c7c4f {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:31:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a548d65c-c05a-410a-af7b-2b865bceace4 req-fba401e2-4f97-4051-b442-411a8b3fb075 service nova] Acquiring lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:31:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a548d65c-c05a-410a-af7b-2b865bceace4 req-fba401e2-4f97-4051-b442-411a8b3fb075 service nova] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:31:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a548d65c-c05a-410a-af7b-2b865bceace4 req-fba401e2-4f97-4051-b442-411a8b3fb075 service nova] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:31:42 user nova-compute[73497]: DEBUG nova.compute.manager [req-a548d65c-c05a-410a-af7b-2b865bceace4 req-fba401e2-4f97-4051-b442-411a8b3fb075 service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] No waiting events found dispatching network-vif-plugged-74cddf0f-c302-4ae4-8142-cee5764c7c4f {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:31:42 user nova-compute[73497]: WARNING nova.compute.manager [req-a548d65c-c05a-410a-af7b-2b865bceace4 req-fba401e2-4f97-4051-b442-411a8b3fb075 service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Received unexpected event network-vif-plugged-74cddf0f-c302-4ae4-8142-cee5764c7c4f for instance with vm_state stopped and task_state None.
Aug 26 23:31:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:31:45 user nova-compute[73497]: INFO nova.compute.manager [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Terminating instance
Aug 26 23:31:45 user nova-compute[73497]: DEBUG nova.compute.manager [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG nova.compute.manager [req-63ab007f-41ed-40fa-b1ad-b4c8f7e7037b req-ef030a9c-5cd1-49ad-92a2-eb685dd195cb service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Received event network-vif-unplugged-2fdb126c-c800-488a-9879-08a65e646325 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-63ab007f-41ed-40fa-b1ad-b4c8f7e7037b req-ef030a9c-5cd1-49ad-92a2-eb685dd195cb service nova] Acquiring lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-63ab007f-41ed-40fa-b1ad-b4c8f7e7037b req-ef030a9c-5cd1-49ad-92a2-eb685dd195cb service nova] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-63ab007f-41ed-40fa-b1ad-b4c8f7e7037b req-ef030a9c-5cd1-49ad-92a2-eb685dd195cb service nova] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG nova.compute.manager [req-63ab007f-41ed-40fa-b1ad-b4c8f7e7037b req-ef030a9c-5cd1-49ad-92a2-eb685dd195cb service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] No waiting events found dispatching network-vif-unplugged-2fdb126c-c800-488a-9879-08a65e646325 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG nova.compute.manager [req-63ab007f-41ed-40fa-b1ad-b4c8f7e7037b req-ef030a9c-5cd1-49ad-92a2-eb685dd195cb service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Received event network-vif-unplugged-2fdb126c-c800-488a-9879-08a65e646325 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:45 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Instance destroyed successfully.
Aug 26 23:31:45 user nova-compute[73497]: DEBUG nova.objects.instance [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lazy-loading 'resources' on Instance uuid aebaeda6-23d1-43a1-afc8-bdc8992067e5 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1490878168',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1490878168',id=12,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:17:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ee8ef1c899342b38a624c1c28309d41',ramdisk_id='',reservation_id='r-92y3pmcv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1276656289',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:19:45Z,user_data=None,user_id='83005131fdc2411abe7a198157910743',uuid=aebaeda6-23d1-43a1-afc8-bdc8992067e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2fdb126c-c800-488a-9879-08a65e646325", "address": "fa:16:3e:e0:28:c4", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fdb126c-c8", "ovs_interfaceid": "2fdb126c-c800-488a-9879-08a65e646325", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Converting VIF {"id": "2fdb126c-c800-488a-9879-08a65e646325", "address": "fa:16:3e:e0:28:c4", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fdb126c-c8", "ovs_interfaceid": "2fdb126c-c800-488a-9879-08a65e646325", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:28:c4,bridge_name='br-int',has_traffic_filtering=True,id=2fdb126c-c800-488a-9879-08a65e646325,network=Network(f8ba0a6b-e4fc-4236-9df3-90ffab8824fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fdb126c-c8') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG os_vif [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:28:c4,bridge_name='br-int',has_traffic_filtering=True,id=2fdb126c-c800-488a-9879-08a65e646325,network=Network(f8ba0a6b-e4fc-4236-9df3-90ffab8824fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fdb126c-c8') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2fdb126c-c8, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:45 user nova-compute[73497]: INFO os_vif [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:28:c4,bridge_name='br-int',has_traffic_filtering=True,id=2fdb126c-c800-488a-9879-08a65e646325,network=Network(f8ba0a6b-e4fc-4236-9df3-90ffab8824fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fdb126c-c8')
Aug 26 23:31:45 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nrOEmVhU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:31:45 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:31:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc6ea2d-e0eb-4e8f-9088-3b86e2b3872a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f72089-edc3-4025-85b5-96aa2d9ff48d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:31:45 user nova-compute[73497]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:31:45 user nova-compute[73497]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)
Aug 26 23:31:45 user nova-compute[73497]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5 (non-flash)
Aug 26 23:31:45 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 (non-flash)
Aug 26 23:31:45 user nova-compute[73497]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:31:45 user nova-compute[73497]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)
Aug 26 23:31:45 user nova-compute[73497]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5 (non-flash)
Aug 26 23:31:45 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281c258b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2'): ({'sdc'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Removing single pathed devices sdc {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:31:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3887c775-fe84-470b-8818-b09f672f639f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f02094c-48c2-4709-9a0c-6d55753c46a3]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:46 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Flushing IO for device /dev/sdc {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:31:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fc3949-ef94-4bad-bd81-873aa7a6cb72]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:46 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:31:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[545fa423-bcaf-461f-ac8d-e6d9f9013076]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:46 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:31:46 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] SCSI volumes sdc have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:31:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:31:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bc984d-3b75-47c9-b1fd-794c6c9da13e]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f98687-6043-46ea-a35b-cdb0bb6bf854]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2, portal: 172.16.0.220,3260]
Aug 26 23:31:46 user nova-compute[73497]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2, portal: 172.16.0.220,3260] successful.
Aug 26 23:31:46 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:31:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c797b7d-2462-4a35-9c56-b07c78e085d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:31:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6148de5-7923-4774-8431-f3b088c056de]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:31:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:31:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:31:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] <== disconnect_volume: return (320ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:31:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:31:46 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Deleting instance files /opt/stack/data/nova/instances/aebaeda6-23d1-43a1-afc8-bdc8992067e5_del
Aug 26 23:31:46 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Deletion of /opt/stack/data/nova/instances/aebaeda6-23d1-43a1-afc8-bdc8992067e5_del complete
Aug 26 23:31:46 user nova-compute[73497]: INFO nova.compute.manager [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 26 23:31:46 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:31:46 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:31:46 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:31:46 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:31:46 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Took 0.52 seconds to deallocate network for instance.
Aug 26 23:31:46 user nova-compute[73497]: DEBUG nova.compute.manager [req-84c585b9-5465-4176-aca5-6c6928eb20d1 req-58e8ce6c-8f3d-4014-9047-e7cae7d248a2 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Received event network-vif-deleted-2fdb126c-c800-488a-9879-08a65e646325 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:31:46 user nova-compute[73497]: INFO nova.compute.manager [req-84c585b9-5465-4176-aca5-6c6928eb20d1 req-58e8ce6c-8f3d-4014-9047-e7cae7d248a2 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Neutron deleted interface 2fdb126c-c800-488a-9879-08a65e646325; detaching it from the instance and deleting it from the info cache
Aug 26 23:31:46 user nova-compute[73497]: DEBUG nova.network.neutron [req-84c585b9-5465-4176-aca5-6c6928eb20d1 req-58e8ce6c-8f3d-4014-9047-e7cae7d248a2 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:31:46 user nova-compute[73497]: DEBUG nova.compute.manager [req-84c585b9-5465-4176-aca5-6c6928eb20d1 req-58e8ce6c-8f3d-4014-9047-e7cae7d248a2 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Detach interface failed, port_id=2fdb126c-c800-488a-9879-08a65e646325, reason: Instance aebaeda6-23d1-43a1-afc8-bdc8992067e5 could not be found. {{(pid=73497) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 23:31:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:47 user nova-compute[73497]: DEBUG nova.compute.manager [req-a5517992-3118-43b2-90d5-dabb11b82a7d req-5328ac1b-782a-42d9-8a13-eb415ee23ad4 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Received event network-vif-plugged-2fdb126c-c800-488a-9879-08a65e646325 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:31:47 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a5517992-3118-43b2-90d5-dabb11b82a7d req-5328ac1b-782a-42d9-8a13-eb415ee23ad4 service nova] Acquiring lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:31:47 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a5517992-3118-43b2-90d5-dabb11b82a7d req-5328ac1b-782a-42d9-8a13-eb415ee23ad4 service nova] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:31:47 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a5517992-3118-43b2-90d5-dabb11b82a7d req-5328ac1b-782a-42d9-8a13-eb415ee23ad4 service nova] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:31:47 user nova-compute[73497]: DEBUG nova.compute.manager [req-a5517992-3118-43b2-90d5-dabb11b82a7d req-5328ac1b-782a-42d9-8a13-eb415ee23ad4 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] No waiting events found dispatching network-vif-plugged-2fdb126c-c800-488a-9879-08a65e646325 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:31:47 user nova-compute[73497]: WARNING nova.compute.manager [req-a5517992-3118-43b2-90d5-dabb11b82a7d req-5328ac1b-782a-42d9-8a13-eb415ee23ad4 service nova] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Received unexpected event network-vif-plugged-2fdb126c-c800-488a-9879-08a65e646325 for instance with vm_state active and task_state deleting.
Aug 26 23:31:47 user nova-compute[73497]: INFO nova.compute.manager [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Took 0.77 seconds to detach 1 volumes for instance.
Aug 26 23:31:47 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:31:47 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:31:47 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:31:47 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:31:47 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:31:48 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Deleted allocations for instance aebaeda6-23d1-43a1-afc8-bdc8992067e5
Aug 26 23:31:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-986c109f-0b79-4f7b-9507-6abdef08575a tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "aebaeda6-23d1-43a1-afc8-bdc8992067e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.032s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:31:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:55 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693092700.6256244, f7c83073-fadc-4e41-a4a9-df0bbe11aa28 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:31:55 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] VM Stopped (Lifecycle Event)
Aug 26 23:31:55 user nova-compute[73497]: DEBUG nova.compute.manager [None req-18f4ad10-904b-43e7-8a24-9d885a8db1dc None None] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:31:55 user nova-compute[73497]: DEBUG nova.compute.manager [None req-18f4ad10-904b-43e7-8a24-9d885a8db1dc None None] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:31:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:31:58 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:31:58 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:32:00 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693092705.8631759, aebaeda6-23d1-43a1-afc8-bdc8992067e5 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:32:00 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] VM Stopped (Lifecycle Event)
Aug 26 23:32:00 user nova-compute[73497]: DEBUG nova.compute.manager [None req-b013a0ac-e426-440c-9ecc-91b03589e1f8 None None] [instance: aebaeda6-23d1-43a1-afc8-bdc8992067e5] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:32:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:01 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:32:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:32:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:32:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:32:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:32:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:32:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853bd672-97af-4e36-9bd4-5cc428b83765/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853bd672-97af-4e36-9bd4-5cc428b83765/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853bd672-97af-4e36-9bd4-5cc428b83765/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853bd672-97af-4e36-9bd4-5cc428b83765/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:04 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:32:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0e68638-bc72-4dd5-8399-7bf207b84b9e/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0e68638-bc72-4dd5-8399-7bf207b84b9e/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0e68638-bc72-4dd5-8399-7bf207b84b9e/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0e68638-bc72-4dd5-8399-7bf207b84b9e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:05 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:32:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:06 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:32:06 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:32:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=7327MB free_disk=24.93374252319336GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:32:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:32:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:32:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 994093f0-e6b2-4c96-b259-c559ef2b1fbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:32:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 171985a3-358d-4b26-a66c-372b9b99b386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:32:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 043294e5-0618-4a31-bb19-1227ef1f5d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:32:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance e9e5c83f-0678-48d4-a81f-1a3f959aabcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:32:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance f7c83073-fadc-4e41-a4a9-df0bbe11aa28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:32:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance e15ddee6-a642-4638-9534-21e640b3d017 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:32:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance b7506745-ace5-45e2-bc1d-883f2c51f1c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:32:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 853bd672-97af-4e36-9bd4-5cc428b83765 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:32:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:32:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance b0e68638-bc72-4dd5-8399-7bf207b84b9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:32:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:32:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:32:06 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:32:06 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:32:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:32:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:32:07 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:32:07 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:32:07 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:32:07 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:32:08 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:32:08 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:32:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-e9e5c83f-0678-48d4-a81f-1a3f959aabcf" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:32:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-e9e5c83f-0678-48d4-a81f-1a3f959aabcf" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:32:08 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:32:09 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Updating instance_info_cache with network_info: [{"id": "3de77772-78de-4261-b064-d1c2d8e30b31", "address": "fa:16:3e:d7:8d:5d", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de77772-78", "ovs_interfaceid": "3de77772-78de-4261-b064-d1c2d8e30b31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:32:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-e9e5c83f-0678-48d4-a81f-1a3f959aabcf" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:32:09 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:32:09 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:32:09 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:32:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:32:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3947143c-a208-4368-8d82-6600a8734ab2 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "853bd672-97af-4e36-9bd4-5cc428b83765" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:32:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3947143c-a208-4368-8d82-6600a8734ab2 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "853bd672-97af-4e36-9bd4-5cc428b83765" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:32:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3947143c-a208-4368-8d82-6600a8734ab2 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "853bd672-97af-4e36-9bd4-5cc428b83765-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:32:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3947143c-a208-4368-8d82-6600a8734ab2 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "853bd672-97af-4e36-9bd4-5cc428b83765-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:32:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3947143c-a208-4368-8d82-6600a8734ab2 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "853bd672-97af-4e36-9bd4-5cc428b83765-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:32:12 user nova-compute[73497]: INFO nova.compute.manager [None req-3947143c-a208-4368-8d82-6600a8734ab2 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Terminating instance
Aug 26 23:32:12 user nova-compute[73497]: DEBUG nova.compute.manager [None req-3947143c-a208-4368-8d82-6600a8734ab2 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:32:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:13 user nova-compute[73497]: DEBUG nova.compute.manager [req-80bea708-95fa-4a3b-bf23-9a7b3863c762 req-98235207-74a5-4304-93f3-a064be7c904c service nova] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Received event network-vif-unplugged-55f5d62f-e069-45a4-953f-d3ec033c3ba1 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:32:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-80bea708-95fa-4a3b-bf23-9a7b3863c762 req-98235207-74a5-4304-93f3-a064be7c904c service nova] Acquiring lock "853bd672-97af-4e36-9bd4-5cc428b83765-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:32:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-80bea708-95fa-4a3b-bf23-9a7b3863c762 req-98235207-74a5-4304-93f3-a064be7c904c service nova] Lock "853bd672-97af-4e36-9bd4-5cc428b83765-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:32:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-80bea708-95fa-4a3b-bf23-9a7b3863c762 req-98235207-74a5-4304-93f3-a064be7c904c service nova] Lock "853bd672-97af-4e36-9bd4-5cc428b83765-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:32:13 user nova-compute[73497]: DEBUG nova.compute.manager [req-80bea708-95fa-4a3b-bf23-9a7b3863c762 req-98235207-74a5-4304-93f3-a064be7c904c service nova] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] No waiting events found dispatching network-vif-unplugged-55f5d62f-e069-45a4-953f-d3ec033c3ba1 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:32:13 user nova-compute[73497]: DEBUG nova.compute.manager [req-80bea708-95fa-4a3b-bf23-9a7b3863c762 req-98235207-74a5-4304-93f3-a064be7c904c service nova] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Received event network-vif-unplugged-55f5d62f-e069-45a4-953f-d3ec033c3ba1 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:32:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:13 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Instance destroyed successfully.
Aug 26 23:32:13 user nova-compute[73497]: DEBUG nova.objects.instance [None req-3947143c-a208-4368-8d82-6600a8734ab2 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lazy-loading 'resources' on Instance uuid 853bd672-97af-4e36-9bd4-5cc428b83765 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:32:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-3947143c-a208-4368-8d82-6600a8734ab2 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1175610065',display_name='tempest-AttachVolumeNegativeTest-server-1175610065',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1175610065',id=35,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAUpFIeOcp1zPIB1StcMmyoqllB/TxzqADHDyaJo2QJoaHz6mot2YhFbI2ARRQboxOc9WkNnkXD0lWj18spSOL3kTOy5zVIJTQ1DdZklxozo74r7DiMARbDzCogj4amLg==',key_name='tempest-keypair-1449143744',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:29:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d784b1d6c31e41d6a03fc377b0be69f5',ramdisk_id='',reservation_id='r-taxc52ms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1095215256',owner_user_name='tempest-AttachVolumeNegativeTest-1095215256-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:29:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e38409b92a95475db83540cbc4222466',uuid=853bd672-97af-4e36-9bd4-5cc428b83765,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55f5d62f-e069-45a4-953f-d3ec033c3ba1", "address": "fa:16:3e:75:d8:38", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55f5d62f-e0", "ovs_interfaceid": "55f5d62f-e069-45a4-953f-d3ec033c3ba1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:32:13 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-3947143c-a208-4368-8d82-6600a8734ab2 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Converting VIF {"id": "55f5d62f-e069-45a4-953f-d3ec033c3ba1", "address": "fa:16:3e:75:d8:38", "network": {"id": "7bae9729-050d-4ff3-a842-91d0ec2c08d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1124321161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d784b1d6c31e41d6a03fc377b0be69f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55f5d62f-e0", "ovs_interfaceid": "55f5d62f-e069-45a4-953f-d3ec033c3ba1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:32:13 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-3947143c-a208-4368-8d82-6600a8734ab2 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:d8:38,bridge_name='br-int',has_traffic_filtering=True,id=55f5d62f-e069-45a4-953f-d3ec033c3ba1,network=Network(7bae9729-050d-4ff3-a842-91d0ec2c08d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55f5d62f-e0') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:32:13 user nova-compute[73497]: DEBUG os_vif [None req-3947143c-a208-4368-8d82-6600a8734ab2 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:d8:38,bridge_name='br-int',has_traffic_filtering=True,id=55f5d62f-e069-45a4-953f-d3ec033c3ba1,network=Network(7bae9729-050d-4ff3-a842-91d0ec2c08d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55f5d62f-e0') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:32:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55f5d62f-e0, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:32:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:32:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:13 user nova-compute[73497]: INFO os_vif [None req-3947143c-a208-4368-8d82-6600a8734ab2 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:d8:38,bridge_name='br-int',has_traffic_filtering=True,id=55f5d62f-e069-45a4-953f-d3ec033c3ba1,network=Network(7bae9729-050d-4ff3-a842-91d0ec2c08d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55f5d62f-e0')
Aug 26 23:32:13 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-3947143c-a208-4368-8d82-6600a8734ab2 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Deleting instance files /opt/stack/data/nova/instances/853bd672-97af-4e36-9bd4-5cc428b83765_del
Aug 26 23:32:13 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-3947143c-a208-4368-8d82-6600a8734ab2 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Deletion of /opt/stack/data/nova/instances/853bd672-97af-4e36-9bd4-5cc428b83765_del complete
Aug 26 23:32:13 user nova-compute[73497]: INFO nova.compute.manager [None req-3947143c-a208-4368-8d82-6600a8734ab2 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 26 23:32:13 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-3947143c-a208-4368-8d82-6600a8734ab2 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:32:13 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:32:13 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:32:14 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:32:14 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Took 0.92 seconds to deallocate network for instance.
Aug 26 23:32:14 user nova-compute[73497]: DEBUG nova.compute.manager [req-a0c56fe0-416d-422f-a566-27d43989be1e req-56e1e41d-0d02-43c7-89ed-6f6dfe96dcdc service nova] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Received event network-vif-deleted-55f5d62f-e069-45a4-953f-d3ec033c3ba1 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:32:14 user nova-compute[73497]: INFO nova.compute.manager [req-a0c56fe0-416d-422f-a566-27d43989be1e req-56e1e41d-0d02-43c7-89ed-6f6dfe96dcdc service nova] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Neutron deleted interface 55f5d62f-e069-45a4-953f-d3ec033c3ba1; detaching it from the instance and deleting it from the info cache
Aug 26 23:32:14 user nova-compute[73497]: DEBUG nova.network.neutron [req-a0c56fe0-416d-422f-a566-27d43989be1e req-56e1e41d-0d02-43c7-89ed-6f6dfe96dcdc service nova] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:32:14 user nova-compute[73497]: DEBUG nova.compute.manager [req-a0c56fe0-416d-422f-a566-27d43989be1e req-56e1e41d-0d02-43c7-89ed-6f6dfe96dcdc service nova] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Detach interface failed, port_id=55f5d62f-e069-45a4-953f-d3ec033c3ba1, reason: Instance 853bd672-97af-4e36-9bd4-5cc428b83765 could not be found. {{(pid=73497) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 23:32:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3947143c-a208-4368-8d82-6600a8734ab2 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:32:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3947143c-a208-4368-8d82-6600a8734ab2 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:32:15 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-3947143c-a208-4368-8d82-6600a8734ab2 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:32:15 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-3947143c-a208-4368-8d82-6600a8734ab2 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:32:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3947143c-a208-4368-8d82-6600a8734ab2 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:32:15 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-3947143c-a208-4368-8d82-6600a8734ab2 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Deleted allocations for instance 853bd672-97af-4e36-9bd4-5cc428b83765
Aug 26 23:32:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3947143c-a208-4368-8d82-6600a8734ab2 tempest-AttachVolumeNegativeTest-1095215256 tempest-AttachVolumeNegativeTest-1095215256-project-member] Lock "853bd672-97af-4e36-9bd4-5cc428b83765" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.410s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:32:15 user nova-compute[73497]: DEBUG nova.compute.manager [req-b4fa7c85-22b2-4b8c-9a35-910b16a4788f req-b15a5e5b-1868-4992-b035-864985da9dd9 service nova] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Received event network-vif-plugged-55f5d62f-e069-45a4-953f-d3ec033c3ba1 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:32:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b4fa7c85-22b2-4b8c-9a35-910b16a4788f req-b15a5e5b-1868-4992-b035-864985da9dd9 service nova] Acquiring lock "853bd672-97af-4e36-9bd4-5cc428b83765-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:32:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b4fa7c85-22b2-4b8c-9a35-910b16a4788f req-b15a5e5b-1868-4992-b035-864985da9dd9 service nova] Lock "853bd672-97af-4e36-9bd4-5cc428b83765-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:32:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b4fa7c85-22b2-4b8c-9a35-910b16a4788f req-b15a5e5b-1868-4992-b035-864985da9dd9 service nova] Lock "853bd672-97af-4e36-9bd4-5cc428b83765-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:32:15 user nova-compute[73497]: DEBUG nova.compute.manager [req-b4fa7c85-22b2-4b8c-9a35-910b16a4788f req-b15a5e5b-1868-4992-b035-864985da9dd9 service nova] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] No waiting events found dispatching network-vif-plugged-55f5d62f-e069-45a4-953f-d3ec033c3ba1 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:32:15 user nova-compute[73497]: WARNING nova.compute.manager [req-b4fa7c85-22b2-4b8c-9a35-910b16a4788f req-b15a5e5b-1868-4992-b035-864985da9dd9 service nova] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Received unexpected event network-vif-plugged-55f5d62f-e069-45a4-953f-d3ec033c3ba1 for instance with vm_state deleted and task_state None.
Aug 26 23:32:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:23 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9798922c-0f59-469f-b2cb-28e5321c8e20 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Acquiring lock "e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:32:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9798922c-0f59-469f-b2cb-28e5321c8e20 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:32:25 user nova-compute[73497]: INFO nova.compute.manager [None req-9798922c-0f59-469f-b2cb-28e5321c8e20 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Detaching volume 617b4eeb-6d93-4ed8-8765-cab4ccf86ef5
Aug 26 23:32:25 user nova-compute[73497]: INFO nova.virt.block_device [None req-9798922c-0f59-469f-b2cb-28e5321c8e20 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Attempting to driver detach volume 617b4eeb-6d93-4ed8-8765-cab4ccf86ef5 from mountpoint /dev/vdb
Aug 26 23:32:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9798922c-0f59-469f-b2cb-28e5321c8e20 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Attempting to detach device vdb from instance e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7 from the persistent domain config. {{(pid=73497) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 23:32:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-9798922c-0f59-469f-b2cb-28e5321c8e20 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:32:25 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:32:25 user nova-compute[73497]:   <source dev="/dev/sdd"/>
Aug 26 23:32:25 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:32:25 user nova-compute[73497]:   <serial>617b4eeb-6d93-4ed8-8765-cab4ccf86ef5</serial>
Aug 26 23:32:25 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:32:25 user nova-compute[73497]: </disk>
Aug 26 23:32:25 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:32:25 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-9798922c-0f59-469f-b2cb-28e5321c8e20 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Successfully detached device vdb from instance e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7 from the persistent domain config.
Aug 26 23:32:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9798922c-0f59-469f-b2cb-28e5321c8e20 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7 from the live domain config. {{(pid=73497) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 23:32:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-9798922c-0f59-469f-b2cb-28e5321c8e20 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:32:25 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:32:25 user nova-compute[73497]:   <source dev="/dev/sdd"/>
Aug 26 23:32:25 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:32:25 user nova-compute[73497]:   <serial>617b4eeb-6d93-4ed8-8765-cab4ccf86ef5</serial>
Aug 26 23:32:25 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:32:25 user nova-compute[73497]: </disk>
Aug 26 23:32:25 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:32:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Acquiring lock "e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Received event <DeviceRemovedEvent: 1693092746.1684823, e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73497) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9798922c-0f59-469f-b2cb-28e5321c8e20 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7 {{(pid=73497) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 23:32:26 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-9798922c-0f59-469f-b2cb-28e5321c8e20 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Successfully detached device vdb from instance e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7 from the live domain config.
Aug 26 23:32:26 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9798922c-0f59-469f-b2cb-28e5321c8e20 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9798922c-0f59-469f-b2cb-28e5321c8e20 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'skrhieCz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:32:26 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-9798922c-0f59-469f-b2cb-28e5321c8e20 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:32:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-9798922c-0f59-469f-b2cb-28e5321c8e20 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-9798922c-0f59-469f-b2cb-28e5321c8e20 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9798922c-0f59-469f-b2cb-28e5321c8e20 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[899957c1-b919-4b88-b7da-4021b81dcf93]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca46882-7856-4aa7-848f-fec37c9e7101]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9798922c-0f59-469f-b2cb-28e5321c8e20 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:32:26 user nova-compute[73497]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)
Aug 26 23:32:26 user nova-compute[73497]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5 (non-flash)
Aug 26 23:32:26 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9798922c-0f59-469f-b2cb-28e5321c8e20 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:32:26 user nova-compute[73497]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)
Aug 26 23:32:26 user nova-compute[73497]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5 (non-flash)
Aug 26 23:32:26 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9798922c-0f59-469f-b2cb-28e5321c8e20 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282c3d23b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5'): ({'sdd'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-9798922c-0f59-469f-b2cb-28e5321c8e20 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Removing single pathed devices sdd {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[59628139-d131-40a6-aa9d-ccadbd83ae9c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f47173-c4bc-4afe-b85d-205f2680aeec]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-9798922c-0f59-469f-b2cb-28e5321c8e20 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Flushing IO for device /dev/sdd {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[38dfce06-8df8-4cec-a735-c2adffd2a969]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-9798922c-0f59-469f-b2cb-28e5321c8e20 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e1c576-4f99-4143-832c-e47031f5f647]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-9798922c-0f59-469f-b2cb-28e5321c8e20 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-9798922c-0f59-469f-b2cb-28e5321c8e20 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] SCSI volumes sdd have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9798922c-0f59-469f-b2cb-28e5321c8e20 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f48822a-2d08-4a8e-a660-4b83bd7b5738]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9798922c-0f59-469f-b2cb-28e5321c8e20 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0695ffe9-d6f7-44a9-a7b9-69cd58614d9a]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9798922c-0f59-469f-b2cb-28e5321c8e20 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5, portal: 172.16.0.220,3260]
Aug 26 23:32:26 user nova-compute[73497]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5, portal: 172.16.0.220,3260] successful.
Aug 26 23:32:26 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a27f0d1-ee5b-474e-af0a-8b8e06311f2e]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9798922c-0f59-469f-b2cb-28e5321c8e20 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-9798922c-0f59-469f-b2cb-28e5321c8e20 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9798922c-0f59-469f-b2cb-28e5321c8e20 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] <== disconnect_volume: return (297ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:32:26 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9798922c-0f59-469f-b2cb-28e5321c8e20 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:32:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c3300bbb-9b88-476d-b44c-4b451270b5a3 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "171985a3-358d-4b26-a66c-372b9b99b386" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:32:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c3300bbb-9b88-476d-b44c-4b451270b5a3 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "171985a3-358d-4b26-a66c-372b9b99b386" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:32:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c3300bbb-9b88-476d-b44c-4b451270b5a3 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "171985a3-358d-4b26-a66c-372b9b99b386-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:32:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c3300bbb-9b88-476d-b44c-4b451270b5a3 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "171985a3-358d-4b26-a66c-372b9b99b386-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:32:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c3300bbb-9b88-476d-b44c-4b451270b5a3 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "171985a3-358d-4b26-a66c-372b9b99b386-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:32:27 user nova-compute[73497]: INFO nova.compute.manager [None req-c3300bbb-9b88-476d-b44c-4b451270b5a3 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Terminating instance
Aug 26 23:32:27 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c3300bbb-9b88-476d-b44c-4b451270b5a3 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:32:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:27 user nova-compute[73497]: DEBUG nova.compute.manager [req-38d7a414-770c-4095-9c0f-1cb6b399685c req-3780f529-3f81-4d6f-ab6d-e08bb8f345e3 service nova] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Received event network-vif-unplugged-1772e978-02b5-4c0b-a99c-67f6c6f91d58 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:32:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-38d7a414-770c-4095-9c0f-1cb6b399685c req-3780f529-3f81-4d6f-ab6d-e08bb8f345e3 service nova] Acquiring lock "171985a3-358d-4b26-a66c-372b9b99b386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:32:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-38d7a414-770c-4095-9c0f-1cb6b399685c req-3780f529-3f81-4d6f-ab6d-e08bb8f345e3 service nova] Lock "171985a3-358d-4b26-a66c-372b9b99b386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:32:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-38d7a414-770c-4095-9c0f-1cb6b399685c req-3780f529-3f81-4d6f-ab6d-e08bb8f345e3 service nova] Lock "171985a3-358d-4b26-a66c-372b9b99b386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:32:27 user nova-compute[73497]: DEBUG nova.compute.manager [req-38d7a414-770c-4095-9c0f-1cb6b399685c req-3780f529-3f81-4d6f-ab6d-e08bb8f345e3 service nova] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] No waiting events found dispatching network-vif-unplugged-1772e978-02b5-4c0b-a99c-67f6c6f91d58 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:32:27 user nova-compute[73497]: DEBUG nova.compute.manager [req-38d7a414-770c-4095-9c0f-1cb6b399685c req-3780f529-3f81-4d6f-ab6d-e08bb8f345e3 service nova] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Received event network-vif-unplugged-1772e978-02b5-4c0b-a99c-67f6c6f91d58 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:32:27 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Instance destroyed successfully.
Aug 26 23:32:27 user nova-compute[73497]: DEBUG nova.objects.instance [None req-c3300bbb-9b88-476d-b44c-4b451270b5a3 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lazy-loading 'resources' on Instance uuid 171985a3-358d-4b26-a66c-372b9b99b386 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:32:27 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-c3300bbb-9b88-476d-b44c-4b451270b5a3 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:13:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-465587333',display_name='tempest-ServerActionsTestOtherA-server-465587333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-465587333',id=4,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkEfHl6zG9yr5sr9jutwV2XJmeMlhN65J2njpgcQb6mCyEUk0cV6s9h2VdW+/plwoOss4vho5+nme8j0/zabYBtL74xkosuFNe1bIAfxbSswJHdqiCv1/r8WNi7pn3DAQ==',key_name='tempest-keypair-1008924037',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:13:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80c212cbb083450ea15ec54a96f12510',ramdisk_id='',reservation_id='r-f3kuzytx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-81910947',owner_user_name='tempest-ServerActionsTestOtherA-81910947-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:13:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='935b8635557949cfba9b6528b97da95f',uuid=171985a3-358d-4b26-a66c-372b9b99b386,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1772e978-02b5-4c0b-a99c-67f6c6f91d58", "address": "fa:16:3e:a7:28:86", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1772e978-02", "ovs_interfaceid": "1772e978-02b5-4c0b-a99c-67f6c6f91d58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:32:27 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-c3300bbb-9b88-476d-b44c-4b451270b5a3 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Converting VIF {"id": "1772e978-02b5-4c0b-a99c-67f6c6f91d58", "address": "fa:16:3e:a7:28:86", "network": {"id": "bf99a38a-faaf-4f1e-a161-736ce9089919", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-636367253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c212cbb083450ea15ec54a96f12510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1772e978-02", "ovs_interfaceid": "1772e978-02b5-4c0b-a99c-67f6c6f91d58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:32:27 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-c3300bbb-9b88-476d-b44c-4b451270b5a3 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:28:86,bridge_name='br-int',has_traffic_filtering=True,id=1772e978-02b5-4c0b-a99c-67f6c6f91d58,network=Network(bf99a38a-faaf-4f1e-a161-736ce9089919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1772e978-02') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:32:27 user nova-compute[73497]: DEBUG os_vif [None req-c3300bbb-9b88-476d-b44c-4b451270b5a3 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:28:86,bridge_name='br-int',has_traffic_filtering=True,id=1772e978-02b5-4c0b-a99c-67f6c6f91d58,network=Network(bf99a38a-faaf-4f1e-a161-736ce9089919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1772e978-02') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:32:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1772e978-02, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:32:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:32:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:27 user nova-compute[73497]: INFO os_vif [None req-c3300bbb-9b88-476d-b44c-4b451270b5a3 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:28:86,bridge_name='br-int',has_traffic_filtering=True,id=1772e978-02b5-4c0b-a99c-67f6c6f91d58,network=Network(bf99a38a-faaf-4f1e-a161-736ce9089919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1772e978-02')
Aug 26 23:32:27 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-c3300bbb-9b88-476d-b44c-4b451270b5a3 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Deleting instance files /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386_del
Aug 26 23:32:27 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-c3300bbb-9b88-476d-b44c-4b451270b5a3 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Deletion of /opt/stack/data/nova/instances/171985a3-358d-4b26-a66c-372b9b99b386_del complete
Aug 26 23:32:27 user nova-compute[73497]: INFO nova.compute.manager [None req-c3300bbb-9b88-476d-b44c-4b451270b5a3 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 26 23:32:27 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-c3300bbb-9b88-476d-b44c-4b451270b5a3 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:32:27 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:32:27 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:32:28 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:32:28 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Took 0.66 seconds to deallocate network for instance.
Aug 26 23:32:28 user nova-compute[73497]: DEBUG nova.compute.manager [req-dd819d78-4898-4c5d-817a-1ba4f91878b3 req-78998fc4-6270-460f-9ada-0c39494e996b service nova] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Received event network-vif-deleted-1772e978-02b5-4c0b-a99c-67f6c6f91d58 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:32:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c3300bbb-9b88-476d-b44c-4b451270b5a3 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:32:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c3300bbb-9b88-476d-b44c-4b451270b5a3 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:32:28 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693092733.6942542, 853bd672-97af-4e36-9bd4-5cc428b83765 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:32:28 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] VM Stopped (Lifecycle Event)
Aug 26 23:32:28 user nova-compute[73497]: DEBUG nova.compute.manager [None req-3ba4fc63-9859-41a3-967b-60f13f926f7d None None] [instance: 853bd672-97af-4e36-9bd4-5cc428b83765] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:32:28 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-c3300bbb-9b88-476d-b44c-4b451270b5a3 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:32:28 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-c3300bbb-9b88-476d-b44c-4b451270b5a3 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:32:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c3300bbb-9b88-476d-b44c-4b451270b5a3 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:32:29 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-c3300bbb-9b88-476d-b44c-4b451270b5a3 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Deleted allocations for instance 171985a3-358d-4b26-a66c-372b9b99b386
Aug 26 23:32:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c3300bbb-9b88-476d-b44c-4b451270b5a3 tempest-ServerActionsTestOtherA-81910947 tempest-ServerActionsTestOtherA-81910947-project-member] Lock "171985a3-358d-4b26-a66c-372b9b99b386" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.088s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:32:29 user nova-compute[73497]: DEBUG nova.compute.manager [req-b35fe05f-aada-4211-849f-e8c2efb5200a req-4116ef27-07c5-4674-bf14-2c51baff35a9 service nova] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Received event network-vif-plugged-1772e978-02b5-4c0b-a99c-67f6c6f91d58 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:32:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b35fe05f-aada-4211-849f-e8c2efb5200a req-4116ef27-07c5-4674-bf14-2c51baff35a9 service nova] Acquiring lock "171985a3-358d-4b26-a66c-372b9b99b386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:32:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b35fe05f-aada-4211-849f-e8c2efb5200a req-4116ef27-07c5-4674-bf14-2c51baff35a9 service nova] Lock "171985a3-358d-4b26-a66c-372b9b99b386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:32:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b35fe05f-aada-4211-849f-e8c2efb5200a req-4116ef27-07c5-4674-bf14-2c51baff35a9 service nova] Lock "171985a3-358d-4b26-a66c-372b9b99b386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:32:29 user nova-compute[73497]: DEBUG nova.compute.manager [req-b35fe05f-aada-4211-849f-e8c2efb5200a req-4116ef27-07c5-4674-bf14-2c51baff35a9 service nova] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] No waiting events found dispatching network-vif-plugged-1772e978-02b5-4c0b-a99c-67f6c6f91d58 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:32:29 user nova-compute[73497]: WARNING nova.compute.manager [req-b35fe05f-aada-4211-849f-e8c2efb5200a req-4116ef27-07c5-4674-bf14-2c51baff35a9 service nova] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Received unexpected event network-vif-plugged-1772e978-02b5-4c0b-a99c-67f6c6f91d58 for instance with vm_state deleted and task_state None.
Aug 26 23:32:30 user nova-compute[73497]: DEBUG nova.objects.instance [None req-9798922c-0f59-469f-b2cb-28e5321c8e20 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lazy-loading 'flavor' on Instance uuid e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:32:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9798922c-0f59-469f-b2cb-28e5321c8e20 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.732s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:32:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 4.616s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:32:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Acquiring lock "e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:32:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:32:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:32:30 user nova-compute[73497]: INFO nova.compute.manager [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Terminating instance
Aug 26 23:32:30 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:32:30 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:30 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:30 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:30 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:30 user nova-compute[73497]: DEBUG nova.compute.manager [req-23189d1e-03bb-478d-b1d2-55a4fe0a38a3 req-05b5eeef-5745-48c4-9b7f-f44e8c598cb2 service nova] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Received event network-vif-unplugged-8e3698bc-dd93-41f1-a767-c634e383a1cb {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:32:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-23189d1e-03bb-478d-b1d2-55a4fe0a38a3 req-05b5eeef-5745-48c4-9b7f-f44e8c598cb2 service nova] Acquiring lock "e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:32:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-23189d1e-03bb-478d-b1d2-55a4fe0a38a3 req-05b5eeef-5745-48c4-9b7f-f44e8c598cb2 service nova] Lock "e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:32:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-23189d1e-03bb-478d-b1d2-55a4fe0a38a3 req-05b5eeef-5745-48c4-9b7f-f44e8c598cb2 service nova] Lock "e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:32:30 user nova-compute[73497]: DEBUG nova.compute.manager [req-23189d1e-03bb-478d-b1d2-55a4fe0a38a3 req-05b5eeef-5745-48c4-9b7f-f44e8c598cb2 service nova] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] No waiting events found dispatching network-vif-unplugged-8e3698bc-dd93-41f1-a767-c634e383a1cb {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:32:30 user nova-compute[73497]: DEBUG nova.compute.manager [req-23189d1e-03bb-478d-b1d2-55a4fe0a38a3 req-05b5eeef-5745-48c4-9b7f-f44e8c598cb2 service nova] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Received event network-vif-unplugged-8e3698bc-dd93-41f1-a767-c634e383a1cb for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:32:31 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Instance destroyed successfully.
Aug 26 23:32:31 user nova-compute[73497]: DEBUG nova.objects.instance [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lazy-loading 'resources' on Instance uuid e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:32:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:29:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1335056796',display_name='tempest-VolumesSnapshotTestJSON-instance-1335056796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1335056796',id=36,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1uXwjtvIGLrJkHawjcGOI+SwB1jES2QTVb3HE0KFkz+Yuz59UEoprubug8vH7yjT2xnWs2izcfAAmyRqkW4AGyFo+lVlEUI0KWuFEJ+uWotCL5QBSEBUhLe4OJY7Pa3g==',key_name='tempest-keypair-1763687090',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:29:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='077c6c937fcc4d8d95eb66d8d7f87167',ramdisk_id='',reservation_id='r-z9lkaqj1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1128972653',owner_user_name='tempest-VolumesSnapshotTestJSON-1128972653-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:29:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec43dd42316042a4895706726866b103',uuid=e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e3698bc-dd93-41f1-a767-c634e383a1cb", "address": "fa:16:3e:67:db:0c", "network": {"id": "bc10efbc-a86e-4a1d-8a40-bc508dd2a6db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1634677403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "077c6c937fcc4d8d95eb66d8d7f87167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e3698bc-dd", "ovs_interfaceid": "8e3698bc-dd93-41f1-a767-c634e383a1cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:32:31 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Converting VIF {"id": "8e3698bc-dd93-41f1-a767-c634e383a1cb", "address": "fa:16:3e:67:db:0c", "network": {"id": "bc10efbc-a86e-4a1d-8a40-bc508dd2a6db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1634677403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "077c6c937fcc4d8d95eb66d8d7f87167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e3698bc-dd", "ovs_interfaceid": "8e3698bc-dd93-41f1-a767-c634e383a1cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:32:31 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:db:0c,bridge_name='br-int',has_traffic_filtering=True,id=8e3698bc-dd93-41f1-a767-c634e383a1cb,network=Network(bc10efbc-a86e-4a1d-8a40-bc508dd2a6db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e3698bc-dd') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:32:31 user nova-compute[73497]: DEBUG os_vif [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:db:0c,bridge_name='br-int',has_traffic_filtering=True,id=8e3698bc-dd93-41f1-a767-c634e383a1cb,network=Network(bc10efbc-a86e-4a1d-8a40-bc508dd2a6db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e3698bc-dd') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:32:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e3698bc-dd, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:32:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:32:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:31 user nova-compute[73497]: INFO os_vif [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:db:0c,bridge_name='br-int',has_traffic_filtering=True,id=8e3698bc-dd93-41f1-a767-c634e383a1cb,network=Network(bc10efbc-a86e-4a1d-8a40-bc508dd2a6db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e3698bc-dd')
Aug 26 23:32:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:32:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'skrhieCz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:32:31 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:32:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:32:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:32:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:617b4eeb-6d93-4ed8-8765-cab4ccf86ef5', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:32:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[938840a0-5bad-4bbf-aa80-4e80239cd33f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:32:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b21d8f-ce73-48af-8b38-5e61edf866d2]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:32:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:32:31 user nova-compute[73497]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)
Aug 26 23:32:31 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:32:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:32:31 user nova-compute[73497]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)
Aug 26 23:32:31 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:32:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282c459990>, {}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:32:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Disconnecting from: [] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:32:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.048s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:32:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] <== disconnect_volume: return (50ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:32:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:32:31 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Deleting instance files /opt/stack/data/nova/instances/e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7_del
Aug 26 23:32:31 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Deletion of /opt/stack/data/nova/instances/e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7_del complete
Aug 26 23:32:31 user nova-compute[73497]: INFO nova.compute.manager [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 26 23:32:31 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:32:31 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:32:31 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:32:32 user nova-compute[73497]: DEBUG nova.compute.manager [req-68208263-d346-4527-b5c8-9f19108a1675 req-88e2bebd-0179-4026-a8e4-74973346c640 service nova] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Received event network-vif-plugged-8e3698bc-dd93-41f1-a767-c634e383a1cb {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:32:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-68208263-d346-4527-b5c8-9f19108a1675 req-88e2bebd-0179-4026-a8e4-74973346c640 service nova] Acquiring lock "e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:32:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-68208263-d346-4527-b5c8-9f19108a1675 req-88e2bebd-0179-4026-a8e4-74973346c640 service nova] Lock "e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:32:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-68208263-d346-4527-b5c8-9f19108a1675 req-88e2bebd-0179-4026-a8e4-74973346c640 service nova] Lock "e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:32:32 user nova-compute[73497]: DEBUG nova.compute.manager [req-68208263-d346-4527-b5c8-9f19108a1675 req-88e2bebd-0179-4026-a8e4-74973346c640 service nova] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] No waiting events found dispatching network-vif-plugged-8e3698bc-dd93-41f1-a767-c634e383a1cb {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:32:32 user nova-compute[73497]: WARNING nova.compute.manager [req-68208263-d346-4527-b5c8-9f19108a1675 req-88e2bebd-0179-4026-a8e4-74973346c640 service nova] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Received unexpected event network-vif-plugged-8e3698bc-dd93-41f1-a767-c634e383a1cb for instance with vm_state active and task_state deleting.
Aug 26 23:32:32 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:32:32 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Took 1.65 seconds to deallocate network for instance.
Aug 26 23:32:32 user nova-compute[73497]: DEBUG nova.compute.manager [req-725a0b25-2d94-47e4-b175-294a89613270 req-1a4fe2ed-b502-4028-a737-0c88c58fa05d service nova] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Received event network-vif-deleted-8e3698bc-dd93-41f1-a767-c634e383a1cb {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:32:32 user nova-compute[73497]: WARNING nova.volume.cinder [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Attachment 3d8db4da-dc78-488b-8c6c-0d094159cfb1 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 3d8db4da-dc78-488b-8c6c-0d094159cfb1. (HTTP 404) (Request-ID: req-872b1309-4dc2-4c1f-b4be-1a169d21b888)
Aug 26 23:32:32 user nova-compute[73497]: INFO nova.compute.manager [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Took 0.02 seconds to detach 1 volumes for instance.
Aug 26 23:32:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:32:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:32:33 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:32:33 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:32:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:32:33 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Deleted allocations for instance e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7
Aug 26 23:32:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9b2b3e3d-8126-4d0d-8a4d-ca94cdd5c3de tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.071s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:32:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-acea6ecb-5380-4076-a156-8b3c4f301092 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "994093f0-e6b2-4c96-b259-c559ef2b1fbc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:32:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-acea6ecb-5380-4076-a156-8b3c4f301092 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "994093f0-e6b2-4c96-b259-c559ef2b1fbc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:32:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-acea6ecb-5380-4076-a156-8b3c4f301092 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "994093f0-e6b2-4c96-b259-c559ef2b1fbc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:32:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-acea6ecb-5380-4076-a156-8b3c4f301092 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "994093f0-e6b2-4c96-b259-c559ef2b1fbc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:32:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-acea6ecb-5380-4076-a156-8b3c4f301092 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "994093f0-e6b2-4c96-b259-c559ef2b1fbc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:32:35 user nova-compute[73497]: INFO nova.compute.manager [None req-acea6ecb-5380-4076-a156-8b3c4f301092 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Terminating instance
Aug 26 23:32:35 user nova-compute[73497]: DEBUG nova.compute.manager [None req-acea6ecb-5380-4076-a156-8b3c4f301092 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:32:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:36 user nova-compute[73497]: DEBUG nova.compute.manager [req-4f3dc014-a6ee-4190-8118-8cc19893e71e req-adc78221-ca99-4a2b-ab5b-800d4ed98a83 service nova] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Received event network-vif-unplugged-9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:32:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4f3dc014-a6ee-4190-8118-8cc19893e71e req-adc78221-ca99-4a2b-ab5b-800d4ed98a83 service nova] Acquiring lock "994093f0-e6b2-4c96-b259-c559ef2b1fbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:32:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4f3dc014-a6ee-4190-8118-8cc19893e71e req-adc78221-ca99-4a2b-ab5b-800d4ed98a83 service nova] Lock "994093f0-e6b2-4c96-b259-c559ef2b1fbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:32:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4f3dc014-a6ee-4190-8118-8cc19893e71e req-adc78221-ca99-4a2b-ab5b-800d4ed98a83 service nova] Lock "994093f0-e6b2-4c96-b259-c559ef2b1fbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:32:36 user nova-compute[73497]: DEBUG nova.compute.manager [req-4f3dc014-a6ee-4190-8118-8cc19893e71e req-adc78221-ca99-4a2b-ab5b-800d4ed98a83 service nova] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] No waiting events found dispatching network-vif-unplugged-9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:32:36 user nova-compute[73497]: DEBUG nova.compute.manager [req-4f3dc014-a6ee-4190-8118-8cc19893e71e req-adc78221-ca99-4a2b-ab5b-800d4ed98a83 service nova] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Received event network-vif-unplugged-9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:32:36 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Instance destroyed successfully.
Aug 26 23:32:36 user nova-compute[73497]: DEBUG nova.objects.instance [None req-acea6ecb-5380-4076-a156-8b3c4f301092 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lazy-loading 'resources' on Instance uuid 994093f0-e6b2-4c96-b259-c559ef2b1fbc {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:32:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-acea6ecb-5380-4076-a156-8b3c4f301092 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-82091661',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-82091661',id=3,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:13:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ee8ef1c899342b38a624c1c28309d41',ramdisk_id='',reservation_id='r-6yk75353',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1276656289',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:14:55Z,user_data=None,user_id='83005131fdc2411abe7a198157910743',uuid=994093f0-e6b2-4c96-b259-c559ef2b1fbc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2", "address": "fa:16:3e:b8:5f:1d", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b0aca2b-85", "ovs_interfaceid": "9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:32:36 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-acea6ecb-5380-4076-a156-8b3c4f301092 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Converting VIF {"id": "9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2", "address": "fa:16:3e:b8:5f:1d", "network": {"id": "f8ba0a6b-e4fc-4236-9df3-90ffab8824fd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1984669458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee8ef1c899342b38a624c1c28309d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b0aca2b-85", "ovs_interfaceid": "9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:32:36 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-acea6ecb-5380-4076-a156-8b3c4f301092 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:5f:1d,bridge_name='br-int',has_traffic_filtering=True,id=9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2,network=Network(f8ba0a6b-e4fc-4236-9df3-90ffab8824fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b0aca2b-85') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:32:36 user nova-compute[73497]: DEBUG os_vif [None req-acea6ecb-5380-4076-a156-8b3c4f301092 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:5f:1d,bridge_name='br-int',has_traffic_filtering=True,id=9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2,network=Network(f8ba0a6b-e4fc-4236-9df3-90ffab8824fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b0aca2b-85') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:32:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b0aca2b-85, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:32:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:32:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:36 user nova-compute[73497]: INFO os_vif [None req-acea6ecb-5380-4076-a156-8b3c4f301092 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:5f:1d,bridge_name='br-int',has_traffic_filtering=True,id=9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2,network=Network(f8ba0a6b-e4fc-4236-9df3-90ffab8824fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b0aca2b-85')
Aug 26 23:32:36 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-acea6ecb-5380-4076-a156-8b3c4f301092 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Deleting instance files /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc_del
Aug 26 23:32:36 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-acea6ecb-5380-4076-a156-8b3c4f301092 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Deletion of /opt/stack/data/nova/instances/994093f0-e6b2-4c96-b259-c559ef2b1fbc_del complete
Aug 26 23:32:36 user nova-compute[73497]: INFO nova.compute.manager [None req-acea6ecb-5380-4076-a156-8b3c4f301092 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 26 23:32:36 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-acea6ecb-5380-4076-a156-8b3c4f301092 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:32:36 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:32:36 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:32:37 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:32:37 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Took 0.57 seconds to deallocate network for instance.
Aug 26 23:32:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-acea6ecb-5380-4076-a156-8b3c4f301092 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:32:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-acea6ecb-5380-4076-a156-8b3c4f301092 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:32:37 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-acea6ecb-5380-4076-a156-8b3c4f301092 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:32:37 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-acea6ecb-5380-4076-a156-8b3c4f301092 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:32:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-acea6ecb-5380-4076-a156-8b3c4f301092 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.255s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:32:37 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-acea6ecb-5380-4076-a156-8b3c4f301092 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Deleted allocations for instance 994093f0-e6b2-4c96-b259-c559ef2b1fbc
Aug 26 23:32:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-acea6ecb-5380-4076-a156-8b3c4f301092 tempest-ServerBootFromVolumeStableRescueTest-1276656289 tempest-ServerBootFromVolumeStableRescueTest-1276656289-project-member] Lock "994093f0-e6b2-4c96-b259-c559ef2b1fbc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.884s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:32:38 user nova-compute[73497]: DEBUG nova.compute.manager [req-21092b8d-c786-45c2-becf-e99be52d4a8b req-d6b37bf4-301d-4f2d-b964-cb1cc57c42f6 service nova] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Received event network-vif-plugged-9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:32:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-21092b8d-c786-45c2-becf-e99be52d4a8b req-d6b37bf4-301d-4f2d-b964-cb1cc57c42f6 service nova] Acquiring lock "994093f0-e6b2-4c96-b259-c559ef2b1fbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:32:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-21092b8d-c786-45c2-becf-e99be52d4a8b req-d6b37bf4-301d-4f2d-b964-cb1cc57c42f6 service nova] Lock "994093f0-e6b2-4c96-b259-c559ef2b1fbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:32:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-21092b8d-c786-45c2-becf-e99be52d4a8b req-d6b37bf4-301d-4f2d-b964-cb1cc57c42f6 service nova] Lock "994093f0-e6b2-4c96-b259-c559ef2b1fbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:32:38 user nova-compute[73497]: DEBUG nova.compute.manager [req-21092b8d-c786-45c2-becf-e99be52d4a8b req-d6b37bf4-301d-4f2d-b964-cb1cc57c42f6 service nova] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] No waiting events found dispatching network-vif-plugged-9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:32:38 user nova-compute[73497]: WARNING nova.compute.manager [req-21092b8d-c786-45c2-becf-e99be52d4a8b req-d6b37bf4-301d-4f2d-b964-cb1cc57c42f6 service nova] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Received unexpected event network-vif-plugged-9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2 for instance with vm_state deleted and task_state None.
Aug 26 23:32:38 user nova-compute[73497]: DEBUG nova.compute.manager [req-21092b8d-c786-45c2-becf-e99be52d4a8b req-d6b37bf4-301d-4f2d-b964-cb1cc57c42f6 service nova] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Received event network-vif-deleted-9b0aca2b-85cd-44d9-b9bb-a36d9fbabde2 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:32:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:42 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693092747.7603471, 171985a3-358d-4b26-a66c-372b9b99b386 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:32:42 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] VM Stopped (Lifecycle Event)
Aug 26 23:32:42 user nova-compute[73497]: DEBUG nova.compute.manager [None req-6059a2f4-b43d-4903-af19-a38529485eb7 None None] [instance: 171985a3-358d-4b26-a66c-372b9b99b386] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:32:46 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693092751.117884, e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:32:46 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] VM Stopped (Lifecycle Event)
Aug 26 23:32:46 user nova-compute[73497]: DEBUG nova.compute.manager [None req-acde5124-9354-4789-b7a4-7664dc49870f None None] [instance: e5c684b7-9f7e-40d0-9ef8-cc050ea0c9d7] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:32:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:32:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:32:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:32:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:32:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:51 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693092756.6410291, 994093f0-e6b2-4c96-b259-c559ef2b1fbc => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:32:51 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] VM Stopped (Lifecycle Event)
Aug 26 23:32:51 user nova-compute[73497]: DEBUG nova.compute.manager [None req-93da1e50-61ad-48c4-879b-7472c22a2b6f None None] [instance: 994093f0-e6b2-4c96-b259-c559ef2b1fbc] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:32:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:32:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:53 user nova-compute[73497]: DEBUG nova.compute.manager [req-5dd54fd5-d00a-4e75-bbf8-37e46e9c3260 req-594a2c42-3378-4cb0-9617-e172575317ae service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Received event network-changed-9993c7ac-e4a2-41c8-97d9-75c681d68a6a {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:32:53 user nova-compute[73497]: DEBUG nova.compute.manager [req-5dd54fd5-d00a-4e75-bbf8-37e46e9c3260 req-594a2c42-3378-4cb0-9617-e172575317ae service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Refreshing instance network info cache due to event network-changed-9993c7ac-e4a2-41c8-97d9-75c681d68a6a. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:32:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-5dd54fd5-d00a-4e75-bbf8-37e46e9c3260 req-594a2c42-3378-4cb0-9617-e172575317ae service nova] Acquiring lock "refresh_cache-b7506745-ace5-45e2-bc1d-883f2c51f1c4" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:32:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-5dd54fd5-d00a-4e75-bbf8-37e46e9c3260 req-594a2c42-3378-4cb0-9617-e172575317ae service nova] Acquired lock "refresh_cache-b7506745-ace5-45e2-bc1d-883f2c51f1c4" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:32:53 user nova-compute[73497]: DEBUG nova.network.neutron [req-5dd54fd5-d00a-4e75-bbf8-37e46e9c3260 req-594a2c42-3378-4cb0-9617-e172575317ae service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Refreshing network info cache for port 9993c7ac-e4a2-41c8-97d9-75c681d68a6a {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:32:54 user nova-compute[73497]: DEBUG nova.network.neutron [req-5dd54fd5-d00a-4e75-bbf8-37e46e9c3260 req-594a2c42-3378-4cb0-9617-e172575317ae service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Updated VIF entry in instance network info cache for port 9993c7ac-e4a2-41c8-97d9-75c681d68a6a. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:32:54 user nova-compute[73497]: DEBUG nova.network.neutron [req-5dd54fd5-d00a-4e75-bbf8-37e46e9c3260 req-594a2c42-3378-4cb0-9617-e172575317ae service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Updating instance_info_cache with network_info: [{"id": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "address": "fa:16:3e:7e:a1:4c", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9993c7ac-e4", "ovs_interfaceid": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:32:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-5dd54fd5-d00a-4e75-bbf8-37e46e9c3260 req-594a2c42-3378-4cb0-9617-e172575317ae service nova] Releasing lock "refresh_cache-b7506745-ace5-45e2-bc1d-883f2c51f1c4" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:32:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ed3931da-a9ad-4aa4-a845-e432e6651328 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:32:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ed3931da-a9ad-4aa4-a845-e432e6651328 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:32:54 user nova-compute[73497]: INFO nova.compute.manager [None req-ed3931da-a9ad-4aa4-a845-e432e6651328 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Detaching volume 69263bc9-1275-443e-8f69-79a2098f3345
Aug 26 23:32:54 user nova-compute[73497]: INFO nova.virt.block_device [None req-ed3931da-a9ad-4aa4-a845-e432e6651328 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Attempting to driver detach volume 69263bc9-1275-443e-8f69-79a2098f3345 from mountpoint /dev/vdb
Aug 26 23:32:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ed3931da-a9ad-4aa4-a845-e432e6651328 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Attempting to detach device vdb from instance b7506745-ace5-45e2-bc1d-883f2c51f1c4 from the persistent domain config. {{(pid=73497) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 23:32:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-ed3931da-a9ad-4aa4-a845-e432e6651328 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:32:54 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:32:54 user nova-compute[73497]:   <source dev="/dev/sdb"/>
Aug 26 23:32:54 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:32:54 user nova-compute[73497]:   <serial>69263bc9-1275-443e-8f69-79a2098f3345</serial>
Aug 26 23:32:54 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 23:32:54 user nova-compute[73497]: </disk>
Aug 26 23:32:54 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:32:54 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-ed3931da-a9ad-4aa4-a845-e432e6651328 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Successfully detached device vdb from instance b7506745-ace5-45e2-bc1d-883f2c51f1c4 from the persistent domain config.
Aug 26 23:32:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ed3931da-a9ad-4aa4-a845-e432e6651328 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b7506745-ace5-45e2-bc1d-883f2c51f1c4 from the live domain config. {{(pid=73497) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 23:32:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-ed3931da-a9ad-4aa4-a845-e432e6651328 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:32:54 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:32:54 user nova-compute[73497]:   <source dev="/dev/sdb"/>
Aug 26 23:32:54 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:32:54 user nova-compute[73497]:   <serial>69263bc9-1275-443e-8f69-79a2098f3345</serial>
Aug 26 23:32:54 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 23:32:54 user nova-compute[73497]: </disk>
Aug 26 23:32:54 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Received event <DeviceRemovedEvent: 1693092775.2970452, b7506745-ace5-45e2-bc1d-883f2c51f1c4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73497) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ed3931da-a9ad-4aa4-a845-e432e6651328 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b7506745-ace5-45e2-bc1d-883f2c51f1c4 {{(pid=73497) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 23:32:55 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-ed3931da-a9ad-4aa4-a845-e432e6651328 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Successfully detached device vdb from instance b7506745-ace5-45e2-bc1d-883f2c51f1c4 from the live domain config.
Aug 26 23:32:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed3931da-a9ad-4aa4-a845-e432e6651328 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3931da-a9ad-4aa4-a845-e432e6651328 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xcfGFVCj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:32:55 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-ed3931da-a9ad-4aa4-a845-e432e6651328 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:32:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-ed3931da-a9ad-4aa4-a845-e432e6651328 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-ed3931da-a9ad-4aa4-a845-e432e6651328 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3931da-a9ad-4aa4-a845-e432e6651328 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cdf6b43-b3b7-4f7a-a80b-3b7765594e46]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfefb1b5-a1aa-4de6-8841-bfa5b4b1e2a8]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3931da-a9ad-4aa4-a845-e432e6651328 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:32:55 user nova-compute[73497]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)
Aug 26 23:32:55 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3931da-a9ad-4aa4-a845-e432e6651328 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:32:55 user nova-compute[73497]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 (non-flash)
Aug 26 23:32:55 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3931da-a9ad-4aa4-a845-e432e6651328 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281c4c3a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345'): ({'sdb'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-ed3931da-a9ad-4aa4-a845-e432e6651328 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Removing single pathed devices sdb {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f13d7a-afcc-4bef-9a4e-21eff90313fb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[25754eb8-0d39-40ee-a8ea-8961d8a050c2]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-ed3931da-a9ad-4aa4-a845-e432e6651328 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Flushing IO for device /dev/sdb {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee25f965-d8c2-4112-9500-db3113f87d42]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-ed3931da-a9ad-4aa4-a845-e432e6651328 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bbdee9-1150-4f67-8b12-891ee261b04c]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-ed3931da-a9ad-4aa4-a845-e432e6651328 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-ed3931da-a9ad-4aa4-a845-e432e6651328 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3931da-a9ad-4aa4-a845-e432e6651328 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[55479dd5-681d-4585-b731-b6fc7bcfc140]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3931da-a9ad-4aa4-a845-e432e6651328 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG nova.compute.manager [req-37ab18c9-90dd-4445-aad4-b0641138680d req-271caf01-a557-49b1-95e0-926144329977 service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Received event network-changed-9993c7ac-e4a2-41c8-97d9-75c681d68a6a {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG nova.compute.manager [req-37ab18c9-90dd-4445-aad4-b0641138680d req-271caf01-a557-49b1-95e0-926144329977 service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Refreshing instance network info cache due to event network-changed-9993c7ac-e4a2-41c8-97d9-75c681d68a6a. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-37ab18c9-90dd-4445-aad4-b0641138680d req-271caf01-a557-49b1-95e0-926144329977 service nova] Acquiring lock "refresh_cache-b7506745-ace5-45e2-bc1d-883f2c51f1c4" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-37ab18c9-90dd-4445-aad4-b0641138680d req-271caf01-a557-49b1-95e0-926144329977 service nova] Acquired lock "refresh_cache-b7506745-ace5-45e2-bc1d-883f2c51f1c4" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG nova.network.neutron [req-37ab18c9-90dd-4445-aad4-b0641138680d req-271caf01-a557-49b1-95e0-926144329977 service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Refreshing network info cache for port 9993c7ac-e4a2-41c8-97d9-75c681d68a6a {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[56106434-9e72-4125-8a71-f68762fe9c08]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3931da-a9ad-4aa4-a845-e432e6651328 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345, portal: 172.16.0.220,3260]
Aug 26 23:32:55 user nova-compute[73497]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345, portal: 172.16.0.220,3260] successful.
Aug 26 23:32:55 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69263bc9-1275-443e-8f69-79a2098f3345 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eff6477-de84-4c81-bc7a-0b770583ffb5]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3931da-a9ad-4aa4-a845-e432e6651328 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-ed3931da-a9ad-4aa4-a845-e432e6651328 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3931da-a9ad-4aa4-a845-e432e6651328 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] <== disconnect_volume: return (294ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:32:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed3931da-a9ad-4aa4-a845-e432e6651328 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:32:56 user nova-compute[73497]: DEBUG nova.network.neutron [req-37ab18c9-90dd-4445-aad4-b0641138680d req-271caf01-a557-49b1-95e0-926144329977 service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Updated VIF entry in instance network info cache for port 9993c7ac-e4a2-41c8-97d9-75c681d68a6a. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:32:56 user nova-compute[73497]: DEBUG nova.network.neutron [req-37ab18c9-90dd-4445-aad4-b0641138680d req-271caf01-a557-49b1-95e0-926144329977 service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Updating instance_info_cache with network_info: [{"id": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "address": "fa:16:3e:7e:a1:4c", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9993c7ac-e4", "ovs_interfaceid": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:32:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-37ab18c9-90dd-4445-aad4-b0641138680d req-271caf01-a557-49b1-95e0-926144329977 service nova] Releasing lock "refresh_cache-b7506745-ace5-45e2-bc1d-883f2c51f1c4" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:32:56 user nova-compute[73497]: DEBUG nova.objects.instance [None req-ed3931da-a9ad-4aa4-a845-e432e6651328 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lazy-loading 'flavor' on Instance uuid b7506745-ace5-45e2-bc1d-883f2c51f1c4 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:32:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ed3931da-a9ad-4aa4-a845-e432e6651328 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.729s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:32:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:32:59 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:32:59 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:33:01 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:33:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:33:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:33:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:33:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:33:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:33:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:33:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:33:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:33:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0e68638-bc72-4dd5-8399-7bf207b84b9e/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:33:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0e68638-bc72-4dd5-8399-7bf207b84b9e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:33:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0e68638-bc72-4dd5-8399-7bf207b84b9e/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:33:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0e68638-bc72-4dd5-8399-7bf207b84b9e/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:33:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:33:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:33:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:33:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:33:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:33:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:33:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:33:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:33:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:33:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:33:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:33:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:33:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:33:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:33:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:33:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:33:03 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:33:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:33:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:33:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:33:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:33:04 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:33:04 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:33:04 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=7959MB free_disk=25.132232666015625GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:33:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:33:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:33:04 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 043294e5-0618-4a31-bb19-1227ef1f5d39 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:33:04 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance e9e5c83f-0678-48d4-a81f-1a3f959aabcf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:33:04 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance f7c83073-fadc-4e41-a4a9-df0bbe11aa28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:33:04 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance e15ddee6-a642-4638-9534-21e640b3d017 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:33:04 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance b7506745-ace5-45e2-bc1d-883f2c51f1c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:33:04 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance b0e68638-bc72-4dd5-8399-7bf207b84b9e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:33:04 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:33:04 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:33:04 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:33:04 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:33:04 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:33:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.404s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:33:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-6b4b1f41-5f93-4a2d-91a3-823d82781060 tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Acquiring lock "b0e68638-bc72-4dd5-8399-7bf207b84b9e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:33:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-6b4b1f41-5f93-4a2d-91a3-823d82781060 tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Lock "b0e68638-bc72-4dd5-8399-7bf207b84b9e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:33:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-6b4b1f41-5f93-4a2d-91a3-823d82781060 tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Acquiring lock "b0e68638-bc72-4dd5-8399-7bf207b84b9e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:33:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-6b4b1f41-5f93-4a2d-91a3-823d82781060 tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Lock "b0e68638-bc72-4dd5-8399-7bf207b84b9e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:33:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-6b4b1f41-5f93-4a2d-91a3-823d82781060 tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Lock "b0e68638-bc72-4dd5-8399-7bf207b84b9e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:33:05 user nova-compute[73497]: INFO nova.compute.manager [None req-6b4b1f41-5f93-4a2d-91a3-823d82781060 tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Terminating instance
Aug 26 23:33:05 user nova-compute[73497]: DEBUG nova.compute.manager [None req-6b4b1f41-5f93-4a2d-91a3-823d82781060 tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:33:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:05 user nova-compute[73497]: DEBUG nova.compute.manager [req-e4795b68-46c9-48c4-93b6-c385f5245259 req-c0c24db6-2790-405f-87e9-bf64e446b577 service nova] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Received event network-vif-unplugged-21638ebe-d593-4c59-9448-e636a441ef73 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:33:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-e4795b68-46c9-48c4-93b6-c385f5245259 req-c0c24db6-2790-405f-87e9-bf64e446b577 service nova] Acquiring lock "b0e68638-bc72-4dd5-8399-7bf207b84b9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:33:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-e4795b68-46c9-48c4-93b6-c385f5245259 req-c0c24db6-2790-405f-87e9-bf64e446b577 service nova] Lock "b0e68638-bc72-4dd5-8399-7bf207b84b9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:33:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-e4795b68-46c9-48c4-93b6-c385f5245259 req-c0c24db6-2790-405f-87e9-bf64e446b577 service nova] Lock "b0e68638-bc72-4dd5-8399-7bf207b84b9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:33:05 user nova-compute[73497]: DEBUG nova.compute.manager [req-e4795b68-46c9-48c4-93b6-c385f5245259 req-c0c24db6-2790-405f-87e9-bf64e446b577 service nova] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] No waiting events found dispatching network-vif-unplugged-21638ebe-d593-4c59-9448-e636a441ef73 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:33:05 user nova-compute[73497]: DEBUG nova.compute.manager [req-e4795b68-46c9-48c4-93b6-c385f5245259 req-c0c24db6-2790-405f-87e9-bf64e446b577 service nova] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Received event network-vif-unplugged-21638ebe-d593-4c59-9448-e636a441ef73 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:33:06 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Instance destroyed successfully.
Aug 26 23:33:06 user nova-compute[73497]: DEBUG nova.objects.instance [None req-6b4b1f41-5f93-4a2d-91a3-823d82781060 tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Lazy-loading 'resources' on Instance uuid b0e68638-bc72-4dd5-8399-7bf207b84b9e {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:33:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-6b4b1f41-5f93-4a2d-91a3-823d82781060 tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:31:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-981347675',display_name='tempest-VolumesNegativeTest-instance-981347675',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-981347675',id=37,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:31:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20af6632e6144c14b9467a2fe40b177c',ramdisk_id='',reservation_id='r-1io6cube',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1933908261',owner_user_name='tempest-VolumesNegativeTest-1933908261-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:31:22Z,user_data=None,user_id='b74def2c45ed436fa80455e81d501ed8',uuid=b0e68638-bc72-4dd5-8399-7bf207b84b9e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21638ebe-d593-4c59-9448-e636a441ef73", "address": "fa:16:3e:5d:12:d6", "network": {"id": "6b9c64ec-dcbd-4e55-8afe-ea10643d3640", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a72e239cc180405f8d119376217b6f9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21638ebe-d5", "ovs_interfaceid": "21638ebe-d593-4c59-9448-e636a441ef73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:33:06 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-6b4b1f41-5f93-4a2d-91a3-823d82781060 tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Converting VIF {"id": "21638ebe-d593-4c59-9448-e636a441ef73", "address": "fa:16:3e:5d:12:d6", "network": {"id": "6b9c64ec-dcbd-4e55-8afe-ea10643d3640", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a72e239cc180405f8d119376217b6f9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21638ebe-d5", "ovs_interfaceid": "21638ebe-d593-4c59-9448-e636a441ef73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:33:06 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-6b4b1f41-5f93-4a2d-91a3-823d82781060 tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:12:d6,bridge_name='br-int',has_traffic_filtering=True,id=21638ebe-d593-4c59-9448-e636a441ef73,network=Network(6b9c64ec-dcbd-4e55-8afe-ea10643d3640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21638ebe-d5') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:33:06 user nova-compute[73497]: DEBUG os_vif [None req-6b4b1f41-5f93-4a2d-91a3-823d82781060 tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:12:d6,bridge_name='br-int',has_traffic_filtering=True,id=21638ebe-d593-4c59-9448-e636a441ef73,network=Network(6b9c64ec-dcbd-4e55-8afe-ea10643d3640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21638ebe-d5') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:33:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21638ebe-d5, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:33:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:33:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:06 user nova-compute[73497]: INFO os_vif [None req-6b4b1f41-5f93-4a2d-91a3-823d82781060 tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:12:d6,bridge_name='br-int',has_traffic_filtering=True,id=21638ebe-d593-4c59-9448-e636a441ef73,network=Network(6b9c64ec-dcbd-4e55-8afe-ea10643d3640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21638ebe-d5')
Aug 26 23:33:06 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-6b4b1f41-5f93-4a2d-91a3-823d82781060 tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Deleting instance files /opt/stack/data/nova/instances/b0e68638-bc72-4dd5-8399-7bf207b84b9e_del
Aug 26 23:33:06 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-6b4b1f41-5f93-4a2d-91a3-823d82781060 tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Deletion of /opt/stack/data/nova/instances/b0e68638-bc72-4dd5-8399-7bf207b84b9e_del complete
Aug 26 23:33:06 user nova-compute[73497]: INFO nova.compute.manager [None req-6b4b1f41-5f93-4a2d-91a3-823d82781060 tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 26 23:33:06 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-6b4b1f41-5f93-4a2d-91a3-823d82781060 tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:33:06 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:33:06 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:33:06 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:33:06 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:33:06 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:33:07 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:33:07 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Took 0.71 seconds to deallocate network for instance.
Aug 26 23:33:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-6b4b1f41-5f93-4a2d-91a3-823d82781060 tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:33:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-6b4b1f41-5f93-4a2d-91a3-823d82781060 tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:33:07 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:33:07 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-6b4b1f41-5f93-4a2d-91a3-823d82781060 tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:33:07 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-6b4b1f41-5f93-4a2d-91a3-823d82781060 tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:33:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-6b4b1f41-5f93-4a2d-91a3-823d82781060 tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.218s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:33:07 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-6b4b1f41-5f93-4a2d-91a3-823d82781060 tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Deleted allocations for instance b0e68638-bc72-4dd5-8399-7bf207b84b9e
Aug 26 23:33:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-6b4b1f41-5f93-4a2d-91a3-823d82781060 tempest-VolumesNegativeTest-1933908261 tempest-VolumesNegativeTest-1933908261-project-member] Lock "b0e68638-bc72-4dd5-8399-7bf207b84b9e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.082s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:33:07 user nova-compute[73497]: DEBUG nova.compute.manager [req-5647d954-5980-4970-bb0b-f3e5b4868e6a req-b848888b-61ef-45a3-9160-591086c57f70 service nova] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Received event network-vif-plugged-21638ebe-d593-4c59-9448-e636a441ef73 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:33:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-5647d954-5980-4970-bb0b-f3e5b4868e6a req-b848888b-61ef-45a3-9160-591086c57f70 service nova] Acquiring lock "b0e68638-bc72-4dd5-8399-7bf207b84b9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:33:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-5647d954-5980-4970-bb0b-f3e5b4868e6a req-b848888b-61ef-45a3-9160-591086c57f70 service nova] Lock "b0e68638-bc72-4dd5-8399-7bf207b84b9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:33:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-5647d954-5980-4970-bb0b-f3e5b4868e6a req-b848888b-61ef-45a3-9160-591086c57f70 service nova] Lock "b0e68638-bc72-4dd5-8399-7bf207b84b9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:33:07 user nova-compute[73497]: DEBUG nova.compute.manager [req-5647d954-5980-4970-bb0b-f3e5b4868e6a req-b848888b-61ef-45a3-9160-591086c57f70 service nova] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] No waiting events found dispatching network-vif-plugged-21638ebe-d593-4c59-9448-e636a441ef73 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:33:07 user nova-compute[73497]: WARNING nova.compute.manager [req-5647d954-5980-4970-bb0b-f3e5b4868e6a req-b848888b-61ef-45a3-9160-591086c57f70 service nova] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Received unexpected event network-vif-plugged-21638ebe-d593-4c59-9448-e636a441ef73 for instance with vm_state deleted and task_state None.
Aug 26 23:33:07 user nova-compute[73497]: DEBUG nova.compute.manager [req-5647d954-5980-4970-bb0b-f3e5b4868e6a req-b848888b-61ef-45a3-9160-591086c57f70 service nova] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Received event network-vif-deleted-21638ebe-d593-4c59-9448-e636a441ef73 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:33:08 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:33:09 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:33:09 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:33:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-f7c83073-fadc-4e41-a4a9-df0bbe11aa28" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:33:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-f7c83073-fadc-4e41-a4a9-df0bbe11aa28" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:33:09 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:33:09 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Updating instance_info_cache with network_info: [{"id": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "address": "fa:16:3e:cf:bd:9e", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74cddf0f-c3", "ovs_interfaceid": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:33:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-f7c83073-fadc-4e41-a4a9-df0bbe11aa28" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:33:09 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:33:09 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:33:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:14 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:33:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:17 user nova-compute[73497]: DEBUG nova.compute.manager [req-80991a01-3bfc-4f04-816f-ab1ec5646a02 req-7e744b4a-85a7-4740-877e-6078f0c2e0cb service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Received event network-changed-8d982123-d2ef-4d00-95d1-bee24f228175 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:33:17 user nova-compute[73497]: DEBUG nova.compute.manager [req-80991a01-3bfc-4f04-816f-ab1ec5646a02 req-7e744b4a-85a7-4740-877e-6078f0c2e0cb service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Refreshing instance network info cache due to event network-changed-8d982123-d2ef-4d00-95d1-bee24f228175. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:33:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-80991a01-3bfc-4f04-816f-ab1ec5646a02 req-7e744b4a-85a7-4740-877e-6078f0c2e0cb service nova] Acquiring lock "refresh_cache-e15ddee6-a642-4638-9534-21e640b3d017" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:33:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-80991a01-3bfc-4f04-816f-ab1ec5646a02 req-7e744b4a-85a7-4740-877e-6078f0c2e0cb service nova] Acquired lock "refresh_cache-e15ddee6-a642-4638-9534-21e640b3d017" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:33:17 user nova-compute[73497]: DEBUG nova.network.neutron [req-80991a01-3bfc-4f04-816f-ab1ec5646a02 req-7e744b4a-85a7-4740-877e-6078f0c2e0cb service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Refreshing network info cache for port 8d982123-d2ef-4d00-95d1-bee24f228175 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:33:18 user nova-compute[73497]: DEBUG nova.network.neutron [req-80991a01-3bfc-4f04-816f-ab1ec5646a02 req-7e744b4a-85a7-4740-877e-6078f0c2e0cb service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Updated VIF entry in instance network info cache for port 8d982123-d2ef-4d00-95d1-bee24f228175. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:33:18 user nova-compute[73497]: DEBUG nova.network.neutron [req-80991a01-3bfc-4f04-816f-ab1ec5646a02 req-7e744b4a-85a7-4740-877e-6078f0c2e0cb service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Updating instance_info_cache with network_info: [{"id": "8d982123-d2ef-4d00-95d1-bee24f228175", "address": "fa:16:3e:e8:ce:24", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d982123-d2", "ovs_interfaceid": "8d982123-d2ef-4d00-95d1-bee24f228175", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:33:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-80991a01-3bfc-4f04-816f-ab1ec5646a02 req-7e744b4a-85a7-4740-877e-6078f0c2e0cb service nova] Releasing lock "refresh_cache-e15ddee6-a642-4638-9534-21e640b3d017" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:33:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-32add6aa-3c37-4c49-8af7-72f19bf38a8a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "e15ddee6-a642-4638-9534-21e640b3d017" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:33:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-32add6aa-3c37-4c49-8af7-72f19bf38a8a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "e15ddee6-a642-4638-9534-21e640b3d017" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:33:18 user nova-compute[73497]: INFO nova.compute.manager [None req-32add6aa-3c37-4c49-8af7-72f19bf38a8a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Detaching volume c8aa603f-2da2-4539-8010-8eb3eb6fcb13
Aug 26 23:33:18 user nova-compute[73497]: INFO nova.virt.block_device [None req-32add6aa-3c37-4c49-8af7-72f19bf38a8a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Attempting to driver detach volume c8aa603f-2da2-4539-8010-8eb3eb6fcb13 from mountpoint /dev/vdb
Aug 26 23:33:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-32add6aa-3c37-4c49-8af7-72f19bf38a8a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Attempting to detach device vdb from instance e15ddee6-a642-4638-9534-21e640b3d017 from the persistent domain config. {{(pid=73497) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 23:33:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-32add6aa-3c37-4c49-8af7-72f19bf38a8a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:33:18 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:33:18 user nova-compute[73497]:   <source dev="/dev/sdf"/>
Aug 26 23:33:18 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:33:18 user nova-compute[73497]:   <serial>c8aa603f-2da2-4539-8010-8eb3eb6fcb13</serial>
Aug 26 23:33:18 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:33:18 user nova-compute[73497]: </disk>
Aug 26 23:33:18 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:33:18 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-32add6aa-3c37-4c49-8af7-72f19bf38a8a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Successfully detached device vdb from instance e15ddee6-a642-4638-9534-21e640b3d017 from the persistent domain config.
Aug 26 23:33:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-32add6aa-3c37-4c49-8af7-72f19bf38a8a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e15ddee6-a642-4638-9534-21e640b3d017 from the live domain config. {{(pid=73497) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 23:33:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-32add6aa-3c37-4c49-8af7-72f19bf38a8a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:33:18 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:33:18 user nova-compute[73497]:   <source dev="/dev/sdf"/>
Aug 26 23:33:18 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:33:18 user nova-compute[73497]:   <serial>c8aa603f-2da2-4539-8010-8eb3eb6fcb13</serial>
Aug 26 23:33:18 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:33:18 user nova-compute[73497]: </disk>
Aug 26 23:33:18 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:33:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Received event <DeviceRemovedEvent: 1693092798.8322024, e15ddee6-a642-4638-9534-21e640b3d017 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73497) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 23:33:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-32add6aa-3c37-4c49-8af7-72f19bf38a8a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e15ddee6-a642-4638-9534-21e640b3d017 {{(pid=73497) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 23:33:18 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-32add6aa-3c37-4c49-8af7-72f19bf38a8a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Successfully detached device vdb from instance e15ddee6-a642-4638-9534-21e640b3d017 from the live domain config.
Aug 26 23:33:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32add6aa-3c37-4c49-8af7-72f19bf38a8a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:33:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-32add6aa-3c37-4c49-8af7-72f19bf38a8a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lIpBFJvH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:33:18 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-32add6aa-3c37-4c49-8af7-72f19bf38a8a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:33:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-32add6aa-3c37-4c49-8af7-72f19bf38a8a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:33:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-32add6aa-3c37-4c49-8af7-72f19bf38a8a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:33:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-32add6aa-3c37-4c49-8af7-72f19bf38a8a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:33:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:33:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:33:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3cd296-0417-45d5-aca4-0648fec4f7c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:33:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:33:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:33:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[607e2080-1196-4cff-9325-ec4f095f8401]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:33:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-32add6aa-3c37-4c49-8af7-72f19bf38a8a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:33:18 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:33:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-32add6aa-3c37-4c49-8af7-72f19bf38a8a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 (non-flash)
Aug 26 23:33:18 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:33:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-32add6aa-3c37-4c49-8af7-72f19bf38a8a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281c4c3d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13'): ({'sdf'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:33:18 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-32add6aa-3c37-4c49-8af7-72f19bf38a8a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Removing single pathed devices sdf {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:33:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:33:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:33:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[743e66b1-aa4b-4212-b8f4-796d85cceed4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:33:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:33:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:33:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78538eb-0e22-4020-ad53-08fd4a7638a5]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:33:18 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-32add6aa-3c37-4c49-8af7-72f19bf38a8a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Flushing IO for device /dev/sdf {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:33:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:33:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:33:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c421f983-5478-47af-b828-e00125a764dd]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:33:18 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-32add6aa-3c37-4c49-8af7-72f19bf38a8a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:33:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:33:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.057s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:33:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c616e0d-39db-4913-99e0-4edba185468a]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:33:19 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-32add6aa-3c37-4c49-8af7-72f19bf38a8a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:33:19 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-32add6aa-3c37-4c49-8af7-72f19bf38a8a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] SCSI volumes sdf have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:33:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-32add6aa-3c37-4c49-8af7-72f19bf38a8a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:33:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:33:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:33:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca819dbe-2a24-4276-a487-7735ec4f4484]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:33:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-32add6aa-3c37-4c49-8af7-72f19bf38a8a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:33:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:33:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:33:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd482d27-a32e-49b8-acc0-38633e97e88d]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:33:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-32add6aa-3c37-4c49-8af7-72f19bf38a8a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13, portal: 172.16.0.220,3260]
Aug 26 23:33:19 user nova-compute[73497]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13, portal: 172.16.0.220,3260] successful.
Aug 26 23:33:19 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:33:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:33:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa603f-2da2-4539-8010-8eb3eb6fcb13 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:33:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[071945c7-1544-4c61-ab07-7b27fc40f198]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:33:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-32add6aa-3c37-4c49-8af7-72f19bf38a8a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:33:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-32add6aa-3c37-4c49-8af7-72f19bf38a8a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:33:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-32add6aa-3c37-4c49-8af7-72f19bf38a8a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] <== disconnect_volume: return (314ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:33:19 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32add6aa-3c37-4c49-8af7-72f19bf38a8a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:33:19 user nova-compute[73497]: DEBUG nova.compute.manager [req-3834d32d-dd5a-4a9e-9a50-694ee8b78819 req-a9dd2bf6-726d-4618-b2d8-506b46d222a7 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Received event network-changed-8d982123-d2ef-4d00-95d1-bee24f228175 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:33:19 user nova-compute[73497]: DEBUG nova.compute.manager [req-3834d32d-dd5a-4a9e-9a50-694ee8b78819 req-a9dd2bf6-726d-4618-b2d8-506b46d222a7 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Refreshing instance network info cache due to event network-changed-8d982123-d2ef-4d00-95d1-bee24f228175. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:33:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3834d32d-dd5a-4a9e-9a50-694ee8b78819 req-a9dd2bf6-726d-4618-b2d8-506b46d222a7 service nova] Acquiring lock "refresh_cache-e15ddee6-a642-4638-9534-21e640b3d017" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:33:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3834d32d-dd5a-4a9e-9a50-694ee8b78819 req-a9dd2bf6-726d-4618-b2d8-506b46d222a7 service nova] Acquired lock "refresh_cache-e15ddee6-a642-4638-9534-21e640b3d017" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:33:19 user nova-compute[73497]: DEBUG nova.network.neutron [req-3834d32d-dd5a-4a9e-9a50-694ee8b78819 req-a9dd2bf6-726d-4618-b2d8-506b46d222a7 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Refreshing network info cache for port 8d982123-d2ef-4d00-95d1-bee24f228175 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:33:19 user nova-compute[73497]: DEBUG nova.objects.instance [None req-32add6aa-3c37-4c49-8af7-72f19bf38a8a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lazy-loading 'flavor' on Instance uuid e15ddee6-a642-4638-9534-21e640b3d017 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:33:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-32add6aa-3c37-4c49-8af7-72f19bf38a8a tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "e15ddee6-a642-4638-9534-21e640b3d017" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.743s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:33:21 user nova-compute[73497]: DEBUG nova.network.neutron [req-3834d32d-dd5a-4a9e-9a50-694ee8b78819 req-a9dd2bf6-726d-4618-b2d8-506b46d222a7 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Updated VIF entry in instance network info cache for port 8d982123-d2ef-4d00-95d1-bee24f228175. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:33:21 user nova-compute[73497]: DEBUG nova.network.neutron [req-3834d32d-dd5a-4a9e-9a50-694ee8b78819 req-a9dd2bf6-726d-4618-b2d8-506b46d222a7 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Updating instance_info_cache with network_info: [{"id": "8d982123-d2ef-4d00-95d1-bee24f228175", "address": "fa:16:3e:e8:ce:24", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d982123-d2", "ovs_interfaceid": "8d982123-d2ef-4d00-95d1-bee24f228175", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:33:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3834d32d-dd5a-4a9e-9a50-694ee8b78819 req-a9dd2bf6-726d-4618-b2d8-506b46d222a7 service nova] Releasing lock "refresh_cache-e15ddee6-a642-4638-9534-21e640b3d017" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:33:21 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693092786.1922553, b0e68638-bc72-4dd5-8399-7bf207b84b9e => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:33:21 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] VM Stopped (Lifecycle Event)
Aug 26 23:33:21 user nova-compute[73497]: DEBUG nova.compute.manager [None req-a63864e0-293d-414e-ae2c-ae6375983a83 None None] [instance: b0e68638-bc72-4dd5-8399-7bf207b84b9e] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:33:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:30 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:30 user nova-compute[73497]: DEBUG nova.objects.instance [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lazy-loading 'flavor' on Instance uuid f7c83073-fadc-4e41-a4a9-df0bbe11aa28 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:33:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "refresh_cache-f7c83073-fadc-4e41-a4a9-df0bbe11aa28" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:33:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquired lock "refresh_cache-f7c83073-fadc-4e41-a4a9-df0bbe11aa28" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:33:30 user nova-compute[73497]: DEBUG nova.network.neutron [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:33:30 user nova-compute[73497]: DEBUG nova.objects.instance [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lazy-loading 'info_cache' on Instance uuid f7c83073-fadc-4e41-a4a9-df0bbe11aa28 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:33:30 user nova-compute[73497]: DEBUG nova.objects.base [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Object Instance<f7c83073-fadc-4e41-a4a9-df0bbe11aa28> lazy-loaded attributes: flavor,info_cache {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG nova.network.neutron [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Updating instance_info_cache with network_info: [{"id": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "address": "fa:16:3e:cf:bd:9e", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74cddf0f-c3", "ovs_interfaceid": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Releasing lock "refresh_cache-f7c83073-fadc-4e41-a4a9-df0bbe11aa28" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:33:31 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Instance destroyed successfully.
Aug 26 23:33:31 user nova-compute[73497]: DEBUG nova.objects.instance [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lazy-loading 'resources' on Instance uuid f7c83073-fadc-4e41-a4a9-df0bbe11aa28 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG nova.objects.base [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Object Instance<f7c83073-fadc-4e41-a4a9-df0bbe11aa28> lazy-loaded attributes: flavor,info_cache,resources {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:25:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1284261730',display_name='tempest-AttachVolumeTestJSON-server-1284261730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1284261730',id=31,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtZgj4CGRRq60nfzAmpM6NX6cbyiNr74c5vhKfLzmguuh54ComCQsitet6gqTOyy+exSU8a+OQZBMej3fWkPoWF9yZ7g9PDakdqjlJxgeAQgaLAVOiZs3e4Hh+0HK9qHg==',key_name='tempest-keypair-1578893874',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:25:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e10f2d1336284b42a8dcbb05e509e9bd',ramdisk_id='',reservation_id='r-awwb3svr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1929388969',owner_user_name='tempest-AttachVolumeTestJSON-1929388969-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:31:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e2c1f8d06854e579ee634e33e6de920',uuid=f7c83073-fadc-4e41-a4a9-df0bbe11aa28,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "address": "fa:16:3e:cf:bd:9e", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74cddf0f-c3", "ovs_interfaceid": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Converting VIF {"id": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "address": "fa:16:3e:cf:bd:9e", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74cddf0f-c3", "ovs_interfaceid": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:bd:9e,bridge_name='br-int',has_traffic_filtering=True,id=74cddf0f-c302-4ae4-8142-cee5764c7c4f,network=Network(77d468df-32fe-45fb-afe7-7ebf9b6b428f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74cddf0f-c3') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG os_vif [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:bd:9e,bridge_name='br-int',has_traffic_filtering=True,id=74cddf0f-c302-4ae4-8142-cee5764c7c4f,network=Network(77d468df-32fe-45fb-afe7-7ebf9b6b428f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74cddf0f-c3') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74cddf0f-c3, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:31 user nova-compute[73497]: INFO os_vif [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:bd:9e,bridge_name='br-int',has_traffic_filtering=True,id=74cddf0f-c302-4ae4-8142-cee5764c7c4f,network=Network(77d468df-32fe-45fb-afe7-7ebf9b6b428f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74cddf0f-c3')
Aug 26 23:33:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Start _get_guest_xml network_info=[{"id": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "address": "fa:16:3e:cf:bd:9e", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74cddf0f-c3", "ovs_interfaceid": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG nova.objects.instance [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lazy-loading 'numa_topology' on Instance uuid f7c83073-fadc-4e41-a4a9-df0bbe11aa28 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG nova.objects.base [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Object Instance<f7c83073-fadc-4e41-a4a9-df0bbe11aa28> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:33:31 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:33:31 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:33:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG nova.objects.instance [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lazy-loading 'vcpu_model' on Instance uuid f7c83073-fadc-4e41-a4a9-df0bbe11aa28 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG nova.objects.base [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Object Instance<f7c83073-fadc-4e41-a4a9-df0bbe11aa28> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:25:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1284261730',display_name='tempest-AttachVolumeTestJSON-server-1284261730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1284261730',id=31,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtZgj4CGRRq60nfzAmpM6NX6cbyiNr74c5vhKfLzmguuh54ComCQsitet6gqTOyy+exSU8a+OQZBMej3fWkPoWF9yZ7g9PDakdqjlJxgeAQgaLAVOiZs3e4Hh+0HK9qHg==',key_name='tempest-keypair-1578893874',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:25:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e10f2d1336284b42a8dcbb05e509e9bd',ramdisk_id='',reservation_id='r-awwb3svr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1929388969',owner_user_name='tempest-AttachVolumeTestJSON-1929388969-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:31:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e2c1f8d06854e579ee634e33e6de920',uuid=f7c83073-fadc-4e41-a4a9-df0bbe11aa28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "address": "fa:16:3e:cf:bd:9e", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74cddf0f-c3", "ovs_interfaceid": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Converting VIF {"id": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "address": "fa:16:3e:cf:bd:9e", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74cddf0f-c3", "ovs_interfaceid": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:bd:9e,bridge_name='br-int',has_traffic_filtering=True,id=74cddf0f-c302-4ae4-8142-cee5764c7c4f,network=Network(77d468df-32fe-45fb-afe7-7ebf9b6b428f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74cddf0f-c3') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG nova.objects.instance [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lazy-loading 'pci_devices' on Instance uuid f7c83073-fadc-4e41-a4a9-df0bbe11aa28 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG nova.objects.base [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Object Instance<f7c83073-fadc-4e41-a4a9-df0bbe11aa28> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:33:31 user nova-compute[73497]:   <uuid>f7c83073-fadc-4e41-a4a9-df0bbe11aa28</uuid>
Aug 26 23:33:31 user nova-compute[73497]:   <name>instance-0000001f</name>
Aug 26 23:33:31 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:33:31 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:33:31 user nova-compute[73497]:   <metadata>
Aug 26 23:33:31 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:33:31 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:33:31 user nova-compute[73497]:       <nova:name>tempest-AttachVolumeTestJSON-server-1284261730</nova:name>
Aug 26 23:33:31 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:33:31</nova:creationTime>
Aug 26 23:33:31 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:33:31 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:33:31 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:33:31 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:33:31 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:33:31 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:33:31 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:33:31 user nova-compute[73497]:       <nova:owner>
Aug 26 23:33:31 user nova-compute[73497]:         <nova:user uuid="6e2c1f8d06854e579ee634e33e6de920">tempest-AttachVolumeTestJSON-1929388969-project-member</nova:user>
Aug 26 23:33:31 user nova-compute[73497]:         <nova:project uuid="e10f2d1336284b42a8dcbb05e509e9bd">tempest-AttachVolumeTestJSON-1929388969</nova:project>
Aug 26 23:33:31 user nova-compute[73497]:       </nova:owner>
Aug 26 23:33:31 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:33:31 user nova-compute[73497]:       <nova:ports>
Aug 26 23:33:31 user nova-compute[73497]:         <nova:port uuid="74cddf0f-c302-4ae4-8142-cee5764c7c4f">
Aug 26 23:33:31 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 23:33:31 user nova-compute[73497]:         </nova:port>
Aug 26 23:33:31 user nova-compute[73497]:       </nova:ports>
Aug 26 23:33:31 user nova-compute[73497]:     </nova:instance>
Aug 26 23:33:31 user nova-compute[73497]:   </metadata>
Aug 26 23:33:31 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:33:31 user nova-compute[73497]:     <system>
Aug 26 23:33:31 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:33:31 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:33:31 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:33:31 user nova-compute[73497]:       <entry name="serial">f7c83073-fadc-4e41-a4a9-df0bbe11aa28</entry>
Aug 26 23:33:31 user nova-compute[73497]:       <entry name="uuid">f7c83073-fadc-4e41-a4a9-df0bbe11aa28</entry>
Aug 26 23:33:31 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:33:31 user nova-compute[73497]:     </system>
Aug 26 23:33:31 user nova-compute[73497]:   </sysinfo>
Aug 26 23:33:31 user nova-compute[73497]:   <os>
Aug 26 23:33:31 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:33:31 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:33:31 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:33:31 user nova-compute[73497]:   </os>
Aug 26 23:33:31 user nova-compute[73497]:   <features>
Aug 26 23:33:31 user nova-compute[73497]:     <acpi/>
Aug 26 23:33:31 user nova-compute[73497]:     <apic/>
Aug 26 23:33:31 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:33:31 user nova-compute[73497]:   </features>
Aug 26 23:33:31 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:33:31 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:33:31 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:33:31 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:33:31 user nova-compute[73497]:   </clock>
Aug 26 23:33:31 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:33:31 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:33:31 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:33:31 user nova-compute[73497]:   </cpu>
Aug 26 23:33:31 user nova-compute[73497]:   <devices>
Aug 26 23:33:31 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:33:31 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:33:31 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk"/>
Aug 26 23:33:31 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:33:31 user nova-compute[73497]:     </disk>
Aug 26 23:33:31 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:33:31 user nova-compute[73497]:       <mac address="fa:16:3e:cf:bd:9e"/>
Aug 26 23:33:31 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:33:31 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:33:31 user nova-compute[73497]:       <target dev="tap74cddf0f-c3"/>
Aug 26 23:33:31 user nova-compute[73497]:     </interface>
Aug 26 23:33:31 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:33:31 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/console.log" append="off"/>
Aug 26 23:33:31 user nova-compute[73497]:     </serial>
Aug 26 23:33:31 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:33:31 user nova-compute[73497]:     <video>
Aug 26 23:33:31 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:33:31 user nova-compute[73497]:     </video>
Aug 26 23:33:31 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:33:31 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:33:31 user nova-compute[73497]:     </rng>
Aug 26 23:33:31 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:33:31 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:33:31 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:33:31 user nova-compute[73497]:     </memballoon>
Aug 26 23:33:31 user nova-compute[73497]:   </devices>
Aug 26 23:33:31 user nova-compute[73497]: </domain>
Aug 26 23:33:31 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:33:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:33:32 user nova-compute[73497]: DEBUG nova.objects.instance [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lazy-loading 'trusted_certs' on Instance uuid f7c83073-fadc-4e41-a4a9-df0bbe11aa28 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:33:32 user nova-compute[73497]: DEBUG nova.objects.base [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Object Instance<f7c83073-fadc-4e41-a4a9-df0bbe11aa28> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:33:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:33:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.201s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:33:32 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:33:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:33:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:33:32 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Cannot resize image /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:33:32 user nova-compute[73497]: DEBUG nova.objects.instance [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lazy-loading 'migration_context' on Instance uuid f7c83073-fadc-4e41-a4a9-df0bbe11aa28 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:33:32 user nova-compute[73497]: DEBUG nova.objects.base [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Object Instance<f7c83073-fadc-4e41-a4a9-df0bbe11aa28> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:33:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:25:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1284261730',display_name='tempest-AttachVolumeTestJSON-server-1284261730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1284261730',id=31,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtZgj4CGRRq60nfzAmpM6NX6cbyiNr74c5vhKfLzmguuh54ComCQsitet6gqTOyy+exSU8a+OQZBMej3fWkPoWF9yZ7g9PDakdqjlJxgeAQgaLAVOiZs3e4Hh+0HK9qHg==',key_name='tempest-keypair-1578893874',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:25:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='e10f2d1336284b42a8dcbb05e509e9bd',ramdisk_id='',reservation_id='r-awwb3svr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1929388969',owner_user_name='tempest-AttachVolumeTestJSON-1929388969-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:31:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e2c1f8d06854e579ee634e33e6de920',uuid=f7c83073-fadc-4e41-a4a9-df0bbe11aa28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "address": "fa:16:3e:cf:bd:9e", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74cddf0f-c3", "ovs_interfaceid": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:33:32 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Converting VIF {"id": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "address": "fa:16:3e:cf:bd:9e", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74cddf0f-c3", "ovs_interfaceid": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:33:32 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:bd:9e,bridge_name='br-int',has_traffic_filtering=True,id=74cddf0f-c302-4ae4-8142-cee5764c7c4f,network=Network(77d468df-32fe-45fb-afe7-7ebf9b6b428f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74cddf0f-c3') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:33:32 user nova-compute[73497]: DEBUG os_vif [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:bd:9e,bridge_name='br-int',has_traffic_filtering=True,id=74cddf0f-c302-4ae4-8142-cee5764c7c4f,network=Network(77d468df-32fe-45fb-afe7-7ebf9b6b428f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74cddf0f-c3') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:33:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:33:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:33:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74cddf0f-c3, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:33:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap74cddf0f-c3, col_values=(('external_ids', {'iface-id': '74cddf0f-c302-4ae4-8142-cee5764c7c4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:bd:9e', 'vm-uuid': 'f7c83073-fadc-4e41-a4a9-df0bbe11aa28'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:33:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:33:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:32 user nova-compute[73497]: INFO os_vif [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:bd:9e,bridge_name='br-int',has_traffic_filtering=True,id=74cddf0f-c302-4ae4-8142-cee5764c7c4f,network=Network(77d468df-32fe-45fb-afe7-7ebf9b6b428f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74cddf0f-c3')
Aug 26 23:33:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:34 user nova-compute[73497]: DEBUG nova.compute.manager [req-f775cc56-312e-40f8-ba42-0dbe5eeda896 req-165777aa-4274-473d-aba7-6fa55c8ca6bc service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Received event network-vif-plugged-74cddf0f-c302-4ae4-8142-cee5764c7c4f {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:33:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f775cc56-312e-40f8-ba42-0dbe5eeda896 req-165777aa-4274-473d-aba7-6fa55c8ca6bc service nova] Acquiring lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:33:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f775cc56-312e-40f8-ba42-0dbe5eeda896 req-165777aa-4274-473d-aba7-6fa55c8ca6bc service nova] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:33:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f775cc56-312e-40f8-ba42-0dbe5eeda896 req-165777aa-4274-473d-aba7-6fa55c8ca6bc service nova] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:33:34 user nova-compute[73497]: DEBUG nova.compute.manager [req-f775cc56-312e-40f8-ba42-0dbe5eeda896 req-165777aa-4274-473d-aba7-6fa55c8ca6bc service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] No waiting events found dispatching network-vif-plugged-74cddf0f-c302-4ae4-8142-cee5764c7c4f {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:33:34 user nova-compute[73497]: WARNING nova.compute.manager [req-f775cc56-312e-40f8-ba42-0dbe5eeda896 req-165777aa-4274-473d-aba7-6fa55c8ca6bc service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Received unexpected event network-vif-plugged-74cddf0f-c302-4ae4-8142-cee5764c7c4f for instance with vm_state stopped and task_state powering-on.
Aug 26 23:33:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "db489468-154b-4238-8b81-f8fa2bc016b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:33:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "db489468-154b-4238-8b81-f8fa2bc016b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:33:34 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:33:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:33:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:33:34 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:33:34 user nova-compute[73497]: INFO nova.compute.claims [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Claim successful on node user
Aug 26 23:33:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:34 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:33:34 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:33:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.346s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:33:34 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:33:34 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:33:34 user nova-compute[73497]: DEBUG nova.network.neutron [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:33:34 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:33:34 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:33:35 user nova-compute[73497]: DEBUG nova.policy [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7d0fa85485fe42fc8a3b884f71db5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f777a90b660e48cdb1f5a453fbe2f806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:33:35 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:33:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:33:35 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Creating image(s)
Aug 26 23:33:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "/opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:33:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "/opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:33:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "/opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:33:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:33:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.200s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:33:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:33:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:33:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:33:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.218s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:33:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:33:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/disk 1073741824" returned: 0 in 0.067s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:33:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:33:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:33:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.250s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:33:35 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Checking if we can resize image /opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:33:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:33:35 user nova-compute[73497]: DEBUG nova.network.neutron [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Successfully created port: fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:33:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:33:36 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Cannot resize image /opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:33:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:33:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Ensure instance console log exists: /opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:33:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:33:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:33:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:33:36 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092816.2267802, f7c83073-fadc-4e41-a4a9-df0bbe11aa28 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:33:36 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] VM Resumed (Lifecycle Event)
Aug 26 23:33:36 user nova-compute[73497]: DEBUG nova.compute.manager [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:33:36 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Instance rebooted successfully.
Aug 26 23:33:36 user nova-compute[73497]: DEBUG nova.compute.manager [None req-8779598e-b844-42aa-9d0b-44f7b37a835f tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:33:36 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:33:36 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:33:36 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 26 23:33:36 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092816.22788, f7c83073-fadc-4e41-a4a9-df0bbe11aa28 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:33:36 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] VM Started (Lifecycle Event)
Aug 26 23:33:36 user nova-compute[73497]: DEBUG nova.compute.manager [req-659362a3-513d-440b-8199-86bb67e2c3a4 req-da0ab6ac-c93b-4731-9ef0-cece0f1241de service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Received event network-vif-plugged-74cddf0f-c302-4ae4-8142-cee5764c7c4f {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:33:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-659362a3-513d-440b-8199-86bb67e2c3a4 req-da0ab6ac-c93b-4731-9ef0-cece0f1241de service nova] Acquiring lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:33:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-659362a3-513d-440b-8199-86bb67e2c3a4 req-da0ab6ac-c93b-4731-9ef0-cece0f1241de service nova] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:33:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-659362a3-513d-440b-8199-86bb67e2c3a4 req-da0ab6ac-c93b-4731-9ef0-cece0f1241de service nova] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:33:36 user nova-compute[73497]: DEBUG nova.compute.manager [req-659362a3-513d-440b-8199-86bb67e2c3a4 req-da0ab6ac-c93b-4731-9ef0-cece0f1241de service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] No waiting events found dispatching network-vif-plugged-74cddf0f-c302-4ae4-8142-cee5764c7c4f {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:33:36 user nova-compute[73497]: WARNING nova.compute.manager [req-659362a3-513d-440b-8199-86bb67e2c3a4 req-da0ab6ac-c93b-4731-9ef0-cece0f1241de service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Received unexpected event network-vif-plugged-74cddf0f-c302-4ae4-8142-cee5764c7c4f for instance with vm_state stopped and task_state powering-on.
Aug 26 23:33:36 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:33:36 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:33:36 user nova-compute[73497]: DEBUG nova.network.neutron [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Successfully updated port: fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:33:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "refresh_cache-db489468-154b-4238-8b81-f8fa2bc016b7" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:33:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquired lock "refresh_cache-db489468-154b-4238-8b81-f8fa2bc016b7" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:33:36 user nova-compute[73497]: DEBUG nova.network.neutron [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:33:36 user nova-compute[73497]: DEBUG nova.compute.manager [req-58aec5e7-c7c4-4165-be23-abc94cab4394 req-b00f9b98-a082-4bcd-a04f-ba27e453fb7a service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Received event network-changed-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:33:36 user nova-compute[73497]: DEBUG nova.compute.manager [req-58aec5e7-c7c4-4165-be23-abc94cab4394 req-b00f9b98-a082-4bcd-a04f-ba27e453fb7a service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Refreshing instance network info cache due to event network-changed-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:33:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-58aec5e7-c7c4-4165-be23-abc94cab4394 req-b00f9b98-a082-4bcd-a04f-ba27e453fb7a service nova] Acquiring lock "refresh_cache-db489468-154b-4238-8b81-f8fa2bc016b7" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:33:36 user nova-compute[73497]: DEBUG nova.network.neutron [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG nova.network.neutron [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Updating instance_info_cache with network_info: [{"id": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "address": "fa:16:3e:ad:7f:ad", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc782cdf-fe", "ovs_interfaceid": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Releasing lock "refresh_cache-db489468-154b-4238-8b81-f8fa2bc016b7" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Instance network_info: |[{"id": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "address": "fa:16:3e:ad:7f:ad", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc782cdf-fe", "ovs_interfaceid": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-58aec5e7-c7c4-4165-be23-abc94cab4394 req-b00f9b98-a082-4bcd-a04f-ba27e453fb7a service nova] Acquired lock "refresh_cache-db489468-154b-4238-8b81-f8fa2bc016b7" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG nova.network.neutron [req-58aec5e7-c7c4-4165-be23-abc94cab4394 req-b00f9b98-a082-4bcd-a04f-ba27e453fb7a service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Refreshing network info cache for port fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Start _get_guest_xml network_info=[{"id": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "address": "fa:16:3e:ad:7f:ad", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc782cdf-fe", "ovs_interfaceid": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:33:37 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:33:37 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:33:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:33:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1477188239',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1477188239',id=38,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+zEsK4nQOioc9Qi0jnFjzykCg6/wtaz/sC0lOshmN9CO3QLXyXzCiB5KfNY2kjTWjUnRt570zcgoTQZLHEtWlYsJLi3kOwtzDS+5T0Z6DQJ/tppWJ0iSc7illPDBtpJQ==',key_name='tempest-keypair-1630262803',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f777a90b660e48cdb1f5a453fbe2f806',ramdisk_id='',reservation_id='r-f3c038xw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-389793905',owner_user_name='tempest-AttachVolumeShelveTestJSON-389793905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:33:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d0fa85485fe42fc8a3b884f71db5669',uuid=db489468-154b-4238-8b81-f8fa2bc016b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "address": "fa:16:3e:ad:7f:ad", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc782cdf-fe", "ovs_interfaceid": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Converting VIF {"id": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "address": "fa:16:3e:ad:7f:ad", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc782cdf-fe", "ovs_interfaceid": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:7f:ad,bridge_name='br-int',has_traffic_filtering=True,id=fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5,network=Network(39b40d3c-dae0-4dcf-a0de-b77899879f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc782cdf-fe') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG nova.objects.instance [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lazy-loading 'pci_devices' on Instance uuid db489468-154b-4238-8b81-f8fa2bc016b7 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:33:37 user nova-compute[73497]:   <uuid>db489468-154b-4238-8b81-f8fa2bc016b7</uuid>
Aug 26 23:33:37 user nova-compute[73497]:   <name>instance-00000026</name>
Aug 26 23:33:37 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:33:37 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:33:37 user nova-compute[73497]:   <metadata>
Aug 26 23:33:37 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:33:37 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:33:37 user nova-compute[73497]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1477188239</nova:name>
Aug 26 23:33:37 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:33:37</nova:creationTime>
Aug 26 23:33:37 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:33:37 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:33:37 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:33:37 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:33:37 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:33:37 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:33:37 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:33:37 user nova-compute[73497]:       <nova:owner>
Aug 26 23:33:37 user nova-compute[73497]:         <nova:user uuid="7d0fa85485fe42fc8a3b884f71db5669">tempest-AttachVolumeShelveTestJSON-389793905-project-member</nova:user>
Aug 26 23:33:37 user nova-compute[73497]:         <nova:project uuid="f777a90b660e48cdb1f5a453fbe2f806">tempest-AttachVolumeShelveTestJSON-389793905</nova:project>
Aug 26 23:33:37 user nova-compute[73497]:       </nova:owner>
Aug 26 23:33:37 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:33:37 user nova-compute[73497]:       <nova:ports>
Aug 26 23:33:37 user nova-compute[73497]:         <nova:port uuid="fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5">
Aug 26 23:33:37 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 23:33:37 user nova-compute[73497]:         </nova:port>
Aug 26 23:33:37 user nova-compute[73497]:       </nova:ports>
Aug 26 23:33:37 user nova-compute[73497]:     </nova:instance>
Aug 26 23:33:37 user nova-compute[73497]:   </metadata>
Aug 26 23:33:37 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:33:37 user nova-compute[73497]:     <system>
Aug 26 23:33:37 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:33:37 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:33:37 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:33:37 user nova-compute[73497]:       <entry name="serial">db489468-154b-4238-8b81-f8fa2bc016b7</entry>
Aug 26 23:33:37 user nova-compute[73497]:       <entry name="uuid">db489468-154b-4238-8b81-f8fa2bc016b7</entry>
Aug 26 23:33:37 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:33:37 user nova-compute[73497]:     </system>
Aug 26 23:33:37 user nova-compute[73497]:   </sysinfo>
Aug 26 23:33:37 user nova-compute[73497]:   <os>
Aug 26 23:33:37 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:33:37 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:33:37 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:33:37 user nova-compute[73497]:   </os>
Aug 26 23:33:37 user nova-compute[73497]:   <features>
Aug 26 23:33:37 user nova-compute[73497]:     <acpi/>
Aug 26 23:33:37 user nova-compute[73497]:     <apic/>
Aug 26 23:33:37 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:33:37 user nova-compute[73497]:   </features>
Aug 26 23:33:37 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:33:37 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:33:37 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:33:37 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:33:37 user nova-compute[73497]:   </clock>
Aug 26 23:33:37 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:33:37 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:33:37 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:33:37 user nova-compute[73497]:   </cpu>
Aug 26 23:33:37 user nova-compute[73497]:   <devices>
Aug 26 23:33:37 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:33:37 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:33:37 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/disk"/>
Aug 26 23:33:37 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:33:37 user nova-compute[73497]:     </disk>
Aug 26 23:33:37 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:33:37 user nova-compute[73497]:       <mac address="fa:16:3e:ad:7f:ad"/>
Aug 26 23:33:37 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:33:37 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:33:37 user nova-compute[73497]:       <target dev="tapfc782cdf-fe"/>
Aug 26 23:33:37 user nova-compute[73497]:     </interface>
Aug 26 23:33:37 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:33:37 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/console.log" append="off"/>
Aug 26 23:33:37 user nova-compute[73497]:     </serial>
Aug 26 23:33:37 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:33:37 user nova-compute[73497]:     <video>
Aug 26 23:33:37 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:33:37 user nova-compute[73497]:     </video>
Aug 26 23:33:37 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:33:37 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:33:37 user nova-compute[73497]:     </rng>
Aug 26 23:33:37 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:33:37 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:33:37 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:33:37 user nova-compute[73497]:     </memballoon>
Aug 26 23:33:37 user nova-compute[73497]:   </devices>
Aug 26 23:33:37 user nova-compute[73497]: </domain>
Aug 26 23:33:37 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:33:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1477188239',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1477188239',id=38,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+zEsK4nQOioc9Qi0jnFjzykCg6/wtaz/sC0lOshmN9CO3QLXyXzCiB5KfNY2kjTWjUnRt570zcgoTQZLHEtWlYsJLi3kOwtzDS+5T0Z6DQJ/tppWJ0iSc7illPDBtpJQ==',key_name='tempest-keypair-1630262803',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f777a90b660e48cdb1f5a453fbe2f806',ramdisk_id='',reservation_id='r-f3c038xw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-389793905',owner_user_name='tempest-AttachVolumeShelveTestJSON-389793905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:33:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d0fa85485fe42fc8a3b884f71db5669',uuid=db489468-154b-4238-8b81-f8fa2bc016b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "address": "fa:16:3e:ad:7f:ad", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc782cdf-fe", "ovs_interfaceid": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Converting VIF {"id": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "address": "fa:16:3e:ad:7f:ad", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc782cdf-fe", "ovs_interfaceid": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:7f:ad,bridge_name='br-int',has_traffic_filtering=True,id=fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5,network=Network(39b40d3c-dae0-4dcf-a0de-b77899879f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc782cdf-fe') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG os_vif [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:7f:ad,bridge_name='br-int',has_traffic_filtering=True,id=fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5,network=Network(39b40d3c-dae0-4dcf-a0de-b77899879f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc782cdf-fe') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc782cdf-fe, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfc782cdf-fe, col_values=(('external_ids', {'iface-id': 'fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:7f:ad', 'vm-uuid': 'db489468-154b-4238-8b81-f8fa2bc016b7'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:37 user nova-compute[73497]: INFO os_vif [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:7f:ad,bridge_name='br-int',has_traffic_filtering=True,id=fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5,network=Network(39b40d3c-dae0-4dcf-a0de-b77899879f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc782cdf-fe')
Aug 26 23:33:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:33:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] No VIF found with MAC fa:16:3e:ad:7f:ad, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:33:38 user nova-compute[73497]: DEBUG nova.network.neutron [req-58aec5e7-c7c4-4165-be23-abc94cab4394 req-b00f9b98-a082-4bcd-a04f-ba27e453fb7a service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Updated VIF entry in instance network info cache for port fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:33:38 user nova-compute[73497]: DEBUG nova.network.neutron [req-58aec5e7-c7c4-4165-be23-abc94cab4394 req-b00f9b98-a082-4bcd-a04f-ba27e453fb7a service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Updating instance_info_cache with network_info: [{"id": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "address": "fa:16:3e:ad:7f:ad", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc782cdf-fe", "ovs_interfaceid": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:33:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-58aec5e7-c7c4-4165-be23-abc94cab4394 req-b00f9b98-a082-4bcd-a04f-ba27e453fb7a service nova] Releasing lock "refresh_cache-db489468-154b-4238-8b81-f8fa2bc016b7" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:33:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:39 user nova-compute[73497]: DEBUG nova.compute.manager [req-bd4cbef6-5791-4110-8c17-d56dc5d260a3 req-045ea4d8-e081-4ad0-9c33-3616a54314d6 service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Received event network-vif-plugged-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:33:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-bd4cbef6-5791-4110-8c17-d56dc5d260a3 req-045ea4d8-e081-4ad0-9c33-3616a54314d6 service nova] Acquiring lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:33:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-bd4cbef6-5791-4110-8c17-d56dc5d260a3 req-045ea4d8-e081-4ad0-9c33-3616a54314d6 service nova] Lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:33:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-bd4cbef6-5791-4110-8c17-d56dc5d260a3 req-045ea4d8-e081-4ad0-9c33-3616a54314d6 service nova] Lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:33:39 user nova-compute[73497]: DEBUG nova.compute.manager [req-bd4cbef6-5791-4110-8c17-d56dc5d260a3 req-045ea4d8-e081-4ad0-9c33-3616a54314d6 service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] No waiting events found dispatching network-vif-plugged-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:33:39 user nova-compute[73497]: WARNING nova.compute.manager [req-bd4cbef6-5791-4110-8c17-d56dc5d260a3 req-045ea4d8-e081-4ad0-9c33-3616a54314d6 service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Received unexpected event network-vif-plugged-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 for instance with vm_state building and task_state spawning.
Aug 26 23:33:40 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:40 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:40 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:41 user nova-compute[73497]: DEBUG nova.compute.manager [req-f30ca7f7-1542-4193-9996-43b97c7d84fb req-e075e102-d663-456f-a0e1-8c07f7a56f3c service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Received event network-vif-plugged-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:33:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f30ca7f7-1542-4193-9996-43b97c7d84fb req-e075e102-d663-456f-a0e1-8c07f7a56f3c service nova] Acquiring lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:33:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f30ca7f7-1542-4193-9996-43b97c7d84fb req-e075e102-d663-456f-a0e1-8c07f7a56f3c service nova] Lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:33:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f30ca7f7-1542-4193-9996-43b97c7d84fb req-e075e102-d663-456f-a0e1-8c07f7a56f3c service nova] Lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:33:41 user nova-compute[73497]: DEBUG nova.compute.manager [req-f30ca7f7-1542-4193-9996-43b97c7d84fb req-e075e102-d663-456f-a0e1-8c07f7a56f3c service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] No waiting events found dispatching network-vif-plugged-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:33:41 user nova-compute[73497]: WARNING nova.compute.manager [req-f30ca7f7-1542-4193-9996-43b97c7d84fb req-e075e102-d663-456f-a0e1-8c07f7a56f3c service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Received unexpected event network-vif-plugged-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 for instance with vm_state building and task_state spawning.
Aug 26 23:33:41 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092821.6133738, db489468-154b-4238-8b81-f8fa2bc016b7 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:33:41 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] VM Resumed (Lifecycle Event)
Aug 26 23:33:41 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:33:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:33:41 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Instance spawned successfully.
Aug 26 23:33:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:33:41 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:33:41 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:33:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:33:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:33:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:33:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:33:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:33:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:33:41 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:33:41 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092821.6180055, db489468-154b-4238-8b81-f8fa2bc016b7 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:33:41 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] VM Started (Lifecycle Event)
Aug 26 23:33:41 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:33:41 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:33:41 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:33:41 user nova-compute[73497]: INFO nova.compute.manager [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Took 6.66 seconds to spawn the instance on the hypervisor.
Aug 26 23:33:41 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:33:41 user nova-compute[73497]: INFO nova.compute.manager [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Took 7.39 seconds to build instance.
Aug 26 23:33:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c5c37a62-8e78-4df2-9a23-cea991e69b15 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "db489468-154b-4238-8b81-f8fa2bc016b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.514s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:33:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d1aad6ba-f641-4978-b7e3-aa61cbb2af26 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:33:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d1aad6ba-f641-4978-b7e3-aa61cbb2af26 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:33:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d1aad6ba-f641-4978-b7e3-aa61cbb2af26 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:33:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d1aad6ba-f641-4978-b7e3-aa61cbb2af26 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:33:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d1aad6ba-f641-4978-b7e3-aa61cbb2af26 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:33:54 user nova-compute[73497]: INFO nova.compute.manager [None req-d1aad6ba-f641-4978-b7e3-aa61cbb2af26 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Terminating instance
Aug 26 23:33:54 user nova-compute[73497]: DEBUG nova.compute.manager [None req-d1aad6ba-f641-4978-b7e3-aa61cbb2af26 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:33:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:54 user nova-compute[73497]: DEBUG nova.compute.manager [req-c183a5a5-22a6-46bb-a9ac-e6af9973d400 req-5c95c25a-a1a6-4a55-8348-61dc516fcdc5 service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Received event network-vif-unplugged-9993c7ac-e4a2-41c8-97d9-75c681d68a6a {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:33:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c183a5a5-22a6-46bb-a9ac-e6af9973d400 req-5c95c25a-a1a6-4a55-8348-61dc516fcdc5 service nova] Acquiring lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:33:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c183a5a5-22a6-46bb-a9ac-e6af9973d400 req-5c95c25a-a1a6-4a55-8348-61dc516fcdc5 service nova] Lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:33:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c183a5a5-22a6-46bb-a9ac-e6af9973d400 req-5c95c25a-a1a6-4a55-8348-61dc516fcdc5 service nova] Lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:33:54 user nova-compute[73497]: DEBUG nova.compute.manager [req-c183a5a5-22a6-46bb-a9ac-e6af9973d400 req-5c95c25a-a1a6-4a55-8348-61dc516fcdc5 service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] No waiting events found dispatching network-vif-unplugged-9993c7ac-e4a2-41c8-97d9-75c681d68a6a {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:33:54 user nova-compute[73497]: DEBUG nova.compute.manager [req-c183a5a5-22a6-46bb-a9ac-e6af9973d400 req-5c95c25a-a1a6-4a55-8348-61dc516fcdc5 service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Received event network-vif-unplugged-9993c7ac-e4a2-41c8-97d9-75c681d68a6a for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:33:55 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Instance destroyed successfully.
Aug 26 23:33:55 user nova-compute[73497]: DEBUG nova.objects.instance [None req-d1aad6ba-f641-4978-b7e3-aa61cbb2af26 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lazy-loading 'resources' on Instance uuid b7506745-ace5-45e2-bc1d-883f2c51f1c4 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:33:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-d1aad6ba-f641-4978-b7e3-aa61cbb2af26 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:28:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1357907004',display_name='tempest-TestMinimumBasicScenario-server-1357907004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1357907004',id=34,image_ref='4953616c-6ab8-44e7-9644-490160ff0ba9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHawhLjVpHObEM1sejmZUdYQSEnONqYB9L2Qv/axMeT5kKxPx9/QuS/i5jErqR53WVLlmHVIBUw7Z4Scv0xP68Y1o8+EymV6cmPgQpjbZL+arFhxVBB0cTzGv9OLKbkK5Q==',key_name='tempest-TestMinimumBasicScenario-1395022215',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:28:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ae441ca35d847e89eb99397fe167960',ramdisk_id='',reservation_id='r-qslnut47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4953616c-6ab8-44e7-9644-490160ff0ba9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1836970755',owner_user_name='tempest-TestMinimumBasicScenario-1836970755-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:31:10Z,user_data=None,user_id='948c44e55c7c404fb660394a747cf162',uuid=b7506745-ace5-45e2-bc1d-883f2c51f1c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "address": "fa:16:3e:7e:a1:4c", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9993c7ac-e4", "ovs_interfaceid": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:33:55 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-d1aad6ba-f641-4978-b7e3-aa61cbb2af26 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Converting VIF {"id": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "address": "fa:16:3e:7e:a1:4c", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9993c7ac-e4", "ovs_interfaceid": "9993c7ac-e4a2-41c8-97d9-75c681d68a6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:33:55 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-d1aad6ba-f641-4978-b7e3-aa61cbb2af26 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:a1:4c,bridge_name='br-int',has_traffic_filtering=True,id=9993c7ac-e4a2-41c8-97d9-75c681d68a6a,network=Network(f11c42be-cba6-4e59-80b1-6fdd90a41c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9993c7ac-e4') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:33:55 user nova-compute[73497]: DEBUG os_vif [None req-d1aad6ba-f641-4978-b7e3-aa61cbb2af26 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:a1:4c,bridge_name='br-int',has_traffic_filtering=True,id=9993c7ac-e4a2-41c8-97d9-75c681d68a6a,network=Network(f11c42be-cba6-4e59-80b1-6fdd90a41c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9993c7ac-e4') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:33:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9993c7ac-e4, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:33:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:33:55 user nova-compute[73497]: INFO os_vif [None req-d1aad6ba-f641-4978-b7e3-aa61cbb2af26 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:a1:4c,bridge_name='br-int',has_traffic_filtering=True,id=9993c7ac-e4a2-41c8-97d9-75c681d68a6a,network=Network(f11c42be-cba6-4e59-80b1-6fdd90a41c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9993c7ac-e4')
Aug 26 23:33:55 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-d1aad6ba-f641-4978-b7e3-aa61cbb2af26 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Deleting instance files /opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4_del
Aug 26 23:33:55 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-d1aad6ba-f641-4978-b7e3-aa61cbb2af26 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Deletion of /opt/stack/data/nova/instances/b7506745-ace5-45e2-bc1d-883f2c51f1c4_del complete
Aug 26 23:33:55 user nova-compute[73497]: INFO nova.compute.manager [None req-d1aad6ba-f641-4978-b7e3-aa61cbb2af26 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 26 23:33:55 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-d1aad6ba-f641-4978-b7e3-aa61cbb2af26 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:33:55 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:33:55 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:33:55 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:33:55 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Took 0.63 seconds to deallocate network for instance.
Aug 26 23:33:55 user nova-compute[73497]: DEBUG nova.compute.manager [req-418cab1f-73e7-486f-9641-12d2e737e282 req-27212862-d876-4cd6-aff5-fc7eefe652f5 service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Received event network-vif-deleted-9993c7ac-e4a2-41c8-97d9-75c681d68a6a {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:33:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d1aad6ba-f641-4978-b7e3-aa61cbb2af26 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:33:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d1aad6ba-f641-4978-b7e3-aa61cbb2af26 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:33:56 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-d1aad6ba-f641-4978-b7e3-aa61cbb2af26 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:33:56 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-d1aad6ba-f641-4978-b7e3-aa61cbb2af26 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:33:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d1aad6ba-f641-4978-b7e3-aa61cbb2af26 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:33:56 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-d1aad6ba-f641-4978-b7e3-aa61cbb2af26 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Deleted allocations for instance b7506745-ace5-45e2-bc1d-883f2c51f1c4
Aug 26 23:33:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d1aad6ba-f641-4978-b7e3-aa61cbb2af26 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.150s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:33:56 user nova-compute[73497]: DEBUG nova.compute.manager [req-3570fde0-56d2-4ea1-a321-8db987f2073d req-c125738c-0744-42b7-afb4-390755c0e069 service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Received event network-vif-plugged-9993c7ac-e4a2-41c8-97d9-75c681d68a6a {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:33:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3570fde0-56d2-4ea1-a321-8db987f2073d req-c125738c-0744-42b7-afb4-390755c0e069 service nova] Acquiring lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:33:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3570fde0-56d2-4ea1-a321-8db987f2073d req-c125738c-0744-42b7-afb4-390755c0e069 service nova] Lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:33:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3570fde0-56d2-4ea1-a321-8db987f2073d req-c125738c-0744-42b7-afb4-390755c0e069 service nova] Lock "b7506745-ace5-45e2-bc1d-883f2c51f1c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:33:56 user nova-compute[73497]: DEBUG nova.compute.manager [req-3570fde0-56d2-4ea1-a321-8db987f2073d req-c125738c-0744-42b7-afb4-390755c0e069 service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] No waiting events found dispatching network-vif-plugged-9993c7ac-e4a2-41c8-97d9-75c681d68a6a {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:33:56 user nova-compute[73497]: WARNING nova.compute.manager [req-3570fde0-56d2-4ea1-a321-8db987f2073d req-c125738c-0744-42b7-afb4-390755c0e069 service nova] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Received unexpected event network-vif-plugged-9993c7ac-e4a2-41c8-97d9-75c681d68a6a for instance with vm_state deleted and task_state None.
Aug 26 23:33:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:33:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Acquiring lock "2b2d2380-d861-46c4-b13c-36b4f48cca77" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:33:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "2b2d2380-d861-46c4-b13c-36b4f48cca77" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:33:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:33:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:33:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:33:57 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:33:57 user nova-compute[73497]: INFO nova.compute.claims [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Claim successful on node user
Aug 26 23:33:58 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:33:58 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:33:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.559s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:33:58 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:33:58 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:33:58 user nova-compute[73497]: DEBUG nova.network.neutron [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:33:58 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:33:58 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:33:58 user nova-compute[73497]: DEBUG nova.policy [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec43dd42316042a4895706726866b103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '077c6c937fcc4d8d95eb66d8d7f87167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:33:58 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:33:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:33:58 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Creating image(s)
Aug 26 23:33:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Acquiring lock "/opt/stack/data/nova/instances/2b2d2380-d861-46c4-b13c-36b4f48cca77/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:33:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "/opt/stack/data/nova/instances/2b2d2380-d861-46c4-b13c-36b4f48cca77/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:33:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "/opt/stack/data/nova/instances/2b2d2380-d861-46c4-b13c-36b4f48cca77/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:33:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:33:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.197s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:33:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:33:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:33:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:33:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.181s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:33:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/2b2d2380-d861-46c4-b13c-36b4f48cca77/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:33:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/2b2d2380-d861-46c4-b13c-36b4f48cca77/disk 1073741824" returned: 0 in 0.049s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:33:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:33:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:33:59 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:33:59 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:33:59 user nova-compute[73497]: DEBUG nova.network.neutron [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Successfully created port: ac9386e4-01a7-4ccf-abf1-814e9f349fcf {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:33:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.191s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:33:59 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2b2d2380-d861-46c4-b13c-36b4f48cca77/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:33:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2d2380-d861-46c4-b13c-36b4f48cca77/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:33:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2d2380-d861-46c4-b13c-36b4f48cca77/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:33:59 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Cannot resize image /opt/stack/data/nova/instances/2b2d2380-d861-46c4-b13c-36b4f48cca77/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:33:59 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:33:59 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Ensure instance console log exists: /opt/stack/data/nova/instances/2b2d2380-d861-46c4-b13c-36b4f48cca77/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:33:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:33:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:33:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:33:59 user nova-compute[73497]: DEBUG nova.network.neutron [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Successfully updated port: ac9386e4-01a7-4ccf-abf1-814e9f349fcf {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:33:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Acquiring lock "refresh_cache-2b2d2380-d861-46c4-b13c-36b4f48cca77" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:33:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Acquired lock "refresh_cache-2b2d2380-d861-46c4-b13c-36b4f48cca77" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:33:59 user nova-compute[73497]: DEBUG nova.network.neutron [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:33:59 user nova-compute[73497]: DEBUG nova.compute.manager [req-cfd89955-05ac-49fe-9ad8-85788c4befea req-c3f987e2-9ccb-47d8-8ef5-8e5e01158f0e service nova] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Received event network-changed-ac9386e4-01a7-4ccf-abf1-814e9f349fcf {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:33:59 user nova-compute[73497]: DEBUG nova.compute.manager [req-cfd89955-05ac-49fe-9ad8-85788c4befea req-c3f987e2-9ccb-47d8-8ef5-8e5e01158f0e service nova] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Refreshing instance network info cache due to event network-changed-ac9386e4-01a7-4ccf-abf1-814e9f349fcf. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:33:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cfd89955-05ac-49fe-9ad8-85788c4befea req-c3f987e2-9ccb-47d8-8ef5-8e5e01158f0e service nova] Acquiring lock "refresh_cache-2b2d2380-d861-46c4-b13c-36b4f48cca77" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG nova.network.neutron [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG nova.network.neutron [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Updating instance_info_cache with network_info: [{"id": "ac9386e4-01a7-4ccf-abf1-814e9f349fcf", "address": "fa:16:3e:8a:9c:5b", "network": {"id": "bc10efbc-a86e-4a1d-8a40-bc508dd2a6db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1634677403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "077c6c937fcc4d8d95eb66d8d7f87167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac9386e4-01", "ovs_interfaceid": "ac9386e4-01a7-4ccf-abf1-814e9f349fcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Releasing lock "refresh_cache-2b2d2380-d861-46c4-b13c-36b4f48cca77" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Instance network_info: |[{"id": "ac9386e4-01a7-4ccf-abf1-814e9f349fcf", "address": "fa:16:3e:8a:9c:5b", "network": {"id": "bc10efbc-a86e-4a1d-8a40-bc508dd2a6db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1634677403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "077c6c937fcc4d8d95eb66d8d7f87167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac9386e4-01", "ovs_interfaceid": "ac9386e4-01a7-4ccf-abf1-814e9f349fcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cfd89955-05ac-49fe-9ad8-85788c4befea req-c3f987e2-9ccb-47d8-8ef5-8e5e01158f0e service nova] Acquired lock "refresh_cache-2b2d2380-d861-46c4-b13c-36b4f48cca77" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG nova.network.neutron [req-cfd89955-05ac-49fe-9ad8-85788c4befea req-c3f987e2-9ccb-47d8-8ef5-8e5e01158f0e service nova] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Refreshing network info cache for port ac9386e4-01a7-4ccf-abf1-814e9f349fcf {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Start _get_guest_xml network_info=[{"id": "ac9386e4-01a7-4ccf-abf1-814e9f349fcf", "address": "fa:16:3e:8a:9c:5b", "network": {"id": "bc10efbc-a86e-4a1d-8a40-bc508dd2a6db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1634677403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "077c6c937fcc4d8d95eb66d8d7f87167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac9386e4-01", "ovs_interfaceid": "ac9386e4-01a7-4ccf-abf1-814e9f349fcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:34:00 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:34:00 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:34:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:33:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-851699194',display_name='tempest-VolumesSnapshotTestJSON-instance-851699194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-851699194',id=39,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADhSirZNeH/xwmT/G7wQs0JZpJU5xUQhGSPJDEZaR1ZOJJSPSlcuY55n8ofcMtoZ9IvX9mbtU71roun/inb3maEu+tsO2cQmGo3MR66dVp17XYNlQ1bqC/hsRfQh3lefA==',key_name='tempest-keypair-794877025',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='077c6c937fcc4d8d95eb66d8d7f87167',ramdisk_id='',reservation_id='r-1b08sx0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1128972653',owner_user_name='tempest-VolumesSnapshotTestJSON-1128972653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:33:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec43dd42316042a4895706726866b103',uuid=2b2d2380-d861-46c4-b13c-36b4f48cca77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac9386e4-01a7-4ccf-abf1-814e9f349fcf", "address": "fa:16:3e:8a:9c:5b", "network": {"id": "bc10efbc-a86e-4a1d-8a40-bc508dd2a6db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1634677403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "077c6c937fcc4d8d95eb66d8d7f87167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac9386e4-01", "ovs_interfaceid": "ac9386e4-01a7-4ccf-abf1-814e9f349fcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Converting VIF {"id": "ac9386e4-01a7-4ccf-abf1-814e9f349fcf", "address": "fa:16:3e:8a:9c:5b", "network": {"id": "bc10efbc-a86e-4a1d-8a40-bc508dd2a6db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1634677403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "077c6c937fcc4d8d95eb66d8d7f87167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac9386e4-01", "ovs_interfaceid": "ac9386e4-01a7-4ccf-abf1-814e9f349fcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:9c:5b,bridge_name='br-int',has_traffic_filtering=True,id=ac9386e4-01a7-4ccf-abf1-814e9f349fcf,network=Network(bc10efbc-a86e-4a1d-8a40-bc508dd2a6db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac9386e4-01') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG nova.objects.instance [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lazy-loading 'pci_devices' on Instance uuid 2b2d2380-d861-46c4-b13c-36b4f48cca77 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:34:00 user nova-compute[73497]:   <uuid>2b2d2380-d861-46c4-b13c-36b4f48cca77</uuid>
Aug 26 23:34:00 user nova-compute[73497]:   <name>instance-00000027</name>
Aug 26 23:34:00 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:34:00 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:34:00 user nova-compute[73497]:   <metadata>
Aug 26 23:34:00 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:34:00 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:34:00 user nova-compute[73497]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-851699194</nova:name>
Aug 26 23:34:00 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:34:00</nova:creationTime>
Aug 26 23:34:00 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:34:00 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:34:00 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:34:00 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:34:00 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:34:00 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:34:00 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:34:00 user nova-compute[73497]:       <nova:owner>
Aug 26 23:34:00 user nova-compute[73497]:         <nova:user uuid="ec43dd42316042a4895706726866b103">tempest-VolumesSnapshotTestJSON-1128972653-project-member</nova:user>
Aug 26 23:34:00 user nova-compute[73497]:         <nova:project uuid="077c6c937fcc4d8d95eb66d8d7f87167">tempest-VolumesSnapshotTestJSON-1128972653</nova:project>
Aug 26 23:34:00 user nova-compute[73497]:       </nova:owner>
Aug 26 23:34:00 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:34:00 user nova-compute[73497]:       <nova:ports>
Aug 26 23:34:00 user nova-compute[73497]:         <nova:port uuid="ac9386e4-01a7-4ccf-abf1-814e9f349fcf">
Aug 26 23:34:00 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 23:34:00 user nova-compute[73497]:         </nova:port>
Aug 26 23:34:00 user nova-compute[73497]:       </nova:ports>
Aug 26 23:34:00 user nova-compute[73497]:     </nova:instance>
Aug 26 23:34:00 user nova-compute[73497]:   </metadata>
Aug 26 23:34:00 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:34:00 user nova-compute[73497]:     <system>
Aug 26 23:34:00 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:34:00 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:34:00 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:34:00 user nova-compute[73497]:       <entry name="serial">2b2d2380-d861-46c4-b13c-36b4f48cca77</entry>
Aug 26 23:34:00 user nova-compute[73497]:       <entry name="uuid">2b2d2380-d861-46c4-b13c-36b4f48cca77</entry>
Aug 26 23:34:00 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:34:00 user nova-compute[73497]:     </system>
Aug 26 23:34:00 user nova-compute[73497]:   </sysinfo>
Aug 26 23:34:00 user nova-compute[73497]:   <os>
Aug 26 23:34:00 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:34:00 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:34:00 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:34:00 user nova-compute[73497]:   </os>
Aug 26 23:34:00 user nova-compute[73497]:   <features>
Aug 26 23:34:00 user nova-compute[73497]:     <acpi/>
Aug 26 23:34:00 user nova-compute[73497]:     <apic/>
Aug 26 23:34:00 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:34:00 user nova-compute[73497]:   </features>
Aug 26 23:34:00 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:34:00 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:34:00 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:34:00 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:34:00 user nova-compute[73497]:   </clock>
Aug 26 23:34:00 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:34:00 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:34:00 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:34:00 user nova-compute[73497]:   </cpu>
Aug 26 23:34:00 user nova-compute[73497]:   <devices>
Aug 26 23:34:00 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:34:00 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:34:00 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/2b2d2380-d861-46c4-b13c-36b4f48cca77/disk"/>
Aug 26 23:34:00 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:34:00 user nova-compute[73497]:     </disk>
Aug 26 23:34:00 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:34:00 user nova-compute[73497]:       <mac address="fa:16:3e:8a:9c:5b"/>
Aug 26 23:34:00 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:34:00 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:34:00 user nova-compute[73497]:       <target dev="tapac9386e4-01"/>
Aug 26 23:34:00 user nova-compute[73497]:     </interface>
Aug 26 23:34:00 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:34:00 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/2b2d2380-d861-46c4-b13c-36b4f48cca77/console.log" append="off"/>
Aug 26 23:34:00 user nova-compute[73497]:     </serial>
Aug 26 23:34:00 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:34:00 user nova-compute[73497]:     <video>
Aug 26 23:34:00 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:34:00 user nova-compute[73497]:     </video>
Aug 26 23:34:00 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:34:00 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:34:00 user nova-compute[73497]:     </rng>
Aug 26 23:34:00 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:34:00 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:34:00 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:34:00 user nova-compute[73497]:     </memballoon>
Aug 26 23:34:00 user nova-compute[73497]:   </devices>
Aug 26 23:34:00 user nova-compute[73497]: </domain>
Aug 26 23:34:00 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:33:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-851699194',display_name='tempest-VolumesSnapshotTestJSON-instance-851699194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-851699194',id=39,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADhSirZNeH/xwmT/G7wQs0JZpJU5xUQhGSPJDEZaR1ZOJJSPSlcuY55n8ofcMtoZ9IvX9mbtU71roun/inb3maEu+tsO2cQmGo3MR66dVp17XYNlQ1bqC/hsRfQh3lefA==',key_name='tempest-keypair-794877025',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='077c6c937fcc4d8d95eb66d8d7f87167',ramdisk_id='',reservation_id='r-1b08sx0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1128972653',owner_user_name='tempest-VolumesSnapshotTestJSON-1128972653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:33:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec43dd42316042a4895706726866b103',uuid=2b2d2380-d861-46c4-b13c-36b4f48cca77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac9386e4-01a7-4ccf-abf1-814e9f349fcf", "address": "fa:16:3e:8a:9c:5b", "network": {"id": "bc10efbc-a86e-4a1d-8a40-bc508dd2a6db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1634677403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "077c6c937fcc4d8d95eb66d8d7f87167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac9386e4-01", "ovs_interfaceid": "ac9386e4-01a7-4ccf-abf1-814e9f349fcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Converting VIF {"id": "ac9386e4-01a7-4ccf-abf1-814e9f349fcf", "address": "fa:16:3e:8a:9c:5b", "network": {"id": "bc10efbc-a86e-4a1d-8a40-bc508dd2a6db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1634677403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "077c6c937fcc4d8d95eb66d8d7f87167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac9386e4-01", "ovs_interfaceid": "ac9386e4-01a7-4ccf-abf1-814e9f349fcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:9c:5b,bridge_name='br-int',has_traffic_filtering=True,id=ac9386e4-01a7-4ccf-abf1-814e9f349fcf,network=Network(bc10efbc-a86e-4a1d-8a40-bc508dd2a6db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac9386e4-01') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG os_vif [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:9c:5b,bridge_name='br-int',has_traffic_filtering=True,id=ac9386e4-01a7-4ccf-abf1-814e9f349fcf,network=Network(bc10efbc-a86e-4a1d-8a40-bc508dd2a6db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac9386e4-01') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac9386e4-01, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapac9386e4-01, col_values=(('external_ids', {'iface-id': 'ac9386e4-01a7-4ccf-abf1-814e9f349fcf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:9c:5b', 'vm-uuid': '2b2d2380-d861-46c4-b13c-36b4f48cca77'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:00 user nova-compute[73497]: INFO os_vif [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:9c:5b,bridge_name='br-int',has_traffic_filtering=True,id=ac9386e4-01a7-4ccf-abf1-814e9f349fcf,network=Network(bc10efbc-a86e-4a1d-8a40-bc508dd2a6db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac9386e4-01')
Aug 26 23:34:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] No VIF found with MAC fa:16:3e:8a:9c:5b, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG nova.network.neutron [req-cfd89955-05ac-49fe-9ad8-85788c4befea req-c3f987e2-9ccb-47d8-8ef5-8e5e01158f0e service nova] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Updated VIF entry in instance network info cache for port ac9386e4-01a7-4ccf-abf1-814e9f349fcf. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG nova.network.neutron [req-cfd89955-05ac-49fe-9ad8-85788c4befea req-c3f987e2-9ccb-47d8-8ef5-8e5e01158f0e service nova] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Updating instance_info_cache with network_info: [{"id": "ac9386e4-01a7-4ccf-abf1-814e9f349fcf", "address": "fa:16:3e:8a:9c:5b", "network": {"id": "bc10efbc-a86e-4a1d-8a40-bc508dd2a6db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1634677403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "077c6c937fcc4d8d95eb66d8d7f87167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac9386e4-01", "ovs_interfaceid": "ac9386e4-01a7-4ccf-abf1-814e9f349fcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:34:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cfd89955-05ac-49fe-9ad8-85788c4befea req-c3f987e2-9ccb-47d8-8ef5-8e5e01158f0e service nova] Releasing lock "refresh_cache-2b2d2380-d861-46c4-b13c-36b4f48cca77" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:34:01 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:34:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:34:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:34:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:34:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:34:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:02 user nova-compute[73497]: DEBUG nova.compute.manager [req-b6cbf23a-bf53-48d2-b192-ba504656699b req-288784f3-4533-42e5-bbd3-e0f4d6d4aa1b service nova] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Received event network-vif-plugged-ac9386e4-01a7-4ccf-abf1-814e9f349fcf {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:34:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b6cbf23a-bf53-48d2-b192-ba504656699b req-288784f3-4533-42e5-bbd3-e0f4d6d4aa1b service nova] Acquiring lock "2b2d2380-d861-46c4-b13c-36b4f48cca77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:34:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b6cbf23a-bf53-48d2-b192-ba504656699b req-288784f3-4533-42e5-bbd3-e0f4d6d4aa1b service nova] Lock "2b2d2380-d861-46c4-b13c-36b4f48cca77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:34:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b6cbf23a-bf53-48d2-b192-ba504656699b req-288784f3-4533-42e5-bbd3-e0f4d6d4aa1b service nova] Lock "2b2d2380-d861-46c4-b13c-36b4f48cca77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:34:02 user nova-compute[73497]: DEBUG nova.compute.manager [req-b6cbf23a-bf53-48d2-b192-ba504656699b req-288784f3-4533-42e5-bbd3-e0f4d6d4aa1b service nova] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] No waiting events found dispatching network-vif-plugged-ac9386e4-01a7-4ccf-abf1-814e9f349fcf {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:34:02 user nova-compute[73497]: WARNING nova.compute.manager [req-b6cbf23a-bf53-48d2-b192-ba504656699b req-288784f3-4533-42e5-bbd3-e0f4d6d4aa1b service nova] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Received unexpected event network-vif-plugged-ac9386e4-01a7-4ccf-abf1-814e9f349fcf for instance with vm_state building and task_state spawning.
Aug 26 23:34:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:34:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:34:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:34:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:34:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2d2380-d861-46c4-b13c-36b4f48cca77/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:34:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2d2380-d861-46c4-b13c-36b4f48cca77/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:34:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2d2380-d861-46c4-b13c-36b4f48cca77/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:34:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2d2380-d861-46c4-b13c-36b4f48cca77/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:34:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:34:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:34:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:34:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:34:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:34:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:34:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:34:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:34:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:34:04 user nova-compute[73497]: DEBUG nova.compute.manager [req-10e056ef-2691-40a3-8aa6-920ab7847de8 req-4c312463-56d0-4dbe-ab69-26171953a24e service nova] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Received event network-vif-plugged-ac9386e4-01a7-4ccf-abf1-814e9f349fcf {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:34:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-10e056ef-2691-40a3-8aa6-920ab7847de8 req-4c312463-56d0-4dbe-ab69-26171953a24e service nova] Acquiring lock "2b2d2380-d861-46c4-b13c-36b4f48cca77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:34:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-10e056ef-2691-40a3-8aa6-920ab7847de8 req-4c312463-56d0-4dbe-ab69-26171953a24e service nova] Lock "2b2d2380-d861-46c4-b13c-36b4f48cca77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:34:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-10e056ef-2691-40a3-8aa6-920ab7847de8 req-4c312463-56d0-4dbe-ab69-26171953a24e service nova] Lock "2b2d2380-d861-46c4-b13c-36b4f48cca77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:34:04 user nova-compute[73497]: DEBUG nova.compute.manager [req-10e056ef-2691-40a3-8aa6-920ab7847de8 req-4c312463-56d0-4dbe-ab69-26171953a24e service nova] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] No waiting events found dispatching network-vif-plugged-ac9386e4-01a7-4ccf-abf1-814e9f349fcf {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:34:04 user nova-compute[73497]: WARNING nova.compute.manager [req-10e056ef-2691-40a3-8aa6-920ab7847de8 req-4c312463-56d0-4dbe-ab69-26171953a24e service nova] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Received unexpected event network-vif-plugged-ac9386e4-01a7-4ccf-abf1-814e9f349fcf for instance with vm_state building and task_state spawning.
Aug 26 23:34:04 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092844.301788, 2b2d2380-d861-46c4-b13c-36b4f48cca77 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:34:04 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] VM Resumed (Lifecycle Event)
Aug 26 23:34:04 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:34:04 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:34:04 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Instance spawned successfully.
Aug 26 23:34:04 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:34:04 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:34:04 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:34:04 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:34:04 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:34:04 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:34:04 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:34:04 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:34:04 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:34:04 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:34:04 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092844.3061163, 2b2d2380-d861-46c4-b13c-36b4f48cca77 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:34:04 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] VM Started (Lifecycle Event)
Aug 26 23:34:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:34:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:34:04 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:34:04 user nova-compute[73497]: INFO nova.compute.manager [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Took 5.85 seconds to spawn the instance on the hypervisor.
Aug 26 23:34:04 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:34:04 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:34:04 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:34:04 user nova-compute[73497]: INFO nova.compute.manager [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Took 6.85 seconds to build instance.
Aug 26 23:34:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c3b48696-581e-46da-ac97-5d841ec6dd81 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "2b2d2380-d861-46c4-b13c-36b4f48cca77" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.948s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:34:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:34:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:34:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:34:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:34:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:34:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:34:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:34:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:34:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:34:06 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:34:06 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:34:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=7853MB free_disk=25.147144317626953GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:34:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:34:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:34:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 043294e5-0618-4a31-bb19-1227ef1f5d39 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:34:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance e9e5c83f-0678-48d4-a81f-1a3f959aabcf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:34:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance f7c83073-fadc-4e41-a4a9-df0bbe11aa28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:34:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance e15ddee6-a642-4638-9534-21e640b3d017 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:34:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance db489468-154b-4238-8b81-f8fa2bc016b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:34:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 2b2d2380-d861-46c4-b13c-36b4f48cca77 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:34:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:34:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:34:06 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:34:06 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:34:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:34:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.642s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:34:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5c5d9119-6864-4edb-a626-ce20cfbf9dc5 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "e15ddee6-a642-4638-9534-21e640b3d017" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:34:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5c5d9119-6864-4edb-a626-ce20cfbf9dc5 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "e15ddee6-a642-4638-9534-21e640b3d017" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:34:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5c5d9119-6864-4edb-a626-ce20cfbf9dc5 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "e15ddee6-a642-4638-9534-21e640b3d017-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:34:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5c5d9119-6864-4edb-a626-ce20cfbf9dc5 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "e15ddee6-a642-4638-9534-21e640b3d017-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:34:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5c5d9119-6864-4edb-a626-ce20cfbf9dc5 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "e15ddee6-a642-4638-9534-21e640b3d017-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:34:08 user nova-compute[73497]: INFO nova.compute.manager [None req-5c5d9119-6864-4edb-a626-ce20cfbf9dc5 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Terminating instance
Aug 26 23:34:08 user nova-compute[73497]: DEBUG nova.compute.manager [None req-5c5d9119-6864-4edb-a626-ce20cfbf9dc5 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:34:08 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:08 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:08 user nova-compute[73497]: DEBUG nova.compute.manager [req-f1d2bf85-4f14-4f65-9a02-681274481cf8 req-e551258c-c650-4791-ae57-cc4c4ee533e0 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Received event network-vif-unplugged-8d982123-d2ef-4d00-95d1-bee24f228175 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:34:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f1d2bf85-4f14-4f65-9a02-681274481cf8 req-e551258c-c650-4791-ae57-cc4c4ee533e0 service nova] Acquiring lock "e15ddee6-a642-4638-9534-21e640b3d017-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:34:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f1d2bf85-4f14-4f65-9a02-681274481cf8 req-e551258c-c650-4791-ae57-cc4c4ee533e0 service nova] Lock "e15ddee6-a642-4638-9534-21e640b3d017-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:34:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f1d2bf85-4f14-4f65-9a02-681274481cf8 req-e551258c-c650-4791-ae57-cc4c4ee533e0 service nova] Lock "e15ddee6-a642-4638-9534-21e640b3d017-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:34:08 user nova-compute[73497]: DEBUG nova.compute.manager [req-f1d2bf85-4f14-4f65-9a02-681274481cf8 req-e551258c-c650-4791-ae57-cc4c4ee533e0 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] No waiting events found dispatching network-vif-unplugged-8d982123-d2ef-4d00-95d1-bee24f228175 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:34:08 user nova-compute[73497]: DEBUG nova.compute.manager [req-f1d2bf85-4f14-4f65-9a02-681274481cf8 req-e551258c-c650-4791-ae57-cc4c4ee533e0 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Received event network-vif-unplugged-8d982123-d2ef-4d00-95d1-bee24f228175 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:34:08 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:34:08 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:34:08 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:34:08 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:34:08 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:34:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:09 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:34:09 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Instance destroyed successfully.
Aug 26 23:34:09 user nova-compute[73497]: DEBUG nova.objects.instance [None req-5c5d9119-6864-4edb-a626-ce20cfbf9dc5 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lazy-loading 'resources' on Instance uuid e15ddee6-a642-4638-9534-21e640b3d017 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:34:09 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-5c5d9119-6864-4edb-a626-ce20cfbf9dc5 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:27:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-493508388',display_name='tempest-ServerRescueNegativeTestJSON-server-493508388',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-493508388',id=33,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINj3seD7LQAkaX0wYOG1fS3idoL99uw4+1lVHlG8bZ0rOjqkGpGnEUfwVCpDQwjz4kP4hFSLF4r/El5/40r8+otqhjInnqtJnBnHrwpLdvAuBQM4cvraqsvSlrODkbriA==',key_name='tempest-keypair-198397446',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:29:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c4ca787dd33440d98779668507369ee',ramdisk_id='',reservation_id='r-on4mu606',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1946187856',owner_user_name='tempest-ServerRescueNegativeTestJSON-1946187856-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:31:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='af64aa253eec41a0976c3e527fe41831',uuid=e15ddee6-a642-4638-9534-21e640b3d017,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d982123-d2ef-4d00-95d1-bee24f228175", "address": "fa:16:3e:e8:ce:24", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d982123-d2", "ovs_interfaceid": "8d982123-d2ef-4d00-95d1-bee24f228175", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:34:09 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-5c5d9119-6864-4edb-a626-ce20cfbf9dc5 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Converting VIF {"id": "8d982123-d2ef-4d00-95d1-bee24f228175", "address": "fa:16:3e:e8:ce:24", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d982123-d2", "ovs_interfaceid": "8d982123-d2ef-4d00-95d1-bee24f228175", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:34:09 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-5c5d9119-6864-4edb-a626-ce20cfbf9dc5 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:ce:24,bridge_name='br-int',has_traffic_filtering=True,id=8d982123-d2ef-4d00-95d1-bee24f228175,network=Network(6f13f07f-104d-4d8d-b5fa-afa402402a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d982123-d2') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:34:09 user nova-compute[73497]: DEBUG os_vif [None req-5c5d9119-6864-4edb-a626-ce20cfbf9dc5 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:ce:24,bridge_name='br-int',has_traffic_filtering=True,id=8d982123-d2ef-4d00-95d1-bee24f228175,network=Network(6f13f07f-104d-4d8d-b5fa-afa402402a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d982123-d2') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:34:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d982123-d2, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:34:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:34:09 user nova-compute[73497]: INFO os_vif [None req-5c5d9119-6864-4edb-a626-ce20cfbf9dc5 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:ce:24,bridge_name='br-int',has_traffic_filtering=True,id=8d982123-d2ef-4d00-95d1-bee24f228175,network=Network(6f13f07f-104d-4d8d-b5fa-afa402402a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d982123-d2')
Aug 26 23:34:09 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-5c5d9119-6864-4edb-a626-ce20cfbf9dc5 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Deleting instance files /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017_del
Aug 26 23:34:09 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-5c5d9119-6864-4edb-a626-ce20cfbf9dc5 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Deletion of /opt/stack/data/nova/instances/e15ddee6-a642-4638-9534-21e640b3d017_del complete
Aug 26 23:34:09 user nova-compute[73497]: INFO nova.compute.manager [None req-5c5d9119-6864-4edb-a626-ce20cfbf9dc5 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 26 23:34:09 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-5c5d9119-6864-4edb-a626-ce20cfbf9dc5 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:34:09 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:34:09 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: e15ddee6-a642-4638-9534-21e640b3d017] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:34:10 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693092835.0631232, b7506745-ace5-45e2-bc1d-883f2c51f1c4 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:34:10 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] VM Stopped (Lifecycle Event)
Aug 26 23:34:10 user nova-compute[73497]: DEBUG nova.compute.manager [None req-eb3ef758-bb75-4624-91e9-1b65c16dbaa4 None None] [instance: b7506745-ace5-45e2-bc1d-883f2c51f1c4] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:34:10 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:34:10 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Cleaning up deleted instances {{(pid=73497) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 23:34:10 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] There are 0 instances to clean {{(pid=73497) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 23:34:10 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:34:10 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Took 1.00 seconds to deallocate network for instance.
Aug 26 23:34:10 user nova-compute[73497]: DEBUG nova.compute.manager [req-a91f3376-48c9-44dc-95eb-fcccee127a6a req-e0405ecf-6706-48eb-ae60-70444306e1f3 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Received event network-vif-deleted-8d982123-d2ef-4d00-95d1-bee24f228175 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:34:10 user nova-compute[73497]: INFO nova.compute.manager [req-a91f3376-48c9-44dc-95eb-fcccee127a6a req-e0405ecf-6706-48eb-ae60-70444306e1f3 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Neutron deleted interface 8d982123-d2ef-4d00-95d1-bee24f228175; detaching it from the instance and deleting it from the info cache
Aug 26 23:34:10 user nova-compute[73497]: DEBUG nova.network.neutron [req-a91f3376-48c9-44dc-95eb-fcccee127a6a req-e0405ecf-6706-48eb-ae60-70444306e1f3 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:34:10 user nova-compute[73497]: DEBUG nova.compute.manager [req-a91f3376-48c9-44dc-95eb-fcccee127a6a req-e0405ecf-6706-48eb-ae60-70444306e1f3 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Detach interface failed, port_id=8d982123-d2ef-4d00-95d1-bee24f228175, reason: Instance e15ddee6-a642-4638-9534-21e640b3d017 could not be found. {{(pid=73497) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 23:34:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5c5d9119-6864-4edb-a626-ce20cfbf9dc5 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:34:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5c5d9119-6864-4edb-a626-ce20cfbf9dc5 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:34:10 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-5c5d9119-6864-4edb-a626-ce20cfbf9dc5 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:34:10 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-5c5d9119-6864-4edb-a626-ce20cfbf9dc5 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:34:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5c5d9119-6864-4edb-a626-ce20cfbf9dc5 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.263s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:34:10 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-5c5d9119-6864-4edb-a626-ce20cfbf9dc5 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Deleted allocations for instance e15ddee6-a642-4638-9534-21e640b3d017
Aug 26 23:34:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5c5d9119-6864-4edb-a626-ce20cfbf9dc5 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "e15ddee6-a642-4638-9534-21e640b3d017" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.406s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:34:11 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:34:11 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:34:11 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Didn't find any instances for network info cache update. {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 23:34:11 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:34:11 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Cleaning up deleted instances with incomplete migration  {{(pid=73497) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 23:34:11 user nova-compute[73497]: DEBUG nova.compute.manager [req-63498180-bbd9-4210-ad57-8b730cb585b7 req-e7983b59-33a9-42ed-8fc2-52ab0c67e0b4 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Received event network-vif-plugged-8d982123-d2ef-4d00-95d1-bee24f228175 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:34:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-63498180-bbd9-4210-ad57-8b730cb585b7 req-e7983b59-33a9-42ed-8fc2-52ab0c67e0b4 service nova] Acquiring lock "e15ddee6-a642-4638-9534-21e640b3d017-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:34:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-63498180-bbd9-4210-ad57-8b730cb585b7 req-e7983b59-33a9-42ed-8fc2-52ab0c67e0b4 service nova] Lock "e15ddee6-a642-4638-9534-21e640b3d017-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:34:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-63498180-bbd9-4210-ad57-8b730cb585b7 req-e7983b59-33a9-42ed-8fc2-52ab0c67e0b4 service nova] Lock "e15ddee6-a642-4638-9534-21e640b3d017-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:34:11 user nova-compute[73497]: DEBUG nova.compute.manager [req-63498180-bbd9-4210-ad57-8b730cb585b7 req-e7983b59-33a9-42ed-8fc2-52ab0c67e0b4 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] No waiting events found dispatching network-vif-plugged-8d982123-d2ef-4d00-95d1-bee24f228175 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:34:11 user nova-compute[73497]: WARNING nova.compute.manager [req-63498180-bbd9-4210-ad57-8b730cb585b7 req-e7983b59-33a9-42ed-8fc2-52ab0c67e0b4 service nova] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Received unexpected event network-vif-plugged-8d982123-d2ef-4d00-95d1-bee24f228175 for instance with vm_state deleted and task_state None.
Aug 26 23:34:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:13 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:34:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:23 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:24 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693092849.5006323, e15ddee6-a642-4638-9534-21e640b3d017 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:34:24 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: e15ddee6-a642-4638-9534-21e640b3d017] VM Stopped (Lifecycle Event)
Aug 26 23:34:24 user nova-compute[73497]: DEBUG nova.compute.manager [None req-1cc3cb59-1dd8-475e-b883-90015419c68d None None] [instance: e15ddee6-a642-4638-9534-21e640b3d017] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:34:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Acquiring lock "358ed2d7-4452-40cf-9fed-d9a8e45b5c99" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:34:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Lock "358ed2d7-4452-40cf-9fed-d9a8e45b5c99" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:34:29 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:34:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:34:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:34:29 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:34:29 user nova-compute[73497]: INFO nova.compute.claims [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Claim successful on node user
Aug 26 23:34:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:29 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:34:29 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:34:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:34:29 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:34:30 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:34:30 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:34:30 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:34:30 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:34:30 user nova-compute[73497]: DEBUG nova.policy [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f7864f3cb23546a9b747390135bd1f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30fe9ca93aa48ba84fb9a5ad89334c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:34:30 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:34:30 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:34:30 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Creating image(s)
Aug 26 23:34:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Acquiring lock "/opt/stack/data/nova/instances/358ed2d7-4452-40cf-9fed-d9a8e45b5c99/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:34:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Lock "/opt/stack/data/nova/instances/358ed2d7-4452-40cf-9fed-d9a8e45b5c99/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:34:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Lock "/opt/stack/data/nova/instances/358ed2d7-4452-40cf-9fed-d9a8e45b5c99/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:34:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:34:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.211s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:34:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:34:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:34:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:34:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.184s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:34:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/358ed2d7-4452-40cf-9fed-d9a8e45b5c99/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:34:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/358ed2d7-4452-40cf-9fed-d9a8e45b5c99/disk 1073741824" returned: 0 in 0.140s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:34:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.331s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:34:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:34:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.196s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:34:31 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Checking if we can resize image /opt/stack/data/nova/instances/358ed2d7-4452-40cf-9fed-d9a8e45b5c99/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:34:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358ed2d7-4452-40cf-9fed-d9a8e45b5c99/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:34:31 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Successfully created port: fbcd036f-eab6-435d-9eb6-856c76c37245 {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:34:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358ed2d7-4452-40cf-9fed-d9a8e45b5c99/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:34:31 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Cannot resize image /opt/stack/data/nova/instances/358ed2d7-4452-40cf-9fed-d9a8e45b5c99/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:34:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:34:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Ensure instance console log exists: /opt/stack/data/nova/instances/358ed2d7-4452-40cf-9fed-d9a8e45b5c99/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:34:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:34:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:34:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:34:31 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Successfully updated port: fbcd036f-eab6-435d-9eb6-856c76c37245 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:34:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Acquiring lock "refresh_cache-358ed2d7-4452-40cf-9fed-d9a8e45b5c99" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:34:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Acquired lock "refresh_cache-358ed2d7-4452-40cf-9fed-d9a8e45b5c99" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:34:31 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:34:31 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:34:31 user nova-compute[73497]: DEBUG nova.compute.manager [req-f019e7d6-1ae3-4c72-ad36-7bdd9ede5afc req-697a6a28-49a1-439e-af5f-c94305c8ab62 service nova] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Received event network-changed-fbcd036f-eab6-435d-9eb6-856c76c37245 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:34:31 user nova-compute[73497]: DEBUG nova.compute.manager [req-f019e7d6-1ae3-4c72-ad36-7bdd9ede5afc req-697a6a28-49a1-439e-af5f-c94305c8ab62 service nova] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Refreshing instance network info cache due to event network-changed-fbcd036f-eab6-435d-9eb6-856c76c37245. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:34:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f019e7d6-1ae3-4c72-ad36-7bdd9ede5afc req-697a6a28-49a1-439e-af5f-c94305c8ab62 service nova] Acquiring lock "refresh_cache-358ed2d7-4452-40cf-9fed-d9a8e45b5c99" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Updating instance_info_cache with network_info: [{"id": "fbcd036f-eab6-435d-9eb6-856c76c37245", "address": "fa:16:3e:78:80:dc", "network": {"id": "ab93ff2a-6428-4e0e-a9a8-afbd83b56307", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-918557970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30fe9ca93aa48ba84fb9a5ad89334c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbcd036f-ea", "ovs_interfaceid": "fbcd036f-eab6-435d-9eb6-856c76c37245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Releasing lock "refresh_cache-358ed2d7-4452-40cf-9fed-d9a8e45b5c99" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Instance network_info: |[{"id": "fbcd036f-eab6-435d-9eb6-856c76c37245", "address": "fa:16:3e:78:80:dc", "network": {"id": "ab93ff2a-6428-4e0e-a9a8-afbd83b56307", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-918557970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30fe9ca93aa48ba84fb9a5ad89334c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbcd036f-ea", "ovs_interfaceid": "fbcd036f-eab6-435d-9eb6-856c76c37245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f019e7d6-1ae3-4c72-ad36-7bdd9ede5afc req-697a6a28-49a1-439e-af5f-c94305c8ab62 service nova] Acquired lock "refresh_cache-358ed2d7-4452-40cf-9fed-d9a8e45b5c99" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG nova.network.neutron [req-f019e7d6-1ae3-4c72-ad36-7bdd9ede5afc req-697a6a28-49a1-439e-af5f-c94305c8ab62 service nova] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Refreshing network info cache for port fbcd036f-eab6-435d-9eb6-856c76c37245 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Start _get_guest_xml network_info=[{"id": "fbcd036f-eab6-435d-9eb6-856c76c37245", "address": "fa:16:3e:78:80:dc", "network": {"id": "ab93ff2a-6428-4e0e-a9a8-afbd83b56307", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-918557970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30fe9ca93aa48ba84fb9a5ad89334c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbcd036f-ea", "ovs_interfaceid": "fbcd036f-eab6-435d-9eb6-856c76c37245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:34:32 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:34:32 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:34:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1594102110',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1594102110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1594102',id=40,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL1TrlNrrZZLYhoWTd8xeTDH3XD5a19EFGBLeQg3aqUycO1k5frRMS2pcGfB8VSVSrjqKJXhfht5b8LeITFx2hnZmZbkWc0zWT7YwTep1ezQNXCkWZKMsSGy3UltJeDKDA==',key_name='tempest-keypair-508003349',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c30fe9ca93aa48ba84fb9a5ad89334c7',ramdisk_id='',reservation_id='r-9ejzcpgz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-131421111',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:34:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7864f3cb23546a9b747390135bd1f0d',uuid=358ed2d7-4452-40cf-9fed-d9a8e45b5c99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbcd036f-eab6-435d-9eb6-856c76c37245", "address": "fa:16:3e:78:80:dc", "network": {"id": "ab93ff2a-6428-4e0e-a9a8-afbd83b56307", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-918557970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30fe9ca93aa48ba84fb9a5ad89334c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbcd036f-ea", "ovs_interfaceid": "fbcd036f-eab6-435d-9eb6-856c76c37245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Converting VIF {"id": "fbcd036f-eab6-435d-9eb6-856c76c37245", "address": "fa:16:3e:78:80:dc", "network": {"id": "ab93ff2a-6428-4e0e-a9a8-afbd83b56307", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-918557970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30fe9ca93aa48ba84fb9a5ad89334c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbcd036f-ea", "ovs_interfaceid": "fbcd036f-eab6-435d-9eb6-856c76c37245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:80:dc,bridge_name='br-int',has_traffic_filtering=True,id=fbcd036f-eab6-435d-9eb6-856c76c37245,network=Network(ab93ff2a-6428-4e0e-a9a8-afbd83b56307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbcd036f-ea') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG nova.objects.instance [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Lazy-loading 'pci_devices' on Instance uuid 358ed2d7-4452-40cf-9fed-d9a8e45b5c99 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:34:32 user nova-compute[73497]:   <uuid>358ed2d7-4452-40cf-9fed-d9a8e45b5c99</uuid>
Aug 26 23:34:32 user nova-compute[73497]:   <name>instance-00000028</name>
Aug 26 23:34:32 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:34:32 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:34:32 user nova-compute[73497]:   <metadata>
Aug 26 23:34:32 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:34:32 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:34:32 user nova-compute[73497]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1594102110</nova:name>
Aug 26 23:34:32 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:34:32</nova:creationTime>
Aug 26 23:34:32 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:34:32 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:34:32 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:34:32 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:34:32 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:34:32 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:34:32 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:34:32 user nova-compute[73497]:       <nova:owner>
Aug 26 23:34:32 user nova-compute[73497]:         <nova:user uuid="f7864f3cb23546a9b747390135bd1f0d">tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member</nova:user>
Aug 26 23:34:32 user nova-compute[73497]:         <nova:project uuid="c30fe9ca93aa48ba84fb9a5ad89334c7">tempest-TestServerVolumeAttachScenarioOldVersion-131421111</nova:project>
Aug 26 23:34:32 user nova-compute[73497]:       </nova:owner>
Aug 26 23:34:32 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:34:32 user nova-compute[73497]:       <nova:ports>
Aug 26 23:34:32 user nova-compute[73497]:         <nova:port uuid="fbcd036f-eab6-435d-9eb6-856c76c37245">
Aug 26 23:34:32 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 23:34:32 user nova-compute[73497]:         </nova:port>
Aug 26 23:34:32 user nova-compute[73497]:       </nova:ports>
Aug 26 23:34:32 user nova-compute[73497]:     </nova:instance>
Aug 26 23:34:32 user nova-compute[73497]:   </metadata>
Aug 26 23:34:32 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:34:32 user nova-compute[73497]:     <system>
Aug 26 23:34:32 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:34:32 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:34:32 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:34:32 user nova-compute[73497]:       <entry name="serial">358ed2d7-4452-40cf-9fed-d9a8e45b5c99</entry>
Aug 26 23:34:32 user nova-compute[73497]:       <entry name="uuid">358ed2d7-4452-40cf-9fed-d9a8e45b5c99</entry>
Aug 26 23:34:32 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:34:32 user nova-compute[73497]:     </system>
Aug 26 23:34:32 user nova-compute[73497]:   </sysinfo>
Aug 26 23:34:32 user nova-compute[73497]:   <os>
Aug 26 23:34:32 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:34:32 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:34:32 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:34:32 user nova-compute[73497]:   </os>
Aug 26 23:34:32 user nova-compute[73497]:   <features>
Aug 26 23:34:32 user nova-compute[73497]:     <acpi/>
Aug 26 23:34:32 user nova-compute[73497]:     <apic/>
Aug 26 23:34:32 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:34:32 user nova-compute[73497]:   </features>
Aug 26 23:34:32 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:34:32 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:34:32 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:34:32 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:34:32 user nova-compute[73497]:   </clock>
Aug 26 23:34:32 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:34:32 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:34:32 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:34:32 user nova-compute[73497]:   </cpu>
Aug 26 23:34:32 user nova-compute[73497]:   <devices>
Aug 26 23:34:32 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:34:32 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:34:32 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/358ed2d7-4452-40cf-9fed-d9a8e45b5c99/disk"/>
Aug 26 23:34:32 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:34:32 user nova-compute[73497]:     </disk>
Aug 26 23:34:32 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:34:32 user nova-compute[73497]:       <mac address="fa:16:3e:78:80:dc"/>
Aug 26 23:34:32 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:34:32 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:34:32 user nova-compute[73497]:       <target dev="tapfbcd036f-ea"/>
Aug 26 23:34:32 user nova-compute[73497]:     </interface>
Aug 26 23:34:32 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:34:32 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/358ed2d7-4452-40cf-9fed-d9a8e45b5c99/console.log" append="off"/>
Aug 26 23:34:32 user nova-compute[73497]:     </serial>
Aug 26 23:34:32 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:34:32 user nova-compute[73497]:     <video>
Aug 26 23:34:32 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:34:32 user nova-compute[73497]:     </video>
Aug 26 23:34:32 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:34:32 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:34:32 user nova-compute[73497]:     </rng>
Aug 26 23:34:32 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:34:32 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:34:32 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:34:32 user nova-compute[73497]:     </memballoon>
Aug 26 23:34:32 user nova-compute[73497]:   </devices>
Aug 26 23:34:32 user nova-compute[73497]: </domain>
Aug 26 23:34:32 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1594102110',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1594102110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1594102',id=40,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL1TrlNrrZZLYhoWTd8xeTDH3XD5a19EFGBLeQg3aqUycO1k5frRMS2pcGfB8VSVSrjqKJXhfht5b8LeITFx2hnZmZbkWc0zWT7YwTep1ezQNXCkWZKMsSGy3UltJeDKDA==',key_name='tempest-keypair-508003349',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c30fe9ca93aa48ba84fb9a5ad89334c7',ramdisk_id='',reservation_id='r-9ejzcpgz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-131421111',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:34:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7864f3cb23546a9b747390135bd1f0d',uuid=358ed2d7-4452-40cf-9fed-d9a8e45b5c99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbcd036f-eab6-435d-9eb6-856c76c37245", "address": "fa:16:3e:78:80:dc", "network": {"id": "ab93ff2a-6428-4e0e-a9a8-afbd83b56307", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-918557970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30fe9ca93aa48ba84fb9a5ad89334c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbcd036f-ea", "ovs_interfaceid": "fbcd036f-eab6-435d-9eb6-856c76c37245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Converting VIF {"id": "fbcd036f-eab6-435d-9eb6-856c76c37245", "address": "fa:16:3e:78:80:dc", "network": {"id": "ab93ff2a-6428-4e0e-a9a8-afbd83b56307", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-918557970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30fe9ca93aa48ba84fb9a5ad89334c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbcd036f-ea", "ovs_interfaceid": "fbcd036f-eab6-435d-9eb6-856c76c37245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:80:dc,bridge_name='br-int',has_traffic_filtering=True,id=fbcd036f-eab6-435d-9eb6-856c76c37245,network=Network(ab93ff2a-6428-4e0e-a9a8-afbd83b56307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbcd036f-ea') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG os_vif [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:80:dc,bridge_name='br-int',has_traffic_filtering=True,id=fbcd036f-eab6-435d-9eb6-856c76c37245,network=Network(ab93ff2a-6428-4e0e-a9a8-afbd83b56307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbcd036f-ea') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfbcd036f-ea, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfbcd036f-ea, col_values=(('external_ids', {'iface-id': 'fbcd036f-eab6-435d-9eb6-856c76c37245', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:80:dc', 'vm-uuid': '358ed2d7-4452-40cf-9fed-d9a8e45b5c99'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:32 user nova-compute[73497]: INFO os_vif [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:80:dc,bridge_name='br-int',has_traffic_filtering=True,id=fbcd036f-eab6-435d-9eb6-856c76c37245,network=Network(ab93ff2a-6428-4e0e-a9a8-afbd83b56307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbcd036f-ea')
Aug 26 23:34:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] No VIF found with MAC fa:16:3e:78:80:dc, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG nova.network.neutron [req-f019e7d6-1ae3-4c72-ad36-7bdd9ede5afc req-697a6a28-49a1-439e-af5f-c94305c8ab62 service nova] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Updated VIF entry in instance network info cache for port fbcd036f-eab6-435d-9eb6-856c76c37245. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG nova.network.neutron [req-f019e7d6-1ae3-4c72-ad36-7bdd9ede5afc req-697a6a28-49a1-439e-af5f-c94305c8ab62 service nova] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Updating instance_info_cache with network_info: [{"id": "fbcd036f-eab6-435d-9eb6-856c76c37245", "address": "fa:16:3e:78:80:dc", "network": {"id": "ab93ff2a-6428-4e0e-a9a8-afbd83b56307", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-918557970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30fe9ca93aa48ba84fb9a5ad89334c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbcd036f-ea", "ovs_interfaceid": "fbcd036f-eab6-435d-9eb6-856c76c37245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:34:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f019e7d6-1ae3-4c72-ad36-7bdd9ede5afc req-697a6a28-49a1-439e-af5f-c94305c8ab62 service nova] Releasing lock "refresh_cache-358ed2d7-4452-40cf-9fed-d9a8e45b5c99" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:34:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-b52e2f97-ffd7-4887-9d37-1d17f1c4c8bf req-7485901b-acac-4bab-90f9-0b18c917a0e3 service nova] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Received event network-vif-plugged-fbcd036f-eab6-435d-9eb6-856c76c37245 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:34:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b52e2f97-ffd7-4887-9d37-1d17f1c4c8bf req-7485901b-acac-4bab-90f9-0b18c917a0e3 service nova] Acquiring lock "358ed2d7-4452-40cf-9fed-d9a8e45b5c99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:34:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b52e2f97-ffd7-4887-9d37-1d17f1c4c8bf req-7485901b-acac-4bab-90f9-0b18c917a0e3 service nova] Lock "358ed2d7-4452-40cf-9fed-d9a8e45b5c99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:34:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b52e2f97-ffd7-4887-9d37-1d17f1c4c8bf req-7485901b-acac-4bab-90f9-0b18c917a0e3 service nova] Lock "358ed2d7-4452-40cf-9fed-d9a8e45b5c99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:34:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-b52e2f97-ffd7-4887-9d37-1d17f1c4c8bf req-7485901b-acac-4bab-90f9-0b18c917a0e3 service nova] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] No waiting events found dispatching network-vif-plugged-fbcd036f-eab6-435d-9eb6-856c76c37245 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:34:33 user nova-compute[73497]: WARNING nova.compute.manager [req-b52e2f97-ffd7-4887-9d37-1d17f1c4c8bf req-7485901b-acac-4bab-90f9-0b18c917a0e3 service nova] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Received unexpected event network-vif-plugged-fbcd036f-eab6-435d-9eb6-856c76c37245 for instance with vm_state building and task_state spawning.
Aug 26 23:34:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:35 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092875.91824, 358ed2d7-4452-40cf-9fed-d9a8e45b5c99 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:34:35 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] VM Resumed (Lifecycle Event)
Aug 26 23:34:35 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:34:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:34:35 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Instance spawned successfully.
Aug 26 23:34:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:34:35 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:34:35 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:34:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:34:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:34:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:34:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:34:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:34:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:34:35 user nova-compute[73497]: DEBUG nova.compute.manager [req-6d5e5573-9971-4da1-af91-20965473bdef req-6b13b4ae-2560-4471-8599-65b1abeb383a service nova] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Received event network-vif-plugged-fbcd036f-eab6-435d-9eb6-856c76c37245 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:34:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6d5e5573-9971-4da1-af91-20965473bdef req-6b13b4ae-2560-4471-8599-65b1abeb383a service nova] Acquiring lock "358ed2d7-4452-40cf-9fed-d9a8e45b5c99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:34:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6d5e5573-9971-4da1-af91-20965473bdef req-6b13b4ae-2560-4471-8599-65b1abeb383a service nova] Lock "358ed2d7-4452-40cf-9fed-d9a8e45b5c99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:34:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6d5e5573-9971-4da1-af91-20965473bdef req-6b13b4ae-2560-4471-8599-65b1abeb383a service nova] Lock "358ed2d7-4452-40cf-9fed-d9a8e45b5c99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:34:35 user nova-compute[73497]: DEBUG nova.compute.manager [req-6d5e5573-9971-4da1-af91-20965473bdef req-6b13b4ae-2560-4471-8599-65b1abeb383a service nova] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] No waiting events found dispatching network-vif-plugged-fbcd036f-eab6-435d-9eb6-856c76c37245 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:34:35 user nova-compute[73497]: WARNING nova.compute.manager [req-6d5e5573-9971-4da1-af91-20965473bdef req-6b13b4ae-2560-4471-8599-65b1abeb383a service nova] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Received unexpected event network-vif-plugged-fbcd036f-eab6-435d-9eb6-856c76c37245 for instance with vm_state building and task_state spawning.
Aug 26 23:34:35 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:34:35 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092875.9203315, 358ed2d7-4452-40cf-9fed-d9a8e45b5c99 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:34:35 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] VM Started (Lifecycle Event)
Aug 26 23:34:35 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:34:36 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:34:36 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:34:36 user nova-compute[73497]: INFO nova.compute.manager [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Took 5.76 seconds to spawn the instance on the hypervisor.
Aug 26 23:34:36 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:34:36 user nova-compute[73497]: INFO nova.compute.manager [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Took 6.68 seconds to build instance.
Aug 26 23:34:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e68972a7-08ec-42a0-b0f0-24844b4d97e6 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Lock "358ed2d7-4452-40cf-9fed-d9a8e45b5c99" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.800s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:34:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:34:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:34:48 user nova-compute[73497]: DEBUG nova.compute.manager [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:34:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:34:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:34:48 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:34:48 user nova-compute[73497]: INFO nova.compute.claims [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Claim successful on node user
Aug 26 23:34:49 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:34:49 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:34:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:34:49 user nova-compute[73497]: DEBUG nova.compute.manager [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:34:49 user nova-compute[73497]: DEBUG nova.compute.manager [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:34:49 user nova-compute[73497]: DEBUG nova.network.neutron [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:34:49 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:34:49 user nova-compute[73497]: DEBUG nova.compute.manager [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:34:49 user nova-compute[73497]: DEBUG nova.policy [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '948c44e55c7c404fb660394a747cf162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae441ca35d847e89eb99397fe167960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:34:49 user nova-compute[73497]: DEBUG nova.compute.manager [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:34:49 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:34:49 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Creating image(s)
Aug 26 23:34:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1fa7599-72de-487d-9b0e-0adf8c0120ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:34:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "/opt/stack/data/nova/instances/f1fa7599-72de-487d-9b0e-0adf8c0120ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:34:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "/opt/stack/data/nova/instances/f1fa7599-72de-487d-9b0e-0adf8c0120ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:34:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "8772755b70e609d92c1d6cfcb74a391d9e9c9f87" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:34:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "8772755b70e609d92c1d6cfcb74a391d9e9c9f87" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:34:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8772755b70e609d92c1d6cfcb74a391d9e9c9f87.part --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:34:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8772755b70e609d92c1d6cfcb74a391d9e9c9f87.part --force-share --output=json" returned: 0 in 0.306s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:34:50 user nova-compute[73497]: DEBUG nova.virt.images [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] 3fe91fd7-2b21-49d2-861d-888133645deb was qcow2, converting to raw {{(pid=73497) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 23:34:50 user nova-compute[73497]: DEBUG nova.privsep.utils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73497) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 23:34:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8772755b70e609d92c1d6cfcb74a391d9e9c9f87.part /opt/stack/data/nova/instances/_base/8772755b70e609d92c1d6cfcb74a391d9e9c9f87.converted {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:34:50 user nova-compute[73497]: DEBUG nova.network.neutron [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Successfully created port: 4f594b38-986f-42c8-bb69-4caeabfe1b56 {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:34:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8772755b70e609d92c1d6cfcb74a391d9e9c9f87.part /opt/stack/data/nova/instances/_base/8772755b70e609d92c1d6cfcb74a391d9e9c9f87.converted" returned: 0 in 0.578s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:34:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8772755b70e609d92c1d6cfcb74a391d9e9c9f87.converted --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8772755b70e609d92c1d6cfcb74a391d9e9c9f87.converted --force-share --output=json" returned: 0 in 0.202s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "8772755b70e609d92c1d6cfcb74a391d9e9c9f87" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.622s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8772755b70e609d92c1d6cfcb74a391d9e9c9f87 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8772755b70e609d92c1d6cfcb74a391d9e9c9f87 --force-share --output=json" returned: 0 in 0.202s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "8772755b70e609d92c1d6cfcb74a391d9e9c9f87" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "8772755b70e609d92c1d6cfcb74a391d9e9c9f87" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8772755b70e609d92c1d6cfcb74a391d9e9c9f87 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG nova.network.neutron [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Successfully updated port: 4f594b38-986f-42c8-bb69-4caeabfe1b56 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "refresh_cache-f1fa7599-72de-487d-9b0e-0adf8c0120ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquired lock "refresh_cache-f1fa7599-72de-487d-9b0e-0adf8c0120ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG nova.network.neutron [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG nova.compute.manager [req-b8565e1e-f225-4295-bdc2-359996c8ec5b req-b8e3bd56-2428-4558-9876-f2db97d21b33 service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Received event network-changed-4f594b38-986f-42c8-bb69-4caeabfe1b56 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG nova.compute.manager [req-b8565e1e-f225-4295-bdc2-359996c8ec5b req-b8e3bd56-2428-4558-9876-f2db97d21b33 service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Refreshing instance network info cache due to event network-changed-4f594b38-986f-42c8-bb69-4caeabfe1b56. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b8565e1e-f225-4295-bdc2-359996c8ec5b req-b8e3bd56-2428-4558-9876-f2db97d21b33 service nova] Acquiring lock "refresh_cache-f1fa7599-72de-487d-9b0e-0adf8c0120ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8772755b70e609d92c1d6cfcb74a391d9e9c9f87 --force-share --output=json" returned: 0 in 0.186s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8772755b70e609d92c1d6cfcb74a391d9e9c9f87,backing_fmt=raw /opt/stack/data/nova/instances/f1fa7599-72de-487d-9b0e-0adf8c0120ca/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG nova.network.neutron [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8772755b70e609d92c1d6cfcb74a391d9e9c9f87,backing_fmt=raw /opt/stack/data/nova/instances/f1fa7599-72de-487d-9b0e-0adf8c0120ca/disk 1073741824" returned: 0 in 0.062s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "8772755b70e609d92c1d6cfcb74a391d9e9c9f87" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8772755b70e609d92c1d6cfcb74a391d9e9c9f87 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8772755b70e609d92c1d6cfcb74a391d9e9c9f87 --force-share --output=json" returned: 0 in 0.184s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f1fa7599-72de-487d-9b0e-0adf8c0120ca/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1fa7599-72de-487d-9b0e-0adf8c0120ca/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG nova.network.neutron [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Updating instance_info_cache with network_info: [{"id": "4f594b38-986f-42c8-bb69-4caeabfe1b56", "address": "fa:16:3e:f0:fe:b5", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f594b38-98", "ovs_interfaceid": "4f594b38-986f-42c8-bb69-4caeabfe1b56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Releasing lock "refresh_cache-f1fa7599-72de-487d-9b0e-0adf8c0120ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG nova.compute.manager [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Instance network_info: |[{"id": "4f594b38-986f-42c8-bb69-4caeabfe1b56", "address": "fa:16:3e:f0:fe:b5", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f594b38-98", "ovs_interfaceid": "4f594b38-986f-42c8-bb69-4caeabfe1b56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b8565e1e-f225-4295-bdc2-359996c8ec5b req-b8e3bd56-2428-4558-9876-f2db97d21b33 service nova] Acquired lock "refresh_cache-f1fa7599-72de-487d-9b0e-0adf8c0120ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG nova.network.neutron [req-b8565e1e-f225-4295-bdc2-359996c8ec5b req-b8e3bd56-2428-4558-9876-f2db97d21b33 service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Refreshing network info cache for port 4f594b38-986f-42c8-bb69-4caeabfe1b56 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1fa7599-72de-487d-9b0e-0adf8c0120ca/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Cannot resize image /opt/stack/data/nova/instances/f1fa7599-72de-487d-9b0e-0adf8c0120ca/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Ensure instance console log exists: /opt/stack/data/nova/instances/f1fa7599-72de-487d-9b0e-0adf8c0120ca/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Start _get_guest_xml network_info=[{"id": "4f594b38-986f-42c8-bb69-4caeabfe1b56", "address": "fa:16:3e:f0:fe:b5", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f594b38-98", "ovs_interfaceid": "4f594b38-986f-42c8-bb69-4caeabfe1b56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:34:46Z,direct_url=<?>,disk_format='qcow2',id=3fe91fd7-2b21-49d2-861d-888133645deb,min_disk=0,min_ram=0,name='tempest-scenario-img--2133907814',owner='9ae441ca35d847e89eb99397fe167960',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:34:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '3fe91fd7-2b21-49d2-861d-888133645deb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:34:51 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:34:51 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:34:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:34:46Z,direct_url=<?>,disk_format='qcow2',id=3fe91fd7-2b21-49d2-861d-888133645deb,min_disk=0,min_ram=0,name='tempest-scenario-img--2133907814',owner='9ae441ca35d847e89eb99397fe167960',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:34:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:34:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-549290483',display_name='tempest-TestMinimumBasicScenario-server-549290483',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-549290483',id=41,image_ref='3fe91fd7-2b21-49d2-861d-888133645deb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFp0321fyFq5IIm16kujwtj0S2cVboytsRtGtxrq/1GtohTpLpvFdJjWsEqvcpe7am9mD7J7VLkWOe7vbZg3rj/Crv7hqi590DhxlWKDIwRe+6CMVAXZHeg50oax6vALiA==',key_name='tempest-TestMinimumBasicScenario-1558020918',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ae441ca35d847e89eb99397fe167960',ramdisk_id='',reservation_id='r-08yvfvzy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3fe91fd7-2b21-49d2-861d-888133645deb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1836970755',owner_user_name='tempest-TestMinimumBasicScenario-1836970755-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:34:49Z,user_data=None,user_id='948c44e55c7c404fb660394a747cf162',uuid=f1fa7599-72de-487d-9b0e-0adf8c0120ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f594b38-986f-42c8-bb69-4caeabfe1b56", "address": "fa:16:3e:f0:fe:b5", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f594b38-98", "ovs_interfaceid": "4f594b38-986f-42c8-bb69-4caeabfe1b56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:34:51 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Converting VIF {"id": "4f594b38-986f-42c8-bb69-4caeabfe1b56", "address": "fa:16:3e:f0:fe:b5", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f594b38-98", "ovs_interfaceid": "4f594b38-986f-42c8-bb69-4caeabfe1b56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:34:52 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:fe:b5,bridge_name='br-int',has_traffic_filtering=True,id=4f594b38-986f-42c8-bb69-4caeabfe1b56,network=Network(f11c42be-cba6-4e59-80b1-6fdd90a41c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f594b38-98') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:34:52 user nova-compute[73497]: DEBUG nova.objects.instance [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lazy-loading 'pci_devices' on Instance uuid f1fa7599-72de-487d-9b0e-0adf8c0120ca {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:34:52 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:34:52 user nova-compute[73497]:   <uuid>f1fa7599-72de-487d-9b0e-0adf8c0120ca</uuid>
Aug 26 23:34:52 user nova-compute[73497]:   <name>instance-00000029</name>
Aug 26 23:34:52 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:34:52 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:34:52 user nova-compute[73497]:   <metadata>
Aug 26 23:34:52 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:34:52 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:34:52 user nova-compute[73497]:       <nova:name>tempest-TestMinimumBasicScenario-server-549290483</nova:name>
Aug 26 23:34:52 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:34:51</nova:creationTime>
Aug 26 23:34:52 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:34:52 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:34:52 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:34:52 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:34:52 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:34:52 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:34:52 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:34:52 user nova-compute[73497]:       <nova:owner>
Aug 26 23:34:52 user nova-compute[73497]:         <nova:user uuid="948c44e55c7c404fb660394a747cf162">tempest-TestMinimumBasicScenario-1836970755-project-member</nova:user>
Aug 26 23:34:52 user nova-compute[73497]:         <nova:project uuid="9ae441ca35d847e89eb99397fe167960">tempest-TestMinimumBasicScenario-1836970755</nova:project>
Aug 26 23:34:52 user nova-compute[73497]:       </nova:owner>
Aug 26 23:34:52 user nova-compute[73497]:       <nova:root type="image" uuid="3fe91fd7-2b21-49d2-861d-888133645deb"/>
Aug 26 23:34:52 user nova-compute[73497]:       <nova:ports>
Aug 26 23:34:52 user nova-compute[73497]:         <nova:port uuid="4f594b38-986f-42c8-bb69-4caeabfe1b56">
Aug 26 23:34:52 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 23:34:52 user nova-compute[73497]:         </nova:port>
Aug 26 23:34:52 user nova-compute[73497]:       </nova:ports>
Aug 26 23:34:52 user nova-compute[73497]:     </nova:instance>
Aug 26 23:34:52 user nova-compute[73497]:   </metadata>
Aug 26 23:34:52 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:34:52 user nova-compute[73497]:     <system>
Aug 26 23:34:52 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:34:52 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:34:52 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:34:52 user nova-compute[73497]:       <entry name="serial">f1fa7599-72de-487d-9b0e-0adf8c0120ca</entry>
Aug 26 23:34:52 user nova-compute[73497]:       <entry name="uuid">f1fa7599-72de-487d-9b0e-0adf8c0120ca</entry>
Aug 26 23:34:52 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:34:52 user nova-compute[73497]:     </system>
Aug 26 23:34:52 user nova-compute[73497]:   </sysinfo>
Aug 26 23:34:52 user nova-compute[73497]:   <os>
Aug 26 23:34:52 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:34:52 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:34:52 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:34:52 user nova-compute[73497]:   </os>
Aug 26 23:34:52 user nova-compute[73497]:   <features>
Aug 26 23:34:52 user nova-compute[73497]:     <acpi/>
Aug 26 23:34:52 user nova-compute[73497]:     <apic/>
Aug 26 23:34:52 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:34:52 user nova-compute[73497]:   </features>
Aug 26 23:34:52 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:34:52 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:34:52 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:34:52 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:34:52 user nova-compute[73497]:   </clock>
Aug 26 23:34:52 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:34:52 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:34:52 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:34:52 user nova-compute[73497]:   </cpu>
Aug 26 23:34:52 user nova-compute[73497]:   <devices>
Aug 26 23:34:52 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:34:52 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:34:52 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/f1fa7599-72de-487d-9b0e-0adf8c0120ca/disk"/>
Aug 26 23:34:52 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:34:52 user nova-compute[73497]:     </disk>
Aug 26 23:34:52 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:34:52 user nova-compute[73497]:       <mac address="fa:16:3e:f0:fe:b5"/>
Aug 26 23:34:52 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:34:52 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:34:52 user nova-compute[73497]:       <target dev="tap4f594b38-98"/>
Aug 26 23:34:52 user nova-compute[73497]:     </interface>
Aug 26 23:34:52 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:34:52 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/f1fa7599-72de-487d-9b0e-0adf8c0120ca/console.log" append="off"/>
Aug 26 23:34:52 user nova-compute[73497]:     </serial>
Aug 26 23:34:52 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:34:52 user nova-compute[73497]:     <video>
Aug 26 23:34:52 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:34:52 user nova-compute[73497]:     </video>
Aug 26 23:34:52 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:34:52 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:34:52 user nova-compute[73497]:     </rng>
Aug 26 23:34:52 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:34:52 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:34:52 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:34:52 user nova-compute[73497]:     </memballoon>
Aug 26 23:34:52 user nova-compute[73497]:   </devices>
Aug 26 23:34:52 user nova-compute[73497]: </domain>
Aug 26 23:34:52 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:34:52 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:34:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-549290483',display_name='tempest-TestMinimumBasicScenario-server-549290483',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-549290483',id=41,image_ref='3fe91fd7-2b21-49d2-861d-888133645deb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFp0321fyFq5IIm16kujwtj0S2cVboytsRtGtxrq/1GtohTpLpvFdJjWsEqvcpe7am9mD7J7VLkWOe7vbZg3rj/Crv7hqi590DhxlWKDIwRe+6CMVAXZHeg50oax6vALiA==',key_name='tempest-TestMinimumBasicScenario-1558020918',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ae441ca35d847e89eb99397fe167960',ramdisk_id='',reservation_id='r-08yvfvzy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3fe91fd7-2b21-49d2-861d-888133645deb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1836970755',owner_user_name='tempest-TestMinimumBasicScenario-1836970755-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:34:49Z,user_data=None,user_id='948c44e55c7c404fb660394a747cf162',uuid=f1fa7599-72de-487d-9b0e-0adf8c0120ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f594b38-986f-42c8-bb69-4caeabfe1b56", "address": "fa:16:3e:f0:fe:b5", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f594b38-98", "ovs_interfaceid": "4f594b38-986f-42c8-bb69-4caeabfe1b56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:34:52 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Converting VIF {"id": "4f594b38-986f-42c8-bb69-4caeabfe1b56", "address": "fa:16:3e:f0:fe:b5", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f594b38-98", "ovs_interfaceid": "4f594b38-986f-42c8-bb69-4caeabfe1b56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:34:52 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:fe:b5,bridge_name='br-int',has_traffic_filtering=True,id=4f594b38-986f-42c8-bb69-4caeabfe1b56,network=Network(f11c42be-cba6-4e59-80b1-6fdd90a41c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f594b38-98') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:34:52 user nova-compute[73497]: DEBUG os_vif [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:fe:b5,bridge_name='br-int',has_traffic_filtering=True,id=4f594b38-986f-42c8-bb69-4caeabfe1b56,network=Network(f11c42be-cba6-4e59-80b1-6fdd90a41c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f594b38-98') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:34:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:34:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:34:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f594b38-98, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:34:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4f594b38-98, col_values=(('external_ids', {'iface-id': '4f594b38-986f-42c8-bb69-4caeabfe1b56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:fe:b5', 'vm-uuid': 'f1fa7599-72de-487d-9b0e-0adf8c0120ca'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:34:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:34:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:52 user nova-compute[73497]: INFO os_vif [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:fe:b5,bridge_name='br-int',has_traffic_filtering=True,id=4f594b38-986f-42c8-bb69-4caeabfe1b56,network=Network(f11c42be-cba6-4e59-80b1-6fdd90a41c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f594b38-98')
Aug 26 23:34:52 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:34:52 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] No VIF found with MAC fa:16:3e:f0:fe:b5, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:34:52 user nova-compute[73497]: DEBUG nova.network.neutron [req-b8565e1e-f225-4295-bdc2-359996c8ec5b req-b8e3bd56-2428-4558-9876-f2db97d21b33 service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Updated VIF entry in instance network info cache for port 4f594b38-986f-42c8-bb69-4caeabfe1b56. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:34:52 user nova-compute[73497]: DEBUG nova.network.neutron [req-b8565e1e-f225-4295-bdc2-359996c8ec5b req-b8e3bd56-2428-4558-9876-f2db97d21b33 service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Updating instance_info_cache with network_info: [{"id": "4f594b38-986f-42c8-bb69-4caeabfe1b56", "address": "fa:16:3e:f0:fe:b5", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f594b38-98", "ovs_interfaceid": "4f594b38-986f-42c8-bb69-4caeabfe1b56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:34:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-b8565e1e-f225-4295-bdc2-359996c8ec5b req-b8e3bd56-2428-4558-9876-f2db97d21b33 service nova] Releasing lock "refresh_cache-f1fa7599-72de-487d-9b0e-0adf8c0120ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:34:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:53 user nova-compute[73497]: DEBUG nova.compute.manager [req-5dfb2473-8e6c-4732-8454-cba820d76c2a req-b164de83-4889-4c8e-b953-66c93da8eefe service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Received event network-vif-plugged-4f594b38-986f-42c8-bb69-4caeabfe1b56 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:34:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-5dfb2473-8e6c-4732-8454-cba820d76c2a req-b164de83-4889-4c8e-b953-66c93da8eefe service nova] Acquiring lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:34:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-5dfb2473-8e6c-4732-8454-cba820d76c2a req-b164de83-4889-4c8e-b953-66c93da8eefe service nova] Lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:34:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-5dfb2473-8e6c-4732-8454-cba820d76c2a req-b164de83-4889-4c8e-b953-66c93da8eefe service nova] Lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:34:53 user nova-compute[73497]: DEBUG nova.compute.manager [req-5dfb2473-8e6c-4732-8454-cba820d76c2a req-b164de83-4889-4c8e-b953-66c93da8eefe service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] No waiting events found dispatching network-vif-plugged-4f594b38-986f-42c8-bb69-4caeabfe1b56 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:34:53 user nova-compute[73497]: WARNING nova.compute.manager [req-5dfb2473-8e6c-4732-8454-cba820d76c2a req-b164de83-4889-4c8e-b953-66c93da8eefe service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Received unexpected event network-vif-plugged-4f594b38-986f-42c8-bb69-4caeabfe1b56 for instance with vm_state building and task_state spawning.
Aug 26 23:34:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:55 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092895.5626366, f1fa7599-72de-487d-9b0e-0adf8c0120ca => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:34:55 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] VM Resumed (Lifecycle Event)
Aug 26 23:34:55 user nova-compute[73497]: DEBUG nova.compute.manager [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:34:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:34:55 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Instance spawned successfully.
Aug 26 23:34:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:34:55 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:34:55 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:34:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:34:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:34:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:34:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:34:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:34:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:34:55 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:34:55 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092895.567185, f1fa7599-72de-487d-9b0e-0adf8c0120ca => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:34:55 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] VM Started (Lifecycle Event)
Aug 26 23:34:55 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:34:55 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:34:55 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:34:55 user nova-compute[73497]: DEBUG nova.compute.manager [req-8663cc2a-fb5b-48b6-a402-eee2dba695a8 req-0d2deb29-b053-4f20-8859-68b903852e74 service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Received event network-vif-plugged-4f594b38-986f-42c8-bb69-4caeabfe1b56 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:34:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8663cc2a-fb5b-48b6-a402-eee2dba695a8 req-0d2deb29-b053-4f20-8859-68b903852e74 service nova] Acquiring lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:34:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8663cc2a-fb5b-48b6-a402-eee2dba695a8 req-0d2deb29-b053-4f20-8859-68b903852e74 service nova] Lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:34:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8663cc2a-fb5b-48b6-a402-eee2dba695a8 req-0d2deb29-b053-4f20-8859-68b903852e74 service nova] Lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:34:55 user nova-compute[73497]: DEBUG nova.compute.manager [req-8663cc2a-fb5b-48b6-a402-eee2dba695a8 req-0d2deb29-b053-4f20-8859-68b903852e74 service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] No waiting events found dispatching network-vif-plugged-4f594b38-986f-42c8-bb69-4caeabfe1b56 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:34:55 user nova-compute[73497]: WARNING nova.compute.manager [req-8663cc2a-fb5b-48b6-a402-eee2dba695a8 req-0d2deb29-b053-4f20-8859-68b903852e74 service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Received unexpected event network-vif-plugged-4f594b38-986f-42c8-bb69-4caeabfe1b56 for instance with vm_state building and task_state spawning.
Aug 26 23:34:55 user nova-compute[73497]: INFO nova.compute.manager [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Took 6.26 seconds to spawn the instance on the hypervisor.
Aug 26 23:34:55 user nova-compute[73497]: DEBUG nova.compute.manager [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:34:55 user nova-compute[73497]: INFO nova.compute.manager [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Took 7.04 seconds to build instance.
Aug 26 23:34:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-35c62e85-7013-4d2b-808c-ea4c425672a1 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.137s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:34:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:34:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:01 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:35:01 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:35:01 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:35:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:35:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:35:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:35:01 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:35:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358ed2d7-4452-40cf-9fed-d9a8e45b5c99/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:35:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358ed2d7-4452-40cf-9fed-d9a8e45b5c99/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:35:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358ed2d7-4452-40cf-9fed-d9a8e45b5c99/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:35:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358ed2d7-4452-40cf-9fed-d9a8e45b5c99/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:35:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:35:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:35:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:35:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:35:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2d2380-d861-46c4-b13c-36b4f48cca77/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:35:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2d2380-d861-46c4-b13c-36b4f48cca77/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:35:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2d2380-d861-46c4-b13c-36b4f48cca77/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:35:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2d2380-d861-46c4-b13c-36b4f48cca77/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:35:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:35:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:35:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:35:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:35:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:35:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:35:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:35:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:35:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:35:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:35:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:35:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:35:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1fa7599-72de-487d-9b0e-0adf8c0120ca/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:35:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1fa7599-72de-487d-9b0e-0adf8c0120ca/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:35:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1fa7599-72de-487d-9b0e-0adf8c0120ca/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:35:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1fa7599-72de-487d-9b0e-0adf8c0120ca/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:35:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:35:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:35:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:35:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:35:05 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:35:05 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:35:05 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=7711MB free_disk=25.082427978515625GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:35:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:35:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:35:05 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 043294e5-0618-4a31-bb19-1227ef1f5d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:35:05 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance e9e5c83f-0678-48d4-a81f-1a3f959aabcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:35:05 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance f7c83073-fadc-4e41-a4a9-df0bbe11aa28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:35:05 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance db489468-154b-4238-8b81-f8fa2bc016b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:35:05 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 2b2d2380-d861-46c4-b13c-36b4f48cca77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:35:05 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 358ed2d7-4452-40cf-9fed-d9a8e45b5c99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:35:05 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance f1fa7599-72de-487d-9b0e-0adf8c0120ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:35:05 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:35:05 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:35:05 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:35:05 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:35:05 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:35:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.462s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:35:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:07 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:35:08 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:35:09 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:35:09 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:35:10 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:35:10 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:35:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:12 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:35:12 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:35:12 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Rebuilding the list of instances to heal {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 23:35:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-043294e5-0618-4a31-bb19-1227ef1f5d39" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:35:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-043294e5-0618-4a31-bb19-1227ef1f5d39" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:35:12 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:35:12 user nova-compute[73497]: DEBUG nova.objects.instance [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lazy-loading 'info_cache' on Instance uuid 043294e5-0618-4a31-bb19-1227ef1f5d39 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:35:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:12 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Updating instance_info_cache with network_info: [{"id": "de273950-9851-448e-8ca2-ac699c12994e", "address": "fa:16:3e:fe:2b:69", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde273950-98", "ovs_interfaceid": "de273950-9851-448e-8ca2-ac699c12994e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:35:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-043294e5-0618-4a31-bb19-1227ef1f5d39" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:35:12 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:35:15 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:35:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-dc648c9d-1665-4ed8-ab94-f638ad788ded tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:35:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-dc648c9d-1665-4ed8-ab94-f638ad788ded tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:35:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-dc648c9d-1665-4ed8-ab94-f638ad788ded tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:35:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-dc648c9d-1665-4ed8-ab94-f638ad788ded tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:35:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-dc648c9d-1665-4ed8-ab94-f638ad788ded tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:35:16 user nova-compute[73497]: INFO nova.compute.manager [None req-dc648c9d-1665-4ed8-ab94-f638ad788ded tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Terminating instance
Aug 26 23:35:16 user nova-compute[73497]: DEBUG nova.compute.manager [None req-dc648c9d-1665-4ed8-ab94-f638ad788ded tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:35:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:16 user nova-compute[73497]: DEBUG nova.compute.manager [req-f6c5bf71-7508-481e-8f26-f51579a8315d req-a92c1f2b-beaa-4d3f-b480-9af9067543ae service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Received event network-vif-unplugged-3de77772-78de-4261-b064-d1c2d8e30b31 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:35:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f6c5bf71-7508-481e-8f26-f51579a8315d req-a92c1f2b-beaa-4d3f-b480-9af9067543ae service nova] Acquiring lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:35:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f6c5bf71-7508-481e-8f26-f51579a8315d req-a92c1f2b-beaa-4d3f-b480-9af9067543ae service nova] Lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:35:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f6c5bf71-7508-481e-8f26-f51579a8315d req-a92c1f2b-beaa-4d3f-b480-9af9067543ae service nova] Lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:35:16 user nova-compute[73497]: DEBUG nova.compute.manager [req-f6c5bf71-7508-481e-8f26-f51579a8315d req-a92c1f2b-beaa-4d3f-b480-9af9067543ae service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] No waiting events found dispatching network-vif-unplugged-3de77772-78de-4261-b064-d1c2d8e30b31 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:35:16 user nova-compute[73497]: DEBUG nova.compute.manager [req-f6c5bf71-7508-481e-8f26-f51579a8315d req-a92c1f2b-beaa-4d3f-b480-9af9067543ae service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Received event network-vif-unplugged-3de77772-78de-4261-b064-d1c2d8e30b31 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:35:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:17 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Instance destroyed successfully.
Aug 26 23:35:17 user nova-compute[73497]: DEBUG nova.objects.instance [None req-dc648c9d-1665-4ed8-ab94-f638ad788ded tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lazy-loading 'resources' on Instance uuid e9e5c83f-0678-48d4-a81f-1a3f959aabcf {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:35:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-dc648c9d-1665-4ed8-ab94-f638ad788ded tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:18:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-10306177',display_name='tempest-ServerRescueNegativeTestJSON-server-10306177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-10306177',id=20,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:20:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c4ca787dd33440d98779668507369ee',ramdisk_id='',reservation_id='r-x1p8i7zq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1946187856',owner_user_name='tempest-ServerRescueNegativeTestJSON-1946187856-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:20:46Z,user_data=None,user_id='af64aa253eec41a0976c3e527fe41831',uuid=e9e5c83f-0678-48d4-a81f-1a3f959aabcf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "3de77772-78de-4261-b064-d1c2d8e30b31", "address": "fa:16:3e:d7:8d:5d", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de77772-78", "ovs_interfaceid": "3de77772-78de-4261-b064-d1c2d8e30b31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:35:17 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-dc648c9d-1665-4ed8-ab94-f638ad788ded tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Converting VIF {"id": "3de77772-78de-4261-b064-d1c2d8e30b31", "address": "fa:16:3e:d7:8d:5d", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de77772-78", "ovs_interfaceid": "3de77772-78de-4261-b064-d1c2d8e30b31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:35:17 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-dc648c9d-1665-4ed8-ab94-f638ad788ded tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:8d:5d,bridge_name='br-int',has_traffic_filtering=True,id=3de77772-78de-4261-b064-d1c2d8e30b31,network=Network(6f13f07f-104d-4d8d-b5fa-afa402402a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de77772-78') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:35:17 user nova-compute[73497]: DEBUG os_vif [None req-dc648c9d-1665-4ed8-ab94-f638ad788ded tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:8d:5d,bridge_name='br-int',has_traffic_filtering=True,id=3de77772-78de-4261-b064-d1c2d8e30b31,network=Network(6f13f07f-104d-4d8d-b5fa-afa402402a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de77772-78') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:35:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3de77772-78, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:35:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:35:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:17 user nova-compute[73497]: INFO os_vif [None req-dc648c9d-1665-4ed8-ab94-f638ad788ded tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:8d:5d,bridge_name='br-int',has_traffic_filtering=True,id=3de77772-78de-4261-b064-d1c2d8e30b31,network=Network(6f13f07f-104d-4d8d-b5fa-afa402402a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de77772-78')
Aug 26 23:35:17 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-dc648c9d-1665-4ed8-ab94-f638ad788ded tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Deleting instance files /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf_del
Aug 26 23:35:17 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-dc648c9d-1665-4ed8-ab94-f638ad788ded tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Deletion of /opt/stack/data/nova/instances/e9e5c83f-0678-48d4-a81f-1a3f959aabcf_del complete
Aug 26 23:35:17 user nova-compute[73497]: INFO nova.compute.manager [None req-dc648c9d-1665-4ed8-ab94-f638ad788ded tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 26 23:35:17 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-dc648c9d-1665-4ed8-ab94-f638ad788ded tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:35:17 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:35:17 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:35:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:18 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:35:18 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Took 0.94 seconds to deallocate network for instance.
Aug 26 23:35:18 user nova-compute[73497]: DEBUG nova.compute.manager [req-2de12016-561f-4d19-8d27-e29547a1aadd req-119fc244-0204-4815-b916-f814c037b8ea service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Received event network-vif-deleted-3de77772-78de-4261-b064-d1c2d8e30b31 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:35:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-dc648c9d-1665-4ed8-ab94-f638ad788ded tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:35:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-dc648c9d-1665-4ed8-ab94-f638ad788ded tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:35:18 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-dc648c9d-1665-4ed8-ab94-f638ad788ded tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Refreshing inventories for resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 23:35:18 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-dc648c9d-1665-4ed8-ab94-f638ad788ded tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Updating ProviderTree inventory for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 23:35:18 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-dc648c9d-1665-4ed8-ab94-f638ad788ded tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Updating inventory in ProviderTree for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 23:35:18 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-dc648c9d-1665-4ed8-ab94-f638ad788ded tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Refreshing aggregate associations for resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1, aggregates: None {{(pid=73497) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 23:35:18 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-dc648c9d-1665-4ed8-ab94-f638ad788ded tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Refreshing trait associations for resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING {{(pid=73497) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 23:35:18 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-dc648c9d-1665-4ed8-ab94-f638ad788ded tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:35:18 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-dc648c9d-1665-4ed8-ab94-f638ad788ded tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:35:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-dc648c9d-1665-4ed8-ab94-f638ad788ded tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:35:18 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-dc648c9d-1665-4ed8-ab94-f638ad788ded tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Deleted allocations for instance e9e5c83f-0678-48d4-a81f-1a3f959aabcf
Aug 26 23:35:18 user nova-compute[73497]: DEBUG nova.compute.manager [req-0444b88d-69a3-41ad-9b4f-b899704ac7a7 req-22f17ce5-d7d2-4545-abbb-ae0c5d37cd51 service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Received event network-vif-plugged-3de77772-78de-4261-b064-d1c2d8e30b31 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:35:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0444b88d-69a3-41ad-9b4f-b899704ac7a7 req-22f17ce5-d7d2-4545-abbb-ae0c5d37cd51 service nova] Acquiring lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:35:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0444b88d-69a3-41ad-9b4f-b899704ac7a7 req-22f17ce5-d7d2-4545-abbb-ae0c5d37cd51 service nova] Lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:35:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0444b88d-69a3-41ad-9b4f-b899704ac7a7 req-22f17ce5-d7d2-4545-abbb-ae0c5d37cd51 service nova] Lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:35:18 user nova-compute[73497]: DEBUG nova.compute.manager [req-0444b88d-69a3-41ad-9b4f-b899704ac7a7 req-22f17ce5-d7d2-4545-abbb-ae0c5d37cd51 service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] No waiting events found dispatching network-vif-plugged-3de77772-78de-4261-b064-d1c2d8e30b31 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:35:18 user nova-compute[73497]: WARNING nova.compute.manager [req-0444b88d-69a3-41ad-9b4f-b899704ac7a7 req-22f17ce5-d7d2-4545-abbb-ae0c5d37cd51 service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Received unexpected event network-vif-plugged-3de77772-78de-4261-b064-d1c2d8e30b31 for instance with vm_state deleted and task_state None.
Aug 26 23:35:18 user nova-compute[73497]: DEBUG nova.compute.manager [req-0444b88d-69a3-41ad-9b4f-b899704ac7a7 req-22f17ce5-d7d2-4545-abbb-ae0c5d37cd51 service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Received event network-vif-plugged-3de77772-78de-4261-b064-d1c2d8e30b31 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:35:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0444b88d-69a3-41ad-9b4f-b899704ac7a7 req-22f17ce5-d7d2-4545-abbb-ae0c5d37cd51 service nova] Acquiring lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:35:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0444b88d-69a3-41ad-9b4f-b899704ac7a7 req-22f17ce5-d7d2-4545-abbb-ae0c5d37cd51 service nova] Lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:35:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0444b88d-69a3-41ad-9b4f-b899704ac7a7 req-22f17ce5-d7d2-4545-abbb-ae0c5d37cd51 service nova] Lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:35:18 user nova-compute[73497]: DEBUG nova.compute.manager [req-0444b88d-69a3-41ad-9b4f-b899704ac7a7 req-22f17ce5-d7d2-4545-abbb-ae0c5d37cd51 service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] No waiting events found dispatching network-vif-plugged-3de77772-78de-4261-b064-d1c2d8e30b31 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:35:18 user nova-compute[73497]: WARNING nova.compute.manager [req-0444b88d-69a3-41ad-9b4f-b899704ac7a7 req-22f17ce5-d7d2-4545-abbb-ae0c5d37cd51 service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Received unexpected event network-vif-plugged-3de77772-78de-4261-b064-d1c2d8e30b31 for instance with vm_state deleted and task_state None.
Aug 26 23:35:18 user nova-compute[73497]: DEBUG nova.compute.manager [req-0444b88d-69a3-41ad-9b4f-b899704ac7a7 req-22f17ce5-d7d2-4545-abbb-ae0c5d37cd51 service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Received event network-vif-plugged-3de77772-78de-4261-b064-d1c2d8e30b31 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:35:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0444b88d-69a3-41ad-9b4f-b899704ac7a7 req-22f17ce5-d7d2-4545-abbb-ae0c5d37cd51 service nova] Acquiring lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:35:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0444b88d-69a3-41ad-9b4f-b899704ac7a7 req-22f17ce5-d7d2-4545-abbb-ae0c5d37cd51 service nova] Lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:35:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0444b88d-69a3-41ad-9b4f-b899704ac7a7 req-22f17ce5-d7d2-4545-abbb-ae0c5d37cd51 service nova] Lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:35:18 user nova-compute[73497]: DEBUG nova.compute.manager [req-0444b88d-69a3-41ad-9b4f-b899704ac7a7 req-22f17ce5-d7d2-4545-abbb-ae0c5d37cd51 service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] No waiting events found dispatching network-vif-plugged-3de77772-78de-4261-b064-d1c2d8e30b31 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:35:18 user nova-compute[73497]: WARNING nova.compute.manager [req-0444b88d-69a3-41ad-9b4f-b899704ac7a7 req-22f17ce5-d7d2-4545-abbb-ae0c5d37cd51 service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Received unexpected event network-vif-plugged-3de77772-78de-4261-b064-d1c2d8e30b31 for instance with vm_state deleted and task_state None.
Aug 26 23:35:18 user nova-compute[73497]: DEBUG nova.compute.manager [req-0444b88d-69a3-41ad-9b4f-b899704ac7a7 req-22f17ce5-d7d2-4545-abbb-ae0c5d37cd51 service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Received event network-vif-unplugged-3de77772-78de-4261-b064-d1c2d8e30b31 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:35:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0444b88d-69a3-41ad-9b4f-b899704ac7a7 req-22f17ce5-d7d2-4545-abbb-ae0c5d37cd51 service nova] Acquiring lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:35:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0444b88d-69a3-41ad-9b4f-b899704ac7a7 req-22f17ce5-d7d2-4545-abbb-ae0c5d37cd51 service nova] Lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:35:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0444b88d-69a3-41ad-9b4f-b899704ac7a7 req-22f17ce5-d7d2-4545-abbb-ae0c5d37cd51 service nova] Lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:35:18 user nova-compute[73497]: DEBUG nova.compute.manager [req-0444b88d-69a3-41ad-9b4f-b899704ac7a7 req-22f17ce5-d7d2-4545-abbb-ae0c5d37cd51 service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] No waiting events found dispatching network-vif-unplugged-3de77772-78de-4261-b064-d1c2d8e30b31 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:35:18 user nova-compute[73497]: WARNING nova.compute.manager [req-0444b88d-69a3-41ad-9b4f-b899704ac7a7 req-22f17ce5-d7d2-4545-abbb-ae0c5d37cd51 service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Received unexpected event network-vif-unplugged-3de77772-78de-4261-b064-d1c2d8e30b31 for instance with vm_state deleted and task_state None.
Aug 26 23:35:18 user nova-compute[73497]: DEBUG nova.compute.manager [req-0444b88d-69a3-41ad-9b4f-b899704ac7a7 req-22f17ce5-d7d2-4545-abbb-ae0c5d37cd51 service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Received event network-vif-plugged-3de77772-78de-4261-b064-d1c2d8e30b31 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:35:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0444b88d-69a3-41ad-9b4f-b899704ac7a7 req-22f17ce5-d7d2-4545-abbb-ae0c5d37cd51 service nova] Acquiring lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:35:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0444b88d-69a3-41ad-9b4f-b899704ac7a7 req-22f17ce5-d7d2-4545-abbb-ae0c5d37cd51 service nova] Lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:35:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-0444b88d-69a3-41ad-9b4f-b899704ac7a7 req-22f17ce5-d7d2-4545-abbb-ae0c5d37cd51 service nova] Lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:35:18 user nova-compute[73497]: DEBUG nova.compute.manager [req-0444b88d-69a3-41ad-9b4f-b899704ac7a7 req-22f17ce5-d7d2-4545-abbb-ae0c5d37cd51 service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] No waiting events found dispatching network-vif-plugged-3de77772-78de-4261-b064-d1c2d8e30b31 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:35:18 user nova-compute[73497]: WARNING nova.compute.manager [req-0444b88d-69a3-41ad-9b4f-b899704ac7a7 req-22f17ce5-d7d2-4545-abbb-ae0c5d37cd51 service nova] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Received unexpected event network-vif-plugged-3de77772-78de-4261-b064-d1c2d8e30b31 for instance with vm_state deleted and task_state None.
Aug 26 23:35:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-dc648c9d-1665-4ed8-ab94-f638ad788ded tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "e9e5c83f-0678-48d4-a81f-1a3f959aabcf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.382s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:35:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0242b715-4256-4720-8e45-5511b93421a3 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:35:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0242b715-4256-4720-8e45-5511b93421a3 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:35:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0242b715-4256-4720-8e45-5511b93421a3 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:35:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0242b715-4256-4720-8e45-5511b93421a3 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:35:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0242b715-4256-4720-8e45-5511b93421a3 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:35:22 user nova-compute[73497]: INFO nova.compute.manager [None req-0242b715-4256-4720-8e45-5511b93421a3 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Terminating instance
Aug 26 23:35:22 user nova-compute[73497]: DEBUG nova.compute.manager [None req-0242b715-4256-4720-8e45-5511b93421a3 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:35:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:22 user nova-compute[73497]: DEBUG nova.compute.manager [req-9a79dbc4-6511-47dc-984e-ec1e1b8e7041 req-bae951f3-4831-40f7-9405-b651d504c2a8 service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Received event network-vif-unplugged-74cddf0f-c302-4ae4-8142-cee5764c7c4f {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:35:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9a79dbc4-6511-47dc-984e-ec1e1b8e7041 req-bae951f3-4831-40f7-9405-b651d504c2a8 service nova] Acquiring lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:35:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9a79dbc4-6511-47dc-984e-ec1e1b8e7041 req-bae951f3-4831-40f7-9405-b651d504c2a8 service nova] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:35:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9a79dbc4-6511-47dc-984e-ec1e1b8e7041 req-bae951f3-4831-40f7-9405-b651d504c2a8 service nova] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:35:22 user nova-compute[73497]: DEBUG nova.compute.manager [req-9a79dbc4-6511-47dc-984e-ec1e1b8e7041 req-bae951f3-4831-40f7-9405-b651d504c2a8 service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] No waiting events found dispatching network-vif-unplugged-74cddf0f-c302-4ae4-8142-cee5764c7c4f {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:35:22 user nova-compute[73497]: DEBUG nova.compute.manager [req-9a79dbc4-6511-47dc-984e-ec1e1b8e7041 req-bae951f3-4831-40f7-9405-b651d504c2a8 service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Received event network-vif-unplugged-74cddf0f-c302-4ae4-8142-cee5764c7c4f for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:35:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:22 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Instance destroyed successfully.
Aug 26 23:35:22 user nova-compute[73497]: DEBUG nova.objects.instance [None req-0242b715-4256-4720-8e45-5511b93421a3 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lazy-loading 'resources' on Instance uuid f7c83073-fadc-4e41-a4a9-df0bbe11aa28 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:35:22 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-0242b715-4256-4720-8e45-5511b93421a3 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:25:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1284261730',display_name='tempest-AttachVolumeTestJSON-server-1284261730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1284261730',id=31,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtZgj4CGRRq60nfzAmpM6NX6cbyiNr74c5vhKfLzmguuh54ComCQsitet6gqTOyy+exSU8a+OQZBMej3fWkPoWF9yZ7g9PDakdqjlJxgeAQgaLAVOiZs3e4Hh+0HK9qHg==',key_name='tempest-keypair-1578893874',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:25:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e10f2d1336284b42a8dcbb05e509e9bd',ramdisk_id='',reservation_id='r-awwb3svr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1929388969',owner_user_name='tempest-AttachVolumeTestJSON-1929388969-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:33:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e2c1f8d06854e579ee634e33e6de920',uuid=f7c83073-fadc-4e41-a4a9-df0bbe11aa28,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "address": "fa:16:3e:cf:bd:9e", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74cddf0f-c3", "ovs_interfaceid": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:35:22 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-0242b715-4256-4720-8e45-5511b93421a3 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Converting VIF {"id": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "address": "fa:16:3e:cf:bd:9e", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74cddf0f-c3", "ovs_interfaceid": "74cddf0f-c302-4ae4-8142-cee5764c7c4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:35:22 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-0242b715-4256-4720-8e45-5511b93421a3 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:bd:9e,bridge_name='br-int',has_traffic_filtering=True,id=74cddf0f-c302-4ae4-8142-cee5764c7c4f,network=Network(77d468df-32fe-45fb-afe7-7ebf9b6b428f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74cddf0f-c3') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:35:22 user nova-compute[73497]: DEBUG os_vif [None req-0242b715-4256-4720-8e45-5511b93421a3 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:bd:9e,bridge_name='br-int',has_traffic_filtering=True,id=74cddf0f-c302-4ae4-8142-cee5764c7c4f,network=Network(77d468df-32fe-45fb-afe7-7ebf9b6b428f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74cddf0f-c3') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:35:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74cddf0f-c3, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:35:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:35:22 user nova-compute[73497]: INFO os_vif [None req-0242b715-4256-4720-8e45-5511b93421a3 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:bd:9e,bridge_name='br-int',has_traffic_filtering=True,id=74cddf0f-c302-4ae4-8142-cee5764c7c4f,network=Network(77d468df-32fe-45fb-afe7-7ebf9b6b428f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74cddf0f-c3')
Aug 26 23:35:22 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-0242b715-4256-4720-8e45-5511b93421a3 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Deleting instance files /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28_del
Aug 26 23:35:22 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-0242b715-4256-4720-8e45-5511b93421a3 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Deletion of /opt/stack/data/nova/instances/f7c83073-fadc-4e41-a4a9-df0bbe11aa28_del complete
Aug 26 23:35:23 user nova-compute[73497]: INFO nova.compute.manager [None req-0242b715-4256-4720-8e45-5511b93421a3 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 26 23:35:23 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-0242b715-4256-4720-8e45-5511b93421a3 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:35:23 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:35:23 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:35:23 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:35:23 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Took 0.86 seconds to deallocate network for instance.
Aug 26 23:35:23 user nova-compute[73497]: DEBUG nova.compute.manager [req-39346f14-1327-4bd1-aa8d-1fbd2e2e6ee8 req-c886a0ab-376e-4c3b-8e79-6de7707fd901 service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Received event network-vif-deleted-74cddf0f-c302-4ae4-8142-cee5764c7c4f {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:35:23 user nova-compute[73497]: INFO nova.compute.manager [req-39346f14-1327-4bd1-aa8d-1fbd2e2e6ee8 req-c886a0ab-376e-4c3b-8e79-6de7707fd901 service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Neutron deleted interface 74cddf0f-c302-4ae4-8142-cee5764c7c4f; detaching it from the instance and deleting it from the info cache
Aug 26 23:35:23 user nova-compute[73497]: DEBUG nova.network.neutron [req-39346f14-1327-4bd1-aa8d-1fbd2e2e6ee8 req-c886a0ab-376e-4c3b-8e79-6de7707fd901 service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:35:23 user nova-compute[73497]: DEBUG nova.compute.manager [req-39346f14-1327-4bd1-aa8d-1fbd2e2e6ee8 req-c886a0ab-376e-4c3b-8e79-6de7707fd901 service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Detach interface failed, port_id=74cddf0f-c302-4ae4-8142-cee5764c7c4f, reason: Instance f7c83073-fadc-4e41-a4a9-df0bbe11aa28 could not be found. {{(pid=73497) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 23:35:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0242b715-4256-4720-8e45-5511b93421a3 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:35:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0242b715-4256-4720-8e45-5511b93421a3 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:35:24 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-0242b715-4256-4720-8e45-5511b93421a3 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:35:24 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-0242b715-4256-4720-8e45-5511b93421a3 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:35:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0242b715-4256-4720-8e45-5511b93421a3 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.258s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:35:24 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-0242b715-4256-4720-8e45-5511b93421a3 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Deleted allocations for instance f7c83073-fadc-4e41-a4a9-df0bbe11aa28
Aug 26 23:35:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0242b715-4256-4720-8e45-5511b93421a3 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.207s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:35:24 user nova-compute[73497]: DEBUG nova.compute.manager [req-1b998338-2d78-44c2-8a4b-92cad4560ebb req-9c0a363c-cb62-4c52-b974-e7fc13676801 service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Received event network-vif-plugged-74cddf0f-c302-4ae4-8142-cee5764c7c4f {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:35:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1b998338-2d78-44c2-8a4b-92cad4560ebb req-9c0a363c-cb62-4c52-b974-e7fc13676801 service nova] Acquiring lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:35:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1b998338-2d78-44c2-8a4b-92cad4560ebb req-9c0a363c-cb62-4c52-b974-e7fc13676801 service nova] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:35:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1b998338-2d78-44c2-8a4b-92cad4560ebb req-9c0a363c-cb62-4c52-b974-e7fc13676801 service nova] Lock "f7c83073-fadc-4e41-a4a9-df0bbe11aa28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:35:24 user nova-compute[73497]: DEBUG nova.compute.manager [req-1b998338-2d78-44c2-8a4b-92cad4560ebb req-9c0a363c-cb62-4c52-b974-e7fc13676801 service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] No waiting events found dispatching network-vif-plugged-74cddf0f-c302-4ae4-8142-cee5764c7c4f {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:35:24 user nova-compute[73497]: WARNING nova.compute.manager [req-1b998338-2d78-44c2-8a4b-92cad4560ebb req-9c0a363c-cb62-4c52-b974-e7fc13676801 service nova] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Received unexpected event network-vif-plugged-74cddf0f-c302-4ae4-8142-cee5764c7c4f for instance with vm_state deleted and task_state None.
Aug 26 23:35:25 user nova-compute[73497]: DEBUG nova.compute.manager [req-3a45814f-406c-489b-975b-d41ec935dcdf req-f564b8a2-fe9e-427e-91b0-59cf24a7210e service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Received event network-changed-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:35:25 user nova-compute[73497]: DEBUG nova.compute.manager [req-3a45814f-406c-489b-975b-d41ec935dcdf req-f564b8a2-fe9e-427e-91b0-59cf24a7210e service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Refreshing instance network info cache due to event network-changed-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:35:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3a45814f-406c-489b-975b-d41ec935dcdf req-f564b8a2-fe9e-427e-91b0-59cf24a7210e service nova] Acquiring lock "refresh_cache-db489468-154b-4238-8b81-f8fa2bc016b7" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:35:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3a45814f-406c-489b-975b-d41ec935dcdf req-f564b8a2-fe9e-427e-91b0-59cf24a7210e service nova] Acquired lock "refresh_cache-db489468-154b-4238-8b81-f8fa2bc016b7" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:35:25 user nova-compute[73497]: DEBUG nova.network.neutron [req-3a45814f-406c-489b-975b-d41ec935dcdf req-f564b8a2-fe9e-427e-91b0-59cf24a7210e service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Refreshing network info cache for port fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:35:26 user nova-compute[73497]: DEBUG nova.network.neutron [req-3a45814f-406c-489b-975b-d41ec935dcdf req-f564b8a2-fe9e-427e-91b0-59cf24a7210e service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Updated VIF entry in instance network info cache for port fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:35:26 user nova-compute[73497]: DEBUG nova.network.neutron [req-3a45814f-406c-489b-975b-d41ec935dcdf req-f564b8a2-fe9e-427e-91b0-59cf24a7210e service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Updating instance_info_cache with network_info: [{"id": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "address": "fa:16:3e:ad:7f:ad", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc782cdf-fe", "ovs_interfaceid": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:35:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-3a45814f-406c-489b-975b-d41ec935dcdf req-f564b8a2-fe9e-427e-91b0-59cf24a7210e service nova] Releasing lock "refresh_cache-db489468-154b-4238-8b81-f8fa2bc016b7" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:35:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b0cde06a-a733-4fb1-abac-3b1d28a8e93c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "db489468-154b-4238-8b81-f8fa2bc016b7" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:35:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b0cde06a-a733-4fb1-abac-3b1d28a8e93c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "db489468-154b-4238-8b81-f8fa2bc016b7" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:35:31 user nova-compute[73497]: INFO nova.compute.manager [None req-b0cde06a-a733-4fb1-abac-3b1d28a8e93c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Shelving
Aug 26 23:35:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:31 user nova-compute[73497]: DEBUG nova.compute.manager [req-647e63a9-f7c7-4935-8d78-8ab746c346cd req-db350048-de1c-4729-8791-a69d0dd34761 service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Received event network-vif-unplugged-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:35:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-647e63a9-f7c7-4935-8d78-8ab746c346cd req-db350048-de1c-4729-8791-a69d0dd34761 service nova] Acquiring lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:35:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-647e63a9-f7c7-4935-8d78-8ab746c346cd req-db350048-de1c-4729-8791-a69d0dd34761 service nova] Lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:35:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-647e63a9-f7c7-4935-8d78-8ab746c346cd req-db350048-de1c-4729-8791-a69d0dd34761 service nova] Lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:35:31 user nova-compute[73497]: DEBUG nova.compute.manager [req-647e63a9-f7c7-4935-8d78-8ab746c346cd req-db350048-de1c-4729-8791-a69d0dd34761 service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] No waiting events found dispatching network-vif-unplugged-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:35:31 user nova-compute[73497]: WARNING nova.compute.manager [req-647e63a9-f7c7-4935-8d78-8ab746c346cd req-db350048-de1c-4729-8791-a69d0dd34761 service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Received unexpected event network-vif-unplugged-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 for instance with vm_state active and task_state shelving.
Aug 26 23:35:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:31 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Instance destroyed successfully.
Aug 26 23:35:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:31 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-b0cde06a-a733-4fb1-abac-3b1d28a8e93c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Beginning cold snapshot process
Aug 26 23:35:32 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693092917.2372463, e9e5c83f-0678-48d4-a81f-1a3f959aabcf => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:35:32 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] VM Stopped (Lifecycle Event)
Aug 26 23:35:32 user nova-compute[73497]: DEBUG nova.privsep.utils [None req-b0cde06a-a733-4fb1-abac-3b1d28a8e93c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73497) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 23:35:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-b0cde06a-a733-4fb1-abac-3b1d28a8e93c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/disk /opt/stack/data/nova/instances/snapshots/tmp2iiim7a7/d91040087b0e49a7bb259daf6945e034 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:35:32 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c25413d4-bb46-4d27-b4c1-6ff4acdac0d3 None None] [instance: e9e5c83f-0678-48d4-a81f-1a3f959aabcf] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:35:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-b0cde06a-a733-4fb1-abac-3b1d28a8e93c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/disk /opt/stack/data/nova/instances/snapshots/tmp2iiim7a7/d91040087b0e49a7bb259daf6945e034" returned: 0 in 1.031s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:35:33 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-b0cde06a-a733-4fb1-abac-3b1d28a8e93c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Snapshot extracted, beginning image upload
Aug 26 23:35:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-9c102937-8991-4ac3-ac4a-3f2517167969 req-def95397-eb72-4890-ba37-2b07c9d97bfd service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Received event network-vif-plugged-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:35:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9c102937-8991-4ac3-ac4a-3f2517167969 req-def95397-eb72-4890-ba37-2b07c9d97bfd service nova] Acquiring lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:35:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9c102937-8991-4ac3-ac4a-3f2517167969 req-def95397-eb72-4890-ba37-2b07c9d97bfd service nova] Lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:35:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9c102937-8991-4ac3-ac4a-3f2517167969 req-def95397-eb72-4890-ba37-2b07c9d97bfd service nova] Lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:35:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-9c102937-8991-4ac3-ac4a-3f2517167969 req-def95397-eb72-4890-ba37-2b07c9d97bfd service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] No waiting events found dispatching network-vif-plugged-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:35:33 user nova-compute[73497]: WARNING nova.compute.manager [req-9c102937-8991-4ac3-ac4a-3f2517167969 req-def95397-eb72-4890-ba37-2b07c9d97bfd service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Received unexpected event network-vif-plugged-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 for instance with vm_state active and task_state shelving_image_uploading.
Aug 26 23:35:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-9c102937-8991-4ac3-ac4a-3f2517167969 req-def95397-eb72-4890-ba37-2b07c9d97bfd service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Received event network-vif-plugged-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:35:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9c102937-8991-4ac3-ac4a-3f2517167969 req-def95397-eb72-4890-ba37-2b07c9d97bfd service nova] Acquiring lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:35:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9c102937-8991-4ac3-ac4a-3f2517167969 req-def95397-eb72-4890-ba37-2b07c9d97bfd service nova] Lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:35:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9c102937-8991-4ac3-ac4a-3f2517167969 req-def95397-eb72-4890-ba37-2b07c9d97bfd service nova] Lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:35:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-9c102937-8991-4ac3-ac4a-3f2517167969 req-def95397-eb72-4890-ba37-2b07c9d97bfd service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] No waiting events found dispatching network-vif-plugged-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:35:33 user nova-compute[73497]: WARNING nova.compute.manager [req-9c102937-8991-4ac3-ac4a-3f2517167969 req-def95397-eb72-4890-ba37-2b07c9d97bfd service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Received unexpected event network-vif-plugged-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 for instance with vm_state active and task_state shelving_image_uploading.
Aug 26 23:35:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-9c102937-8991-4ac3-ac4a-3f2517167969 req-def95397-eb72-4890-ba37-2b07c9d97bfd service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Received event network-vif-plugged-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:35:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9c102937-8991-4ac3-ac4a-3f2517167969 req-def95397-eb72-4890-ba37-2b07c9d97bfd service nova] Acquiring lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:35:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9c102937-8991-4ac3-ac4a-3f2517167969 req-def95397-eb72-4890-ba37-2b07c9d97bfd service nova] Lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:35:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9c102937-8991-4ac3-ac4a-3f2517167969 req-def95397-eb72-4890-ba37-2b07c9d97bfd service nova] Lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:35:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-9c102937-8991-4ac3-ac4a-3f2517167969 req-def95397-eb72-4890-ba37-2b07c9d97bfd service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] No waiting events found dispatching network-vif-plugged-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:35:33 user nova-compute[73497]: WARNING nova.compute.manager [req-9c102937-8991-4ac3-ac4a-3f2517167969 req-def95397-eb72-4890-ba37-2b07c9d97bfd service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Received unexpected event network-vif-plugged-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 for instance with vm_state active and task_state shelving_image_uploading.
Aug 26 23:35:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-9c102937-8991-4ac3-ac4a-3f2517167969 req-def95397-eb72-4890-ba37-2b07c9d97bfd service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Received event network-vif-unplugged-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:35:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9c102937-8991-4ac3-ac4a-3f2517167969 req-def95397-eb72-4890-ba37-2b07c9d97bfd service nova] Acquiring lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:35:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9c102937-8991-4ac3-ac4a-3f2517167969 req-def95397-eb72-4890-ba37-2b07c9d97bfd service nova] Lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:35:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9c102937-8991-4ac3-ac4a-3f2517167969 req-def95397-eb72-4890-ba37-2b07c9d97bfd service nova] Lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:35:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-9c102937-8991-4ac3-ac4a-3f2517167969 req-def95397-eb72-4890-ba37-2b07c9d97bfd service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] No waiting events found dispatching network-vif-unplugged-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:35:33 user nova-compute[73497]: WARNING nova.compute.manager [req-9c102937-8991-4ac3-ac4a-3f2517167969 req-def95397-eb72-4890-ba37-2b07c9d97bfd service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Received unexpected event network-vif-unplugged-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 for instance with vm_state active and task_state shelving_image_uploading.
Aug 26 23:35:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-9c102937-8991-4ac3-ac4a-3f2517167969 req-def95397-eb72-4890-ba37-2b07c9d97bfd service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Received event network-vif-plugged-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:35:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9c102937-8991-4ac3-ac4a-3f2517167969 req-def95397-eb72-4890-ba37-2b07c9d97bfd service nova] Acquiring lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:35:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9c102937-8991-4ac3-ac4a-3f2517167969 req-def95397-eb72-4890-ba37-2b07c9d97bfd service nova] Lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:35:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9c102937-8991-4ac3-ac4a-3f2517167969 req-def95397-eb72-4890-ba37-2b07c9d97bfd service nova] Lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:35:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-9c102937-8991-4ac3-ac4a-3f2517167969 req-def95397-eb72-4890-ba37-2b07c9d97bfd service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] No waiting events found dispatching network-vif-plugged-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:35:33 user nova-compute[73497]: WARNING nova.compute.manager [req-9c102937-8991-4ac3-ac4a-3f2517167969 req-def95397-eb72-4890-ba37-2b07c9d97bfd service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Received unexpected event network-vif-plugged-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 for instance with vm_state active and task_state shelving_image_uploading.
Aug 26 23:35:35 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-b0cde06a-a733-4fb1-abac-3b1d28a8e93c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Snapshot image upload complete
Aug 26 23:35:35 user nova-compute[73497]: DEBUG nova.compute.manager [None req-b0cde06a-a733-4fb1-abac-3b1d28a8e93c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:35:35 user nova-compute[73497]: INFO nova.compute.manager [None req-b0cde06a-a733-4fb1-abac-3b1d28a8e93c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Shelve offloading
Aug 26 23:35:35 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Instance destroyed successfully.
Aug 26 23:35:35 user nova-compute[73497]: DEBUG nova.compute.manager [None req-b0cde06a-a733-4fb1-abac-3b1d28a8e93c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:35:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b0cde06a-a733-4fb1-abac-3b1d28a8e93c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "refresh_cache-db489468-154b-4238-8b81-f8fa2bc016b7" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:35:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b0cde06a-a733-4fb1-abac-3b1d28a8e93c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquired lock "refresh_cache-db489468-154b-4238-8b81-f8fa2bc016b7" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:35:35 user nova-compute[73497]: DEBUG nova.network.neutron [None req-b0cde06a-a733-4fb1-abac-3b1d28a8e93c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:35:36 user nova-compute[73497]: DEBUG nova.network.neutron [None req-b0cde06a-a733-4fb1-abac-3b1d28a8e93c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Updating instance_info_cache with network_info: [{"id": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "address": "fa:16:3e:ad:7f:ad", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc782cdf-fe", "ovs_interfaceid": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:35:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b0cde06a-a733-4fb1-abac-3b1d28a8e93c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Releasing lock "refresh_cache-db489468-154b-4238-8b81-f8fa2bc016b7" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:35:36 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Instance destroyed successfully.
Aug 26 23:35:36 user nova-compute[73497]: DEBUG nova.objects.instance [None req-b0cde06a-a733-4fb1-abac-3b1d28a8e93c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lazy-loading 'resources' on Instance uuid db489468-154b-4238-8b81-f8fa2bc016b7 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:35:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-b0cde06a-a733-4fb1-abac-3b1d28a8e93c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:33:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1477188239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1477188239',id=38,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+zEsK4nQOioc9Qi0jnFjzykCg6/wtaz/sC0lOshmN9CO3QLXyXzCiB5KfNY2kjTWjUnRt570zcgoTQZLHEtWlYsJLi3kOwtzDS+5T0Z6DQJ/tppWJ0iSc7illPDBtpJQ==',key_name='tempest-keypair-1630262803',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:33:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f777a90b660e48cdb1f5a453fbe2f806',ramdisk_id='',reservation_id='r-f3c038xw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-389793905',owner_user_name='tempest-AttachVolumeShelveTestJSON-389793905-project-member',shelved_at='2023-08-26T23:35:35.581660',shelved_host='user',shelved_image_id='19064d93-0426-401c-9dc3-d65e7832d59d'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:35:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d0fa85485fe42fc8a3b884f71db5669',uuid=db489468-154b-4238-8b81-f8fa2bc016b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "address": "fa:16:3e:ad:7f:ad", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc782cdf-fe", "ovs_interfaceid": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:35:36 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-b0cde06a-a733-4fb1-abac-3b1d28a8e93c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Converting VIF {"id": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "address": "fa:16:3e:ad:7f:ad", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc782cdf-fe", "ovs_interfaceid": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:35:36 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-b0cde06a-a733-4fb1-abac-3b1d28a8e93c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:7f:ad,bridge_name='br-int',has_traffic_filtering=True,id=fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5,network=Network(39b40d3c-dae0-4dcf-a0de-b77899879f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc782cdf-fe') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:35:36 user nova-compute[73497]: DEBUG os_vif [None req-b0cde06a-a733-4fb1-abac-3b1d28a8e93c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:7f:ad,bridge_name='br-int',has_traffic_filtering=True,id=fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5,network=Network(39b40d3c-dae0-4dcf-a0de-b77899879f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc782cdf-fe') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:35:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc782cdf-fe, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:35:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:36 user nova-compute[73497]: DEBUG nova.compute.manager [req-df0e1f65-0a74-4b4e-8cab-b822c12b75d0 req-c5676feb-fdda-4a7e-b4ba-9038dd0a68b6 service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Received event network-changed-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:35:36 user nova-compute[73497]: DEBUG nova.compute.manager [req-df0e1f65-0a74-4b4e-8cab-b822c12b75d0 req-c5676feb-fdda-4a7e-b4ba-9038dd0a68b6 service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Refreshing instance network info cache due to event network-changed-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:35:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-df0e1f65-0a74-4b4e-8cab-b822c12b75d0 req-c5676feb-fdda-4a7e-b4ba-9038dd0a68b6 service nova] Acquiring lock "refresh_cache-db489468-154b-4238-8b81-f8fa2bc016b7" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:35:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-df0e1f65-0a74-4b4e-8cab-b822c12b75d0 req-c5676feb-fdda-4a7e-b4ba-9038dd0a68b6 service nova] Acquired lock "refresh_cache-db489468-154b-4238-8b81-f8fa2bc016b7" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:35:36 user nova-compute[73497]: DEBUG nova.network.neutron [req-df0e1f65-0a74-4b4e-8cab-b822c12b75d0 req-c5676feb-fdda-4a7e-b4ba-9038dd0a68b6 service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Refreshing network info cache for port fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:35:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:35:36 user nova-compute[73497]: INFO os_vif [None req-b0cde06a-a733-4fb1-abac-3b1d28a8e93c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:7f:ad,bridge_name='br-int',has_traffic_filtering=True,id=fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5,network=Network(39b40d3c-dae0-4dcf-a0de-b77899879f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc782cdf-fe')
Aug 26 23:35:36 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-b0cde06a-a733-4fb1-abac-3b1d28a8e93c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Deleting instance files /opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7_del
Aug 26 23:35:36 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-b0cde06a-a733-4fb1-abac-3b1d28a8e93c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Deletion of /opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7_del complete
Aug 26 23:35:36 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-b0cde06a-a733-4fb1-abac-3b1d28a8e93c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Deleted allocations for instance db489468-154b-4238-8b81-f8fa2bc016b7
Aug 26 23:35:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b0cde06a-a733-4fb1-abac-3b1d28a8e93c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:35:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b0cde06a-a733-4fb1-abac-3b1d28a8e93c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:35:36 user nova-compute[73497]: DEBUG nova.objects.instance [None req-b0cde06a-a733-4fb1-abac-3b1d28a8e93c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lazy-loading 'numa_topology' on Instance uuid db489468-154b-4238-8b81-f8fa2bc016b7 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:35:36 user nova-compute[73497]: DEBUG nova.objects.base [None req-b0cde06a-a733-4fb1-abac-3b1d28a8e93c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Object Instance<db489468-154b-4238-8b81-f8fa2bc016b7> lazy-loaded attributes: resources,numa_topology {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:35:37 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-b0cde06a-a733-4fb1-abac-3b1d28a8e93c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:35:37 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-b0cde06a-a733-4fb1-abac-3b1d28a8e93c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:35:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b0cde06a-a733-4fb1-abac-3b1d28a8e93c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.188s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:35:37 user nova-compute[73497]: DEBUG nova.network.neutron [req-df0e1f65-0a74-4b4e-8cab-b822c12b75d0 req-c5676feb-fdda-4a7e-b4ba-9038dd0a68b6 service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Updated VIF entry in instance network info cache for port fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:35:37 user nova-compute[73497]: DEBUG nova.network.neutron [req-df0e1f65-0a74-4b4e-8cab-b822c12b75d0 req-c5676feb-fdda-4a7e-b4ba-9038dd0a68b6 service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Updating instance_info_cache with network_info: [{"id": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "address": "fa:16:3e:ad:7f:ad", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapfc782cdf-fe", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:35:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b0cde06a-a733-4fb1-abac-3b1d28a8e93c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "db489468-154b-4238-8b81-f8fa2bc016b7" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.847s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:35:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-df0e1f65-0a74-4b4e-8cab-b822c12b75d0 req-c5676feb-fdda-4a7e-b4ba-9038dd0a68b6 service nova] Releasing lock "refresh_cache-db489468-154b-4238-8b81-f8fa2bc016b7" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:35:37 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693092922.9230146, f7c83073-fadc-4e41-a4a9-df0bbe11aa28 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:35:37 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] VM Stopped (Lifecycle Event)
Aug 26 23:35:37 user nova-compute[73497]: DEBUG nova.compute.manager [None req-7e0ba086-937d-44bb-8bad-fa947f574ec6 None None] [instance: f7c83073-fadc-4e41-a4a9-df0bbe11aa28] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:35:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:46 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693092931.916839, db489468-154b-4238-8b81-f8fa2bc016b7 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:35:46 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] VM Stopped (Lifecycle Event)
Aug 26 23:35:46 user nova-compute[73497]: DEBUG nova.compute.manager [None req-497dfd0a-b464-4b5b-808c-947f1f5d247c None None] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:35:48 user nova-compute[73497]: DEBUG nova.compute.manager [req-2b61bf0b-2921-46db-a9ed-2f9ffbdca6e3 req-1062db1f-fab6-4e17-8fb3-b19bc842ae9b service nova] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Received event network-changed-ac9386e4-01a7-4ccf-abf1-814e9f349fcf {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:35:48 user nova-compute[73497]: DEBUG nova.compute.manager [req-2b61bf0b-2921-46db-a9ed-2f9ffbdca6e3 req-1062db1f-fab6-4e17-8fb3-b19bc842ae9b service nova] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Refreshing instance network info cache due to event network-changed-ac9386e4-01a7-4ccf-abf1-814e9f349fcf. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:35:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2b61bf0b-2921-46db-a9ed-2f9ffbdca6e3 req-1062db1f-fab6-4e17-8fb3-b19bc842ae9b service nova] Acquiring lock "refresh_cache-2b2d2380-d861-46c4-b13c-36b4f48cca77" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:35:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2b61bf0b-2921-46db-a9ed-2f9ffbdca6e3 req-1062db1f-fab6-4e17-8fb3-b19bc842ae9b service nova] Acquired lock "refresh_cache-2b2d2380-d861-46c4-b13c-36b4f48cca77" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:35:48 user nova-compute[73497]: DEBUG nova.network.neutron [req-2b61bf0b-2921-46db-a9ed-2f9ffbdca6e3 req-1062db1f-fab6-4e17-8fb3-b19bc842ae9b service nova] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Refreshing network info cache for port ac9386e4-01a7-4ccf-abf1-814e9f349fcf {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:35:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Acquiring lock "2b2d2380-d861-46c4-b13c-36b4f48cca77" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:35:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "2b2d2380-d861-46c4-b13c-36b4f48cca77" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:35:49 user nova-compute[73497]: DEBUG nova.objects.instance [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lazy-loading 'flavor' on Instance uuid 2b2d2380-d861-46c4-b13c-36b4f48cca77 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:35:49 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Ignoring supplied device name: /dev/vdb
Aug 26 23:35:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "2b2d2380-d861-46c4-b13c-36b4f48cca77" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:35:49 user nova-compute[73497]: DEBUG nova.network.neutron [req-2b61bf0b-2921-46db-a9ed-2f9ffbdca6e3 req-1062db1f-fab6-4e17-8fb3-b19bc842ae9b service nova] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Updated VIF entry in instance network info cache for port ac9386e4-01a7-4ccf-abf1-814e9f349fcf. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:35:49 user nova-compute[73497]: DEBUG nova.network.neutron [req-2b61bf0b-2921-46db-a9ed-2f9ffbdca6e3 req-1062db1f-fab6-4e17-8fb3-b19bc842ae9b service nova] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Updating instance_info_cache with network_info: [{"id": "ac9386e4-01a7-4ccf-abf1-814e9f349fcf", "address": "fa:16:3e:8a:9c:5b", "network": {"id": "bc10efbc-a86e-4a1d-8a40-bc508dd2a6db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1634677403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "077c6c937fcc4d8d95eb66d8d7f87167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac9386e4-01", "ovs_interfaceid": "ac9386e4-01a7-4ccf-abf1-814e9f349fcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:35:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2b61bf0b-2921-46db-a9ed-2f9ffbdca6e3 req-1062db1f-fab6-4e17-8fb3-b19bc842ae9b service nova] Releasing lock "refresh_cache-2b2d2380-d861-46c4-b13c-36b4f48cca77" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:35:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Acquiring lock "2b2d2380-d861-46c4-b13c-36b4f48cca77" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:35:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "2b2d2380-d861-46c4-b13c-36b4f48cca77" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:35:49 user nova-compute[73497]: INFO nova.compute.manager [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Attaching volume 4772d294-ae64-43aa-beb4-d3ca4e63a6f3 to /dev/vdb
Aug 26 23:35:49 user nova-compute[73497]: DEBUG os_brick.utils [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:35:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:35:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:35:49 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee84aad-122c-4cbe-9055-350fec967cfe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:35:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:35:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:35:49 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[433cbeb9-9159-4b49-819d-48515309d4be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:35:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:35:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:35:49 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7ac220-26b5-4444-aabf-3e4dbec10415]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:35:49 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e9c044-364a-4310-adf2-d1c6ef69a737]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:35:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:35:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:35:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:35:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:35:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:35:49 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:35:49 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a2ea66-e661-43ce-a492-dc21ab64b87c]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:35:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:35:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:35:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:35:49 user nova-compute[73497]: DEBUG os_brick.utils [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:35:49 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Updating existing volume attachment record: 04e87762-e5aa-460c-9cf9-bfcd3a75eeb3 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:35:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:35:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:35:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:01 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:36:01 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:36:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:03 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:36:03 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:36:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:36:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:36:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:36:03 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:36:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358ed2d7-4452-40cf-9fed-d9a8e45b5c99/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358ed2d7-4452-40cf-9fed-d9a8e45b5c99/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358ed2d7-4452-40cf-9fed-d9a8e45b5c99/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358ed2d7-4452-40cf-9fed-d9a8e45b5c99/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2d2380-d861-46c4-b13c-36b4f48cca77/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2d2380-d861-46c4-b13c-36b4f48cca77/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2d2380-d861-46c4-b13c-36b4f48cca77/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2d2380-d861-46c4-b13c-36b4f48cca77/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1fa7599-72de-487d-9b0e-0adf8c0120ca/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1fa7599-72de-487d-9b0e-0adf8c0120ca/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1fa7599-72de-487d-9b0e-0adf8c0120ca/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1fa7599-72de-487d-9b0e-0adf8c0120ca/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:05 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:36:05 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:36:05 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8077MB free_disk=25.08618927001953GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:36:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:36:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:36:05 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 043294e5-0618-4a31-bb19-1227ef1f5d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:36:05 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 2b2d2380-d861-46c4-b13c-36b4f48cca77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:36:05 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 358ed2d7-4452-40cf-9fed-d9a8e45b5c99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:36:05 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance f1fa7599-72de-487d-9b0e-0adf8c0120ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:36:05 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:36:05 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:36:05 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:36:05 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:36:05 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:36:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.308s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:36:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5f5bab8a-a1d5-45c4-b077-6117516dc490 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "043294e5-0618-4a31-bb19-1227ef1f5d39" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:36:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5f5bab8a-a1d5-45c4-b077-6117516dc490 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "043294e5-0618-4a31-bb19-1227ef1f5d39" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:36:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5f5bab8a-a1d5-45c4-b077-6117516dc490 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:36:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5f5bab8a-a1d5-45c4-b077-6117516dc490 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:36:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5f5bab8a-a1d5-45c4-b077-6117516dc490 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:36:07 user nova-compute[73497]: INFO nova.compute.manager [None req-5f5bab8a-a1d5-45c4-b077-6117516dc490 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Terminating instance
Aug 26 23:36:07 user nova-compute[73497]: DEBUG nova.compute.manager [None req-5f5bab8a-a1d5-45c4-b077-6117516dc490 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:36:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:07 user nova-compute[73497]: DEBUG nova.compute.manager [req-10a3ee58-8027-4158-9a50-e9c2c0479acb req-596b2598-4bb5-4b61-990b-d7d4ad584951 service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Received event network-vif-unplugged-de273950-9851-448e-8ca2-ac699c12994e {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:36:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-10a3ee58-8027-4158-9a50-e9c2c0479acb req-596b2598-4bb5-4b61-990b-d7d4ad584951 service nova] Acquiring lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:36:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-10a3ee58-8027-4158-9a50-e9c2c0479acb req-596b2598-4bb5-4b61-990b-d7d4ad584951 service nova] Lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:36:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-10a3ee58-8027-4158-9a50-e9c2c0479acb req-596b2598-4bb5-4b61-990b-d7d4ad584951 service nova] Lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:36:07 user nova-compute[73497]: DEBUG nova.compute.manager [req-10a3ee58-8027-4158-9a50-e9c2c0479acb req-596b2598-4bb5-4b61-990b-d7d4ad584951 service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] No waiting events found dispatching network-vif-unplugged-de273950-9851-448e-8ca2-ac699c12994e {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:36:07 user nova-compute[73497]: DEBUG nova.compute.manager [req-10a3ee58-8027-4158-9a50-e9c2c0479acb req-596b2598-4bb5-4b61-990b-d7d4ad584951 service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Received event network-vif-unplugged-de273950-9851-448e-8ca2-ac699c12994e for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:36:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:07 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Instance destroyed successfully.
Aug 26 23:36:07 user nova-compute[73497]: DEBUG nova.objects.instance [None req-5f5bab8a-a1d5-45c4-b077-6117516dc490 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lazy-loading 'resources' on Instance uuid 043294e5-0618-4a31-bb19-1227ef1f5d39 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:36:07 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-5f5bab8a-a1d5-45c4-b077-6117516dc490 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:18:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1111344785',display_name='tempest-ServerRescueNegativeTestJSON-server-1111344785',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1111344785',id=19,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:23:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c4ca787dd33440d98779668507369ee',ramdisk_id='',reservation_id='r-mq6jhfdi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1946187856',owner_user_name='tempest-ServerRescueNegativeTestJSON-1946187856-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:25:32Z,user_data=None,user_id='af64aa253eec41a0976c3e527fe41831',uuid=043294e5-0618-4a31-bb19-1227ef1f5d39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de273950-9851-448e-8ca2-ac699c12994e", "address": "fa:16:3e:fe:2b:69", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde273950-98", "ovs_interfaceid": "de273950-9851-448e-8ca2-ac699c12994e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:36:07 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-5f5bab8a-a1d5-45c4-b077-6117516dc490 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Converting VIF {"id": "de273950-9851-448e-8ca2-ac699c12994e", "address": "fa:16:3e:fe:2b:69", "network": {"id": "6f13f07f-104d-4d8d-b5fa-afa402402a8c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1417614058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c4ca787dd33440d98779668507369ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde273950-98", "ovs_interfaceid": "de273950-9851-448e-8ca2-ac699c12994e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:36:07 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-5f5bab8a-a1d5-45c4-b077-6117516dc490 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:2b:69,bridge_name='br-int',has_traffic_filtering=True,id=de273950-9851-448e-8ca2-ac699c12994e,network=Network(6f13f07f-104d-4d8d-b5fa-afa402402a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde273950-98') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:36:07 user nova-compute[73497]: DEBUG os_vif [None req-5f5bab8a-a1d5-45c4-b077-6117516dc490 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:2b:69,bridge_name='br-int',has_traffic_filtering=True,id=de273950-9851-448e-8ca2-ac699c12994e,network=Network(6f13f07f-104d-4d8d-b5fa-afa402402a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde273950-98') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:36:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde273950-98, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:36:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:36:07 user nova-compute[73497]: INFO os_vif [None req-5f5bab8a-a1d5-45c4-b077-6117516dc490 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:2b:69,bridge_name='br-int',has_traffic_filtering=True,id=de273950-9851-448e-8ca2-ac699c12994e,network=Network(6f13f07f-104d-4d8d-b5fa-afa402402a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde273950-98')
Aug 26 23:36:07 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-5f5bab8a-a1d5-45c4-b077-6117516dc490 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Deleting instance files /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39_del
Aug 26 23:36:07 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-5f5bab8a-a1d5-45c4-b077-6117516dc490 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Deletion of /opt/stack/data/nova/instances/043294e5-0618-4a31-bb19-1227ef1f5d39_del complete
Aug 26 23:36:07 user nova-compute[73497]: INFO nova.compute.manager [None req-5f5bab8a-a1d5-45c4-b077-6117516dc490 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 26 23:36:07 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-5f5bab8a-a1d5-45c4-b077-6117516dc490 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:36:07 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:36:07 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:36:08 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:36:08 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Took 0.85 seconds to deallocate network for instance.
Aug 26 23:36:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5f5bab8a-a1d5-45c4-b077-6117516dc490 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:36:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5f5bab8a-a1d5-45c4-b077-6117516dc490 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:36:08 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-5f5bab8a-a1d5-45c4-b077-6117516dc490 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:36:09 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-5f5bab8a-a1d5-45c4-b077-6117516dc490 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:36:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5f5bab8a-a1d5-45c4-b077-6117516dc490 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.285s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:36:09 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-5f5bab8a-a1d5-45c4-b077-6117516dc490 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Deleted allocations for instance 043294e5-0618-4a31-bb19-1227ef1f5d39
Aug 26 23:36:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5f5bab8a-a1d5-45c4-b077-6117516dc490 tempest-ServerRescueNegativeTestJSON-1946187856 tempest-ServerRescueNegativeTestJSON-1946187856-project-member] Lock "043294e5-0618-4a31-bb19-1227ef1f5d39" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.288s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:36:09 user nova-compute[73497]: DEBUG nova.compute.manager [req-8cdc097b-d7b8-4033-8b37-f65773b9f944 req-8883548d-87dc-464a-b914-4148c601e93d service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Received event network-vif-plugged-de273950-9851-448e-8ca2-ac699c12994e {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:36:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8cdc097b-d7b8-4033-8b37-f65773b9f944 req-8883548d-87dc-464a-b914-4148c601e93d service nova] Acquiring lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:36:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8cdc097b-d7b8-4033-8b37-f65773b9f944 req-8883548d-87dc-464a-b914-4148c601e93d service nova] Lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:36:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8cdc097b-d7b8-4033-8b37-f65773b9f944 req-8883548d-87dc-464a-b914-4148c601e93d service nova] Lock "043294e5-0618-4a31-bb19-1227ef1f5d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:36:09 user nova-compute[73497]: DEBUG nova.compute.manager [req-8cdc097b-d7b8-4033-8b37-f65773b9f944 req-8883548d-87dc-464a-b914-4148c601e93d service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] No waiting events found dispatching network-vif-plugged-de273950-9851-448e-8ca2-ac699c12994e {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:36:09 user nova-compute[73497]: WARNING nova.compute.manager [req-8cdc097b-d7b8-4033-8b37-f65773b9f944 req-8883548d-87dc-464a-b914-4148c601e93d service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Received unexpected event network-vif-plugged-de273950-9851-448e-8ca2-ac699c12994e for instance with vm_state deleted and task_state None.
Aug 26 23:36:09 user nova-compute[73497]: DEBUG nova.compute.manager [req-8cdc097b-d7b8-4033-8b37-f65773b9f944 req-8883548d-87dc-464a-b914-4148c601e93d service nova] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Received event network-vif-deleted-de273950-9851-448e-8ca2-ac699c12994e {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:36:10 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:36:10 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:36:11 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:36:12 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:36:12 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:36:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:14 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:36:14 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:36:14 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Skipping network cache update for instance because it has been migrated to another host. {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9886}}
Aug 26 23:36:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-2b2d2380-d861-46c4-b13c-36b4f48cca77" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:36:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-2b2d2380-d861-46c4-b13c-36b4f48cca77" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:36:14 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:36:14 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Updating instance_info_cache with network_info: [{"id": "ac9386e4-01a7-4ccf-abf1-814e9f349fcf", "address": "fa:16:3e:8a:9c:5b", "network": {"id": "bc10efbc-a86e-4a1d-8a40-bc508dd2a6db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1634677403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "077c6c937fcc4d8d95eb66d8d7f87167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac9386e4-01", "ovs_interfaceid": "ac9386e4-01a7-4ccf-abf1-814e9f349fcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:36:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-2b2d2380-d861-46c4-b13c-36b4f48cca77" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:36:14 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:36:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "94425d3d-4703-434f-8a58-19a334b44d69" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:36:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "94425d3d-4703-434f-8a58-19a334b44d69" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:36:16 user nova-compute[73497]: DEBUG nova.compute.manager [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:36:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:36:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:36:16 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:36:16 user nova-compute[73497]: INFO nova.compute.claims [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Claim successful on node user
Aug 26 23:36:16 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:36:16 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:36:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.284s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:36:16 user nova-compute[73497]: DEBUG nova.compute.manager [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:36:16 user nova-compute[73497]: DEBUG nova.compute.manager [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:36:16 user nova-compute[73497]: DEBUG nova.network.neutron [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:36:16 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:36:16 user nova-compute[73497]: DEBUG nova.compute.manager [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:36:16 user nova-compute[73497]: DEBUG nova.policy [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6e2c1f8d06854e579ee634e33e6de920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f2d1336284b42a8dcbb05e509e9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:36:16 user nova-compute[73497]: DEBUG nova.compute.manager [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:36:16 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:36:16 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Creating image(s)
Aug 26 23:36:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "/opt/stack/data/nova/instances/94425d3d-4703-434f-8a58-19a334b44d69/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:36:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "/opt/stack/data/nova/instances/94425d3d-4703-434f-8a58-19a334b44d69/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:36:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "/opt/stack/data/nova/instances/94425d3d-4703-434f-8a58-19a334b44d69/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:36:16 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.215s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:36:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:36:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.191s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/94425d3d-4703-434f-8a58-19a334b44d69/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/94425d3d-4703-434f-8a58-19a334b44d69/disk 1073741824" returned: 0 in 0.063s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:36:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.188s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:17 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Checking if we can resize image /opt/stack/data/nova/instances/94425d3d-4703-434f-8a58-19a334b44d69/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:36:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94425d3d-4703-434f-8a58-19a334b44d69/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:17 user nova-compute[73497]: DEBUG nova.network.neutron [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Successfully created port: cbcbd7d5-cca7-4e29-bf12-e472b1730340 {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:36:17 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94425d3d-4703-434f-8a58-19a334b44d69/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:17 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Cannot resize image /opt/stack/data/nova/instances/94425d3d-4703-434f-8a58-19a334b44d69/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:36:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:36:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Ensure instance console log exists: /opt/stack/data/nova/instances/94425d3d-4703-434f-8a58-19a334b44d69/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:36:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:36:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:36:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:36:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:36:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:18 user nova-compute[73497]: DEBUG nova.network.neutron [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Successfully updated port: cbcbd7d5-cca7-4e29-bf12-e472b1730340 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:36:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "refresh_cache-94425d3d-4703-434f-8a58-19a334b44d69" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:36:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquired lock "refresh_cache-94425d3d-4703-434f-8a58-19a334b44d69" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:36:18 user nova-compute[73497]: DEBUG nova.network.neutron [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:36:18 user nova-compute[73497]: DEBUG nova.compute.manager [req-56c16488-74a3-4485-8d07-eb0ee78dea80 req-c5532a29-963c-4150-a11a-c91a04a5f938 service nova] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Received event network-changed-cbcbd7d5-cca7-4e29-bf12-e472b1730340 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:36:18 user nova-compute[73497]: DEBUG nova.compute.manager [req-56c16488-74a3-4485-8d07-eb0ee78dea80 req-c5532a29-963c-4150-a11a-c91a04a5f938 service nova] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Refreshing instance network info cache due to event network-changed-cbcbd7d5-cca7-4e29-bf12-e472b1730340. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:36:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-56c16488-74a3-4485-8d07-eb0ee78dea80 req-c5532a29-963c-4150-a11a-c91a04a5f938 service nova] Acquiring lock "refresh_cache-94425d3d-4703-434f-8a58-19a334b44d69" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:36:18 user nova-compute[73497]: DEBUG nova.network.neutron [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:36:18 user nova-compute[73497]: DEBUG nova.network.neutron [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Updating instance_info_cache with network_info: [{"id": "cbcbd7d5-cca7-4e29-bf12-e472b1730340", "address": "fa:16:3e:f0:47:cf", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbcbd7d5-cc", "ovs_interfaceid": "cbcbd7d5-cca7-4e29-bf12-e472b1730340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:36:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Releasing lock "refresh_cache-94425d3d-4703-434f-8a58-19a334b44d69" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:36:18 user nova-compute[73497]: DEBUG nova.compute.manager [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Instance network_info: |[{"id": "cbcbd7d5-cca7-4e29-bf12-e472b1730340", "address": "fa:16:3e:f0:47:cf", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbcbd7d5-cc", "ovs_interfaceid": "cbcbd7d5-cca7-4e29-bf12-e472b1730340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:36:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-56c16488-74a3-4485-8d07-eb0ee78dea80 req-c5532a29-963c-4150-a11a-c91a04a5f938 service nova] Acquired lock "refresh_cache-94425d3d-4703-434f-8a58-19a334b44d69" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:36:18 user nova-compute[73497]: DEBUG nova.network.neutron [req-56c16488-74a3-4485-8d07-eb0ee78dea80 req-c5532a29-963c-4150-a11a-c91a04a5f938 service nova] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Refreshing network info cache for port cbcbd7d5-cca7-4e29-bf12-e472b1730340 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:36:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Start _get_guest_xml network_info=[{"id": "cbcbd7d5-cca7-4e29-bf12-e472b1730340", "address": "fa:16:3e:f0:47:cf", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbcbd7d5-cc", "ovs_interfaceid": "cbcbd7d5-cca7-4e29-bf12-e472b1730340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:36:18 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:36:18 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:36:19 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:36:19 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:36:19 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:36:19 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:36:19 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:36:19 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:36:19 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:36:19 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:36:19 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:36:19 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:36:19 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:36:19 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:36:19 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:36:19 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:36:19 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:36:19 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:36:19 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:36:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-482333375',display_name='tempest-AttachVolumeTestJSON-server-482333375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-482333375',id=42,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7js1I6AOeoJbMn1fKsKWTF8NDeLnfY1+8BDEUbhNcbAycSF0YDPQzJdXj2iWTcBPceKtMnptzdgQ8G5hDS9Tn89hww77OvBvIkPOfGE6dVydq19WOqLo0tSRsjfNgJ/Q==',key_name='tempest-keypair-672246647',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e10f2d1336284b42a8dcbb05e509e9bd',ramdisk_id='',reservation_id='r-3jcqkh96',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1929388969',owner_user_name='tempest-AttachVolumeTestJSON-1929388969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:36:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e2c1f8d06854e579ee634e33e6de920',uuid=94425d3d-4703-434f-8a58-19a334b44d69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbcbd7d5-cca7-4e29-bf12-e472b1730340", "address": "fa:16:3e:f0:47:cf", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbcbd7d5-cc", "ovs_interfaceid": "cbcbd7d5-cca7-4e29-bf12-e472b1730340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:36:19 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Converting VIF {"id": "cbcbd7d5-cca7-4e29-bf12-e472b1730340", "address": "fa:16:3e:f0:47:cf", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbcbd7d5-cc", "ovs_interfaceid": "cbcbd7d5-cca7-4e29-bf12-e472b1730340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:36:19 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:47:cf,bridge_name='br-int',has_traffic_filtering=True,id=cbcbd7d5-cca7-4e29-bf12-e472b1730340,network=Network(77d468df-32fe-45fb-afe7-7ebf9b6b428f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbcbd7d5-cc') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:36:19 user nova-compute[73497]: DEBUG nova.objects.instance [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lazy-loading 'pci_devices' on Instance uuid 94425d3d-4703-434f-8a58-19a334b44d69 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:36:19 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:36:19 user nova-compute[73497]:   <uuid>94425d3d-4703-434f-8a58-19a334b44d69</uuid>
Aug 26 23:36:19 user nova-compute[73497]:   <name>instance-0000002a</name>
Aug 26 23:36:19 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:36:19 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:36:19 user nova-compute[73497]:   <metadata>
Aug 26 23:36:19 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:36:19 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:36:19 user nova-compute[73497]:       <nova:name>tempest-AttachVolumeTestJSON-server-482333375</nova:name>
Aug 26 23:36:19 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:36:18</nova:creationTime>
Aug 26 23:36:19 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:36:19 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:36:19 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:36:19 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:36:19 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:36:19 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:36:19 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:36:19 user nova-compute[73497]:       <nova:owner>
Aug 26 23:36:19 user nova-compute[73497]:         <nova:user uuid="6e2c1f8d06854e579ee634e33e6de920">tempest-AttachVolumeTestJSON-1929388969-project-member</nova:user>
Aug 26 23:36:19 user nova-compute[73497]:         <nova:project uuid="e10f2d1336284b42a8dcbb05e509e9bd">tempest-AttachVolumeTestJSON-1929388969</nova:project>
Aug 26 23:36:19 user nova-compute[73497]:       </nova:owner>
Aug 26 23:36:19 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:36:19 user nova-compute[73497]:       <nova:ports>
Aug 26 23:36:19 user nova-compute[73497]:         <nova:port uuid="cbcbd7d5-cca7-4e29-bf12-e472b1730340">
Aug 26 23:36:19 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 23:36:19 user nova-compute[73497]:         </nova:port>
Aug 26 23:36:19 user nova-compute[73497]:       </nova:ports>
Aug 26 23:36:19 user nova-compute[73497]:     </nova:instance>
Aug 26 23:36:19 user nova-compute[73497]:   </metadata>
Aug 26 23:36:19 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:36:19 user nova-compute[73497]:     <system>
Aug 26 23:36:19 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:36:19 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:36:19 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:36:19 user nova-compute[73497]:       <entry name="serial">94425d3d-4703-434f-8a58-19a334b44d69</entry>
Aug 26 23:36:19 user nova-compute[73497]:       <entry name="uuid">94425d3d-4703-434f-8a58-19a334b44d69</entry>
Aug 26 23:36:19 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:36:19 user nova-compute[73497]:     </system>
Aug 26 23:36:19 user nova-compute[73497]:   </sysinfo>
Aug 26 23:36:19 user nova-compute[73497]:   <os>
Aug 26 23:36:19 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:36:19 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:36:19 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:36:19 user nova-compute[73497]:   </os>
Aug 26 23:36:19 user nova-compute[73497]:   <features>
Aug 26 23:36:19 user nova-compute[73497]:     <acpi/>
Aug 26 23:36:19 user nova-compute[73497]:     <apic/>
Aug 26 23:36:19 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:36:19 user nova-compute[73497]:   </features>
Aug 26 23:36:19 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:36:19 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:36:19 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:36:19 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:36:19 user nova-compute[73497]:   </clock>
Aug 26 23:36:19 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:36:19 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:36:19 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:36:19 user nova-compute[73497]:   </cpu>
Aug 26 23:36:19 user nova-compute[73497]:   <devices>
Aug 26 23:36:19 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:36:19 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:36:19 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/94425d3d-4703-434f-8a58-19a334b44d69/disk"/>
Aug 26 23:36:19 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:36:19 user nova-compute[73497]:     </disk>
Aug 26 23:36:19 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:36:19 user nova-compute[73497]:       <mac address="fa:16:3e:f0:47:cf"/>
Aug 26 23:36:19 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:36:19 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:36:19 user nova-compute[73497]:       <target dev="tapcbcbd7d5-cc"/>
Aug 26 23:36:19 user nova-compute[73497]:     </interface>
Aug 26 23:36:19 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:36:19 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/94425d3d-4703-434f-8a58-19a334b44d69/console.log" append="off"/>
Aug 26 23:36:19 user nova-compute[73497]:     </serial>
Aug 26 23:36:19 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:36:19 user nova-compute[73497]:     <video>
Aug 26 23:36:19 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:36:19 user nova-compute[73497]:     </video>
Aug 26 23:36:19 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:36:19 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:36:19 user nova-compute[73497]:     </rng>
Aug 26 23:36:19 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:36:19 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:36:19 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:36:19 user nova-compute[73497]:     </memballoon>
Aug 26 23:36:19 user nova-compute[73497]:   </devices>
Aug 26 23:36:19 user nova-compute[73497]: </domain>
Aug 26 23:36:19 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:36:19 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:36:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-482333375',display_name='tempest-AttachVolumeTestJSON-server-482333375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-482333375',id=42,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7js1I6AOeoJbMn1fKsKWTF8NDeLnfY1+8BDEUbhNcbAycSF0YDPQzJdXj2iWTcBPceKtMnptzdgQ8G5hDS9Tn89hww77OvBvIkPOfGE6dVydq19WOqLo0tSRsjfNgJ/Q==',key_name='tempest-keypair-672246647',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e10f2d1336284b42a8dcbb05e509e9bd',ramdisk_id='',reservation_id='r-3jcqkh96',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1929388969',owner_user_name='tempest-AttachVolumeTestJSON-1929388969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:36:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e2c1f8d06854e579ee634e33e6de920',uuid=94425d3d-4703-434f-8a58-19a334b44d69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbcbd7d5-cca7-4e29-bf12-e472b1730340", "address": "fa:16:3e:f0:47:cf", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbcbd7d5-cc", "ovs_interfaceid": "cbcbd7d5-cca7-4e29-bf12-e472b1730340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:36:19 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Converting VIF {"id": "cbcbd7d5-cca7-4e29-bf12-e472b1730340", "address": "fa:16:3e:f0:47:cf", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbcbd7d5-cc", "ovs_interfaceid": "cbcbd7d5-cca7-4e29-bf12-e472b1730340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:36:19 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:47:cf,bridge_name='br-int',has_traffic_filtering=True,id=cbcbd7d5-cca7-4e29-bf12-e472b1730340,network=Network(77d468df-32fe-45fb-afe7-7ebf9b6b428f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbcbd7d5-cc') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:36:19 user nova-compute[73497]: DEBUG os_vif [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:47:cf,bridge_name='br-int',has_traffic_filtering=True,id=cbcbd7d5-cca7-4e29-bf12-e472b1730340,network=Network(77d468df-32fe-45fb-afe7-7ebf9b6b428f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbcbd7d5-cc') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:36:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:36:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:36:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcbcbd7d5-cc, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:36:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcbcbd7d5-cc, col_values=(('external_ids', {'iface-id': 'cbcbd7d5-cca7-4e29-bf12-e472b1730340', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:47:cf', 'vm-uuid': '94425d3d-4703-434f-8a58-19a334b44d69'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:36:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:36:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:19 user nova-compute[73497]: INFO os_vif [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:47:cf,bridge_name='br-int',has_traffic_filtering=True,id=cbcbd7d5-cca7-4e29-bf12-e472b1730340,network=Network(77d468df-32fe-45fb-afe7-7ebf9b6b428f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbcbd7d5-cc')
Aug 26 23:36:19 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:36:19 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] No VIF found with MAC fa:16:3e:f0:47:cf, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:36:19 user nova-compute[73497]: DEBUG nova.network.neutron [req-56c16488-74a3-4485-8d07-eb0ee78dea80 req-c5532a29-963c-4150-a11a-c91a04a5f938 service nova] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Updated VIF entry in instance network info cache for port cbcbd7d5-cca7-4e29-bf12-e472b1730340. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:36:19 user nova-compute[73497]: DEBUG nova.network.neutron [req-56c16488-74a3-4485-8d07-eb0ee78dea80 req-c5532a29-963c-4150-a11a-c91a04a5f938 service nova] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Updating instance_info_cache with network_info: [{"id": "cbcbd7d5-cca7-4e29-bf12-e472b1730340", "address": "fa:16:3e:f0:47:cf", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbcbd7d5-cc", "ovs_interfaceid": "cbcbd7d5-cca7-4e29-bf12-e472b1730340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:36:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-56c16488-74a3-4485-8d07-eb0ee78dea80 req-c5532a29-963c-4150-a11a-c91a04a5f938 service nova] Releasing lock "refresh_cache-94425d3d-4703-434f-8a58-19a334b44d69" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:36:20 user nova-compute[73497]: DEBUG nova.compute.manager [req-654aaf19-fa7f-4070-8242-36198dd88c08 req-64c6e8b1-5082-4e02-a358-2590af8bc989 service nova] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Received event network-changed-fbcd036f-eab6-435d-9eb6-856c76c37245 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:36:20 user nova-compute[73497]: DEBUG nova.compute.manager [req-654aaf19-fa7f-4070-8242-36198dd88c08 req-64c6e8b1-5082-4e02-a358-2590af8bc989 service nova] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Refreshing instance network info cache due to event network-changed-fbcd036f-eab6-435d-9eb6-856c76c37245. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:36:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-654aaf19-fa7f-4070-8242-36198dd88c08 req-64c6e8b1-5082-4e02-a358-2590af8bc989 service nova] Acquiring lock "refresh_cache-358ed2d7-4452-40cf-9fed-d9a8e45b5c99" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:36:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-654aaf19-fa7f-4070-8242-36198dd88c08 req-64c6e8b1-5082-4e02-a358-2590af8bc989 service nova] Acquired lock "refresh_cache-358ed2d7-4452-40cf-9fed-d9a8e45b5c99" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:36:20 user nova-compute[73497]: DEBUG nova.network.neutron [req-654aaf19-fa7f-4070-8242-36198dd88c08 req-64c6e8b1-5082-4e02-a358-2590af8bc989 service nova] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Refreshing network info cache for port fbcd036f-eab6-435d-9eb6-856c76c37245 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:36:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:20 user nova-compute[73497]: DEBUG nova.compute.manager [req-377086da-013d-4c1a-85b4-7dcefec4ae24 req-7c493801-b202-4b0e-b2a5-c6a5d1c72403 service nova] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Received event network-vif-plugged-cbcbd7d5-cca7-4e29-bf12-e472b1730340 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:36:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-377086da-013d-4c1a-85b4-7dcefec4ae24 req-7c493801-b202-4b0e-b2a5-c6a5d1c72403 service nova] Acquiring lock "94425d3d-4703-434f-8a58-19a334b44d69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:36:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-377086da-013d-4c1a-85b4-7dcefec4ae24 req-7c493801-b202-4b0e-b2a5-c6a5d1c72403 service nova] Lock "94425d3d-4703-434f-8a58-19a334b44d69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:36:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-377086da-013d-4c1a-85b4-7dcefec4ae24 req-7c493801-b202-4b0e-b2a5-c6a5d1c72403 service nova] Lock "94425d3d-4703-434f-8a58-19a334b44d69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:36:20 user nova-compute[73497]: DEBUG nova.compute.manager [req-377086da-013d-4c1a-85b4-7dcefec4ae24 req-7c493801-b202-4b0e-b2a5-c6a5d1c72403 service nova] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] No waiting events found dispatching network-vif-plugged-cbcbd7d5-cca7-4e29-bf12-e472b1730340 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:36:20 user nova-compute[73497]: WARNING nova.compute.manager [req-377086da-013d-4c1a-85b4-7dcefec4ae24 req-7c493801-b202-4b0e-b2a5-c6a5d1c72403 service nova] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Received unexpected event network-vif-plugged-cbcbd7d5-cca7-4e29-bf12-e472b1730340 for instance with vm_state building and task_state spawning.
Aug 26 23:36:21 user nova-compute[73497]: DEBUG nova.network.neutron [req-654aaf19-fa7f-4070-8242-36198dd88c08 req-64c6e8b1-5082-4e02-a358-2590af8bc989 service nova] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Updated VIF entry in instance network info cache for port fbcd036f-eab6-435d-9eb6-856c76c37245. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:36:21 user nova-compute[73497]: DEBUG nova.network.neutron [req-654aaf19-fa7f-4070-8242-36198dd88c08 req-64c6e8b1-5082-4e02-a358-2590af8bc989 service nova] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Updating instance_info_cache with network_info: [{"id": "fbcd036f-eab6-435d-9eb6-856c76c37245", "address": "fa:16:3e:78:80:dc", "network": {"id": "ab93ff2a-6428-4e0e-a9a8-afbd83b56307", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-918557970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30fe9ca93aa48ba84fb9a5ad89334c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbcd036f-ea", "ovs_interfaceid": "fbcd036f-eab6-435d-9eb6-856c76c37245", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:36:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-654aaf19-fa7f-4070-8242-36198dd88c08 req-64c6e8b1-5082-4e02-a358-2590af8bc989 service nova] Releasing lock "refresh_cache-358ed2d7-4452-40cf-9fed-d9a8e45b5c99" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:36:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:22 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693092967.8496096, 043294e5-0618-4a31-bb19-1227ef1f5d39 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:36:22 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] VM Stopped (Lifecycle Event)
Aug 26 23:36:22 user nova-compute[73497]: DEBUG nova.compute.manager [None req-1cef46d8-2040-4cc9-ae26-5d2fd36ab3cc None None] [instance: 043294e5-0618-4a31-bb19-1227ef1f5d39] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:36:23 user nova-compute[73497]: DEBUG nova.compute.manager [req-98c8bf63-6a16-4a31-b7a3-cddfb735f638 req-88e18c00-1c91-497f-9fab-5320c1ffb1da service nova] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Received event network-vif-plugged-cbcbd7d5-cca7-4e29-bf12-e472b1730340 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:36:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-98c8bf63-6a16-4a31-b7a3-cddfb735f638 req-88e18c00-1c91-497f-9fab-5320c1ffb1da service nova] Acquiring lock "94425d3d-4703-434f-8a58-19a334b44d69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:36:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-98c8bf63-6a16-4a31-b7a3-cddfb735f638 req-88e18c00-1c91-497f-9fab-5320c1ffb1da service nova] Lock "94425d3d-4703-434f-8a58-19a334b44d69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:36:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-98c8bf63-6a16-4a31-b7a3-cddfb735f638 req-88e18c00-1c91-497f-9fab-5320c1ffb1da service nova] Lock "94425d3d-4703-434f-8a58-19a334b44d69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:36:23 user nova-compute[73497]: DEBUG nova.compute.manager [req-98c8bf63-6a16-4a31-b7a3-cddfb735f638 req-88e18c00-1c91-497f-9fab-5320c1ffb1da service nova] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] No waiting events found dispatching network-vif-plugged-cbcbd7d5-cca7-4e29-bf12-e472b1730340 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:36:23 user nova-compute[73497]: WARNING nova.compute.manager [req-98c8bf63-6a16-4a31-b7a3-cddfb735f638 req-88e18c00-1c91-497f-9fab-5320c1ffb1da service nova] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Received unexpected event network-vif-plugged-cbcbd7d5-cca7-4e29-bf12-e472b1730340 for instance with vm_state building and task_state spawning.
Aug 26 23:36:23 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092983.081353, 94425d3d-4703-434f-8a58-19a334b44d69 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:36:23 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] VM Resumed (Lifecycle Event)
Aug 26 23:36:23 user nova-compute[73497]: DEBUG nova.compute.manager [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:36:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:36:23 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Instance spawned successfully.
Aug 26 23:36:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:36:23 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:36:23 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:36:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:36:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:36:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:36:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:36:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:36:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:36:23 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:36:23 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693092983.086078, 94425d3d-4703-434f-8a58-19a334b44d69 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:36:23 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] VM Started (Lifecycle Event)
Aug 26 23:36:23 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:36:23 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:36:23 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:36:23 user nova-compute[73497]: INFO nova.compute.manager [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Took 6.29 seconds to spawn the instance on the hypervisor.
Aug 26 23:36:23 user nova-compute[73497]: DEBUG nova.compute.manager [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:36:23 user nova-compute[73497]: INFO nova.compute.manager [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Took 6.92 seconds to build instance.
Aug 26 23:36:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-41e36de7-a1e7-4637-a353-8859b223c8c4 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "94425d3d-4703-434f-8a58-19a334b44d69" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.020s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:36:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Acquiring lock "358ed2d7-4452-40cf-9fed-d9a8e45b5c99" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:36:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Lock "358ed2d7-4452-40cf-9fed-d9a8e45b5c99" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:36:26 user nova-compute[73497]: DEBUG nova.objects.instance [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Lazy-loading 'flavor' on Instance uuid 358ed2d7-4452-40cf-9fed-d9a8e45b5c99 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:36:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Lock "358ed2d7-4452-40cf-9fed-d9a8e45b5c99" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:36:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Acquiring lock "358ed2d7-4452-40cf-9fed-d9a8e45b5c99" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:36:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Lock "358ed2d7-4452-40cf-9fed-d9a8e45b5c99" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:36:26 user nova-compute[73497]: INFO nova.compute.manager [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Attaching volume eec7c57c-759d-440d-b34c-645e2fe8f524 to /dev/vdb
Aug 26 23:36:26 user nova-compute[73497]: DEBUG os_brick.utils [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:36:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4860918d-bcc1-4826-80e8-556699a9d210]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[817877ae-1d6d-4b92-9314-4a1d31fb36dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[976a5df7-b7e5-4d26-a73b-1e0f8ecd4bfb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae26d78d-42de-4048-abfa-6afc96e9bf10]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:36:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:36:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:26 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:36:26 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:36:26 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a06bab1-fddc-4b6e-92c8-104b9c8be156]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:36:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:36:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:36:26 user nova-compute[73497]: DEBUG os_brick.utils [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:36:26 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Updating existing volume attachment record: 279e2158-8e6b-4503-be08-ee55c6e649d8 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:36:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RAizjZGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:36:32 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:36:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:36:32 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:36:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:36:32 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:36:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c872e694-b549-4d5e-a4e5-333ed6d6473c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:36:32 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6779f2a5-18de-4b1f-90cd-04e6f036b889]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3] added
Aug 26 23:36:32 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c000ea5-20f8-4f6c-8a14-4b3dcc301cae]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.207s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6626eeb4-f846-42c4-ad6a-ebe3f3fffe00]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RAizjZGv {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RAizjZGv" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bed613-115c-4c11-a9a0-ab0124494416]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RAizjZGv'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d4c8f4-696c-4ab7-8ccd-6627f36e05b5]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[071605b5-ee3c-45e9-b66a-7c5d21d490d8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 23:36:32 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 23:36:32 user nova-compute[73497]:  {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:36:32 user nova-compute[73497]: WARNING os_brick.initiator.connectors.iscsi [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 23:36:32 user nova-compute[73497]: 
Aug 26 23:36:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7aa4ab2-5c69-434a-8862-df33a0e20cef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3, portal: 172.16.0.220,3260]
Aug 26 23:36:32 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3, portal: 172.16.0.220,3260] successful.
Aug 26 23:36:32 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8f75c5-71b5-4219-9261-5264611c8513]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[135ae1d3-8b5e-47fe-8a4a-467148832d5d]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 (non-flash)
Aug 26 23:36:32 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 (non-flash)
Aug 26 23:36:32 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.474s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[173ee2e0-2a0b-4b25-bb9e-63674b1ef08f]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:32 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: None {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:36:33 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:36:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RAizjZGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:36:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.509s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:36:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] <== connect_volume: return (1510ms) {'type': 'block', 'scsi_wwn': '23963313765633830', 'path': '/dev/sdb'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:36:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963313765633830', 'path': '/dev/sdb'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:36:33 user nova-compute[73497]: DEBUG nova.objects.instance [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lazy-loading 'flavor' on Instance uuid 2b2d2380-d861-46c4-b13c-36b4f48cca77 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:36:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 23:36:33 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:36:33 user nova-compute[73497]:   <source dev="/dev/sdb"/>
Aug 26 23:36:33 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:36:33 user nova-compute[73497]:   <serial>4772d294-ae64-43aa-beb4-d3ca4e63a6f3</serial>
Aug 26 23:36:33 user nova-compute[73497]: </disk>
Aug 26 23:36:33 user nova-compute[73497]:  {{(pid=73497) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 23:36:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:36:34 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:36:34 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:36:34 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] No VIF found with MAC fa:16:3e:8a:9c:5b, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:36:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f70b15e8-e680-4b1b-a134-24e483ebcd22 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "2b2d2380-d861-46c4-b13c-36b4f48cca77" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 45.038s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:36:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:36:37 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kQwdpRDs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:36:37 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:36:37 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:36:37 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:36:37 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:36:37 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:36:37 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:36:37 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:36:37 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:37 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:37 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff433e38-8bde-4110-ae64-32de4d234ab1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:37 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:36:37 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:36:37 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:37 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:37 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddf000b-e67b-4f33-9a27-3c6f282dc496]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:37 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524] added
Aug 26 23:36:37 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:36:37 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:37 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:37 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[caebbb43-59c6-4e39-9067-0c977ab511ed]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:37 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:36:37 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:37 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:37 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a364e3-b787-4a3f-b594-68f18b6444e0]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:37 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:36:37 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kQwdpRDs {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kQwdpRDs" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:38 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bee3891-7f03-4135-b553-a38a2b0e3d21]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kQwdpRDs'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:36:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:38 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c2abb2-42dc-443b-86d8-b0c0932d295b]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:36:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:38 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db27cdc-5349-440f-8f84-3829dba09e93]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 (non-flash)
Aug 26 23:36:38 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:36:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 (non-flash)
Aug 26 23:36:38 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:36:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:38 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf43581-6252-4560-a724-ac855cdc0aa6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524, portal: 172.16.0.220,3260]
Aug 26 23:36:38 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524, portal: 172.16.0.220,3260] successful.
Aug 26 23:36:38 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:36:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:38 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41de83e-d72a-4dc6-a12a-07a5153515a6]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:36:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:38 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e100c290-4dec-4266-9c54-cb1f39a69925]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 (non-flash)
Aug 26 23:36:38 user nova-compute[73497]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524 (non-flash)
Aug 26 23:36:38 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:36:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 (non-flash)
Aug 26 23:36:38 user nova-compute[73497]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524 (non-flash)
Aug 26 23:36:38 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:36:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:36:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:36:38 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:36:38 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:36:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:38 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5852c5-767a-485f-8f92-4851dd7819fd]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:38 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: None {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:36:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:39 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:36:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kQwdpRDs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:36:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:36:39 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26165666662616232', 'path': '/dev/sdc'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:36:39 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165666662616232', 'path': '/dev/sdc'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:36:39 user nova-compute[73497]: DEBUG nova.objects.instance [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Lazy-loading 'flavor' on Instance uuid 358ed2d7-4452-40cf-9fed-d9a8e45b5c99 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:36:39 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 23:36:39 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:36:39 user nova-compute[73497]:   <source dev="/dev/sdc"/>
Aug 26 23:36:39 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:36:39 user nova-compute[73497]:   <serial>eec7c57c-759d-440d-b34c-645e2fe8f524</serial>
Aug 26 23:36:39 user nova-compute[73497]: </disk>
Aug 26 23:36:39 user nova-compute[73497]:  {{(pid=73497) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 23:36:39 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:36:39 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:36:39 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] No VIF found with MAC fa:16:3e:78:80:dc, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:36:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ecff9b88-4bfd-49f5-95ec-f93698503a4f tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Lock "358ed2d7-4452-40cf-9fed-d9a8e45b5c99" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.490s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:36:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-09621f9b-078a-49bb-b14c-a8a0eb50e780 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Acquiring lock "358ed2d7-4452-40cf-9fed-d9a8e45b5c99" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:36:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-09621f9b-078a-49bb-b14c-a8a0eb50e780 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Lock "358ed2d7-4452-40cf-9fed-d9a8e45b5c99" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:36:41 user nova-compute[73497]: INFO nova.compute.manager [None req-09621f9b-078a-49bb-b14c-a8a0eb50e780 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Detaching volume eec7c57c-759d-440d-b34c-645e2fe8f524
Aug 26 23:36:41 user nova-compute[73497]: INFO nova.virt.block_device [None req-09621f9b-078a-49bb-b14c-a8a0eb50e780 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Attempting to driver detach volume eec7c57c-759d-440d-b34c-645e2fe8f524 from mountpoint /dev/vdb
Aug 26 23:36:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-09621f9b-078a-49bb-b14c-a8a0eb50e780 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Attempting to detach device vdb from instance 358ed2d7-4452-40cf-9fed-d9a8e45b5c99 from the persistent domain config. {{(pid=73497) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 23:36:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-09621f9b-078a-49bb-b14c-a8a0eb50e780 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:36:41 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:36:41 user nova-compute[73497]:   <source dev="/dev/sdc"/>
Aug 26 23:36:41 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:36:41 user nova-compute[73497]:   <serial>eec7c57c-759d-440d-b34c-645e2fe8f524</serial>
Aug 26 23:36:41 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:36:41 user nova-compute[73497]: </disk>
Aug 26 23:36:41 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:36:41 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-09621f9b-078a-49bb-b14c-a8a0eb50e780 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Successfully detached device vdb from instance 358ed2d7-4452-40cf-9fed-d9a8e45b5c99 from the persistent domain config.
Aug 26 23:36:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-09621f9b-078a-49bb-b14c-a8a0eb50e780 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 358ed2d7-4452-40cf-9fed-d9a8e45b5c99 from the live domain config. {{(pid=73497) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 23:36:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-09621f9b-078a-49bb-b14c-a8a0eb50e780 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:36:41 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:36:41 user nova-compute[73497]:   <source dev="/dev/sdc"/>
Aug 26 23:36:41 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:36:41 user nova-compute[73497]:   <serial>eec7c57c-759d-440d-b34c-645e2fe8f524</serial>
Aug 26 23:36:41 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:36:41 user nova-compute[73497]: </disk>
Aug 26 23:36:41 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Received event <DeviceRemovedEvent: 1693093002.4483042, 358ed2d7-4452-40cf-9fed-d9a8e45b5c99 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73497) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-09621f9b-078a-49bb-b14c-a8a0eb50e780 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 358ed2d7-4452-40cf-9fed-d9a8e45b5c99 {{(pid=73497) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 23:36:42 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-09621f9b-078a-49bb-b14c-a8a0eb50e780 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Successfully detached device vdb from instance 358ed2d7-4452-40cf-9fed-d9a8e45b5c99 from the live domain config.
Aug 26 23:36:42 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09621f9b-078a-49bb-b14c-a8a0eb50e780 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-09621f9b-078a-49bb-b14c-a8a0eb50e780 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kQwdpRDs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:36:42 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-09621f9b-078a-49bb-b14c-a8a0eb50e780 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:36:42 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-09621f9b-078a-49bb-b14c-a8a0eb50e780 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-09621f9b-078a-49bb-b14c-a8a0eb50e780 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-09621f9b-078a-49bb-b14c-a8a0eb50e780 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51ec3a3-6fa9-498e-8e0a-d6ccd815bec8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3fab6d-e269-4364-9279-6c6801d51053]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-09621f9b-078a-49bb-b14c-a8a0eb50e780 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 (non-flash)
Aug 26 23:36:42 user nova-compute[73497]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524 (non-flash)
Aug 26 23:36:42 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-09621f9b-078a-49bb-b14c-a8a0eb50e780 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 (non-flash)
Aug 26 23:36:42 user nova-compute[73497]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524 (non-flash)
Aug 26 23:36:42 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-09621f9b-078a-49bb-b14c-a8a0eb50e780 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281c303b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524'): ({'sdc'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-09621f9b-078a-49bb-b14c-a8a0eb50e780 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Removing single pathed devices sdc {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f076fb80-68fe-4a0f-a4b8-1302570105a5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f9f20d-b8e9-4b84-908a-3dc1931ea3ff]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-09621f9b-078a-49bb-b14c-a8a0eb50e780 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Flushing IO for device /dev/sdc {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf437d38-d0e8-4e26-8695-4add092c6756]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-09621f9b-078a-49bb-b14c-a8a0eb50e780 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdde12b-8290-4050-9b9f-8ac58c82a69a]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-09621f9b-078a-49bb-b14c-a8a0eb50e780 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-09621f9b-078a-49bb-b14c-a8a0eb50e780 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] SCSI volumes sdc have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-09621f9b-078a-49bb-b14c-a8a0eb50e780 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e6a370-ed16-489f-b7cd-8b109b3bda54]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-09621f9b-078a-49bb-b14c-a8a0eb50e780 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afc539f-a7dc-4082-80e9-e862efe10fe7]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-09621f9b-078a-49bb-b14c-a8a0eb50e780 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524, portal: 172.16.0.220,3260]
Aug 26 23:36:42 user nova-compute[73497]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524, portal: 172.16.0.220,3260] successful.
Aug 26 23:36:42 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec7c57c-759d-440d-b34c-645e2fe8f524 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcb5d02-b8b7-49eb-a372-610be89dcfb2]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-09621f9b-078a-49bb-b14c-a8a0eb50e780 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-09621f9b-078a-49bb-b14c-a8a0eb50e780 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-09621f9b-078a-49bb-b14c-a8a0eb50e780 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] <== disconnect_volume: return (310ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:36:42 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09621f9b-078a-49bb-b14c-a8a0eb50e780 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:36:43 user nova-compute[73497]: DEBUG nova.objects.instance [None req-09621f9b-078a-49bb-b14c-a8a0eb50e780 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Lazy-loading 'flavor' on Instance uuid 358ed2d7-4452-40cf-9fed-d9a8e45b5c99 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:36:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-09621f9b-078a-49bb-b14c-a8a0eb50e780 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Lock "358ed2d7-4452-40cf-9fed-d9a8e45b5c99" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.784s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:36:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:36:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:36:43 user nova-compute[73497]: DEBUG nova.objects.instance [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lazy-loading 'flavor' on Instance uuid f1fa7599-72de-487d-9b0e-0adf8c0120ca {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:36:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:36:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:36:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:36:44 user nova-compute[73497]: INFO nova.compute.manager [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Attaching volume 5df2b0ba-df91-442b-bc03-1781ad1ee6f5 to /dev/vdb
Aug 26 23:36:44 user nova-compute[73497]: DEBUG os_brick.utils [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:36:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:44 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0245699-43a6-4942-b00f-188573cf3fdd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:44 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd5eb28-f5e4-46b1-8fdb-73a802889c59]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:44 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3309ed-2e81-4481-835e-5df3411dd802]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:44 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[82abfc76-539a-4848-894a-77bf1e3df8e7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:36:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:36:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:36:44 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:36:44 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b15dee0-0241-4636-85db-72524c1c9e84]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:36:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:36:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:36:44 user nova-compute[73497]: DEBUG os_brick.utils [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:36:44 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Updating existing volume attachment record: 9df0390e-7185-46a3-914c-aaf35eb8b2f8 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:36:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:48 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dkxrWfmD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:36:56 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:36:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:36:56 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:36:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:36:56 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:36:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdb4ff7-9df4-4ca6-8091-f8b116f6c284]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:36:56 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[717af4cf-d617-436d-bcd7-075e14f8890f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5] added
Aug 26 23:36:56 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[253c9c16-8620-41af-8116-525b3a017705]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1514d893-a443-453b-9da4-1a29f9bc054f]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dkxrWfmD {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dkxrWfmD" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[711c8990-70b3-4db9-b42e-b339c37a8cbc]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dkxrWfmD'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0468fde7-c986-4d91-a596-7aca574995f1]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3893f050-7897-40df-a656-9f090bbf8574]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 (non-flash)
Aug 26 23:36:56 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 (non-flash)
Aug 26 23:36:56 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5077f8ac-0f69-47eb-9422-b05774592a4c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5, portal: 172.16.0.220,3260]
Aug 26 23:36:56 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5, portal: 172.16.0.220,3260] successful.
Aug 26 23:36:56 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6781ec-13b0-46d7-9de0-134e5387b244]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[835c7bcb-92a1-48c3-b231-bf3007e2848a]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 (non-flash)
Aug 26 23:36:56 user nova-compute[73497]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)
Aug 26 23:36:56 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 (non-flash)
Aug 26 23:36:56 user nova-compute[73497]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)
Aug 26 23:36:56 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9fc9e5-7335-4bbc-9b90-5d231e410e3f]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:36:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dkxrWfmD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:36:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:57 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:36:57 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '26130613361326562', 'path': '/dev/sdc'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:36:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130613361326562', 'path': '/dev/sdc'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:36:57 user nova-compute[73497]: DEBUG nova.objects.instance [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lazy-loading 'flavor' on Instance uuid f1fa7599-72de-487d-9b0e-0adf8c0120ca {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:36:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 23:36:57 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:36:57 user nova-compute[73497]:   <source dev="/dev/sdc"/>
Aug 26 23:36:57 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:36:57 user nova-compute[73497]:   <serial>5df2b0ba-df91-442b-bc03-1781ad1ee6f5</serial>
Aug 26 23:36:57 user nova-compute[73497]: </disk>
Aug 26 23:36:57 user nova-compute[73497]:  {{(pid=73497) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 23:36:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:36:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:36:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:36:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] No VIF found with MAC fa:16:3e:f0:fe:b5, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:36:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-a10ce749-5b76-4827-bf73-5bbef3374dfc tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.910s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:36:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:00 user nova-compute[73497]: DEBUG nova.compute.manager [req-577416a5-5dc5-4e4d-b0e7-d5bc49cedc39 req-c000463c-d72b-4be9-9b2c-00bc40647b82 service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Received event network-changed-4f594b38-986f-42c8-bb69-4caeabfe1b56 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:37:00 user nova-compute[73497]: DEBUG nova.compute.manager [req-577416a5-5dc5-4e4d-b0e7-d5bc49cedc39 req-c000463c-d72b-4be9-9b2c-00bc40647b82 service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Refreshing instance network info cache due to event network-changed-4f594b38-986f-42c8-bb69-4caeabfe1b56. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:37:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-577416a5-5dc5-4e4d-b0e7-d5bc49cedc39 req-c000463c-d72b-4be9-9b2c-00bc40647b82 service nova] Acquiring lock "refresh_cache-f1fa7599-72de-487d-9b0e-0adf8c0120ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:37:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-577416a5-5dc5-4e4d-b0e7-d5bc49cedc39 req-c000463c-d72b-4be9-9b2c-00bc40647b82 service nova] Acquired lock "refresh_cache-f1fa7599-72de-487d-9b0e-0adf8c0120ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:37:00 user nova-compute[73497]: DEBUG nova.network.neutron [req-577416a5-5dc5-4e4d-b0e7-d5bc49cedc39 req-c000463c-d72b-4be9-9b2c-00bc40647b82 service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Refreshing network info cache for port 4f594b38-986f-42c8-bb69-4caeabfe1b56 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:37:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:01 user nova-compute[73497]: DEBUG nova.network.neutron [req-577416a5-5dc5-4e4d-b0e7-d5bc49cedc39 req-c000463c-d72b-4be9-9b2c-00bc40647b82 service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Updated VIF entry in instance network info cache for port 4f594b38-986f-42c8-bb69-4caeabfe1b56. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:37:01 user nova-compute[73497]: DEBUG nova.network.neutron [req-577416a5-5dc5-4e4d-b0e7-d5bc49cedc39 req-c000463c-d72b-4be9-9b2c-00bc40647b82 service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Updating instance_info_cache with network_info: [{"id": "4f594b38-986f-42c8-bb69-4caeabfe1b56", "address": "fa:16:3e:f0:fe:b5", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f594b38-98", "ovs_interfaceid": "4f594b38-986f-42c8-bb69-4caeabfe1b56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:37:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-577416a5-5dc5-4e4d-b0e7-d5bc49cedc39 req-c000463c-d72b-4be9-9b2c-00bc40647b82 service nova] Releasing lock "refresh_cache-f1fa7599-72de-487d-9b0e-0adf8c0120ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:37:02 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:37:02 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:37:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-4775f2c4-cd7a-4c25-83e7-d4143cd97a5f req-92e7d6c0-6e74-40d8-8827-10c4561bfe38 service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Received event network-changed-4f594b38-986f-42c8-bb69-4caeabfe1b56 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:37:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-4775f2c4-cd7a-4c25-83e7-d4143cd97a5f req-92e7d6c0-6e74-40d8-8827-10c4561bfe38 service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Refreshing instance network info cache due to event network-changed-4f594b38-986f-42c8-bb69-4caeabfe1b56. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:37:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4775f2c4-cd7a-4c25-83e7-d4143cd97a5f req-92e7d6c0-6e74-40d8-8827-10c4561bfe38 service nova] Acquiring lock "refresh_cache-f1fa7599-72de-487d-9b0e-0adf8c0120ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:37:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4775f2c4-cd7a-4c25-83e7-d4143cd97a5f req-92e7d6c0-6e74-40d8-8827-10c4561bfe38 service nova] Acquired lock "refresh_cache-f1fa7599-72de-487d-9b0e-0adf8c0120ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:37:03 user nova-compute[73497]: DEBUG nova.network.neutron [req-4775f2c4-cd7a-4c25-83e7-d4143cd97a5f req-92e7d6c0-6e74-40d8-8827-10c4561bfe38 service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Refreshing network info cache for port 4f594b38-986f-42c8-bb69-4caeabfe1b56 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:37:03 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:37:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:37:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:37:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:37:03 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:37:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1fa7599-72de-487d-9b0e-0adf8c0120ca/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1fa7599-72de-487d-9b0e-0adf8c0120ca/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1fa7599-72de-487d-9b0e-0adf8c0120ca/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8ceffa6c-5b61-4436-9d57-0f27740fed72 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:37:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8ceffa6c-5b61-4436-9d57-0f27740fed72 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:37:03 user nova-compute[73497]: INFO nova.compute.manager [None req-8ceffa6c-5b61-4436-9d57-0f27740fed72 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Rebooting instance
Aug 26 23:37:03 user nova-compute[73497]: DEBUG nova.network.neutron [req-4775f2c4-cd7a-4c25-83e7-d4143cd97a5f req-92e7d6c0-6e74-40d8-8827-10c4561bfe38 service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Updated VIF entry in instance network info cache for port 4f594b38-986f-42c8-bb69-4caeabfe1b56. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:37:03 user nova-compute[73497]: DEBUG nova.network.neutron [req-4775f2c4-cd7a-4c25-83e7-d4143cd97a5f req-92e7d6c0-6e74-40d8-8827-10c4561bfe38 service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Updating instance_info_cache with network_info: [{"id": "4f594b38-986f-42c8-bb69-4caeabfe1b56", "address": "fa:16:3e:f0:fe:b5", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f594b38-98", "ovs_interfaceid": "4f594b38-986f-42c8-bb69-4caeabfe1b56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:37:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8ceffa6c-5b61-4436-9d57-0f27740fed72 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "refresh_cache-f1fa7599-72de-487d-9b0e-0adf8c0120ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:37:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4775f2c4-cd7a-4c25-83e7-d4143cd97a5f req-92e7d6c0-6e74-40d8-8827-10c4561bfe38 service nova] Releasing lock "refresh_cache-f1fa7599-72de-487d-9b0e-0adf8c0120ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:37:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8ceffa6c-5b61-4436-9d57-0f27740fed72 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquired lock "refresh_cache-f1fa7599-72de-487d-9b0e-0adf8c0120ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:37:03 user nova-compute[73497]: DEBUG nova.network.neutron [None req-8ceffa6c-5b61-4436-9d57-0f27740fed72 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:37:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1fa7599-72de-487d-9b0e-0adf8c0120ca/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:03 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:37:03 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2d2380-d861-46c4-b13c-36b4f48cca77/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2d2380-d861-46c4-b13c-36b4f48cca77/disk --force-share --output=json" returned: 0 in 0.301s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2d2380-d861-46c4-b13c-36b4f48cca77/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2d2380-d861-46c4-b13c-36b4f48cca77/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:04 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:37:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94425d3d-4703-434f-8a58-19a334b44d69/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:04 user nova-compute[73497]: DEBUG nova.network.neutron [None req-8ceffa6c-5b61-4436-9d57-0f27740fed72 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Updating instance_info_cache with network_info: [{"id": "4f594b38-986f-42c8-bb69-4caeabfe1b56", "address": "fa:16:3e:f0:fe:b5", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f594b38-98", "ovs_interfaceid": "4f594b38-986f-42c8-bb69-4caeabfe1b56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:37:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8ceffa6c-5b61-4436-9d57-0f27740fed72 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Releasing lock "refresh_cache-f1fa7599-72de-487d-9b0e-0adf8c0120ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:37:04 user nova-compute[73497]: DEBUG nova.compute.manager [None req-8ceffa6c-5b61-4436-9d57-0f27740fed72 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:37:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94425d3d-4703-434f-8a58-19a334b44d69/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94425d3d-4703-434f-8a58-19a334b44d69/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94425d3d-4703-434f-8a58-19a334b44d69/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358ed2d7-4452-40cf-9fed-d9a8e45b5c99/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358ed2d7-4452-40cf-9fed-d9a8e45b5c99/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358ed2d7-4452-40cf-9fed-d9a8e45b5c99/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358ed2d7-4452-40cf-9fed-d9a8e45b5c99/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:05 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:37:05 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:37:05 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8112MB free_disk=25.07220458984375GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:37:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:37:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:37:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 2b2d2380-d861-46c4-b13c-36b4f48cca77 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:37:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 358ed2d7-4452-40cf-9fed-d9a8e45b5c99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:37:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance f1fa7599-72de-487d-9b0e-0adf8c0120ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:37:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 94425d3d-4703-434f-8a58-19a334b44d69 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:37:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:37:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:37:06 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:37:06 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:37:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:37:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.364s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:37:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:07 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:37:07 user nova-compute[73497]: DEBUG nova.compute.manager [req-d0ba1257-0746-4aa0-bfbe-31047d3ecc6e req-e47b10c2-6678-403b-b2c5-20eb5cf6d94e service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Received event network-vif-unplugged-4f594b38-986f-42c8-bb69-4caeabfe1b56 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:37:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d0ba1257-0746-4aa0-bfbe-31047d3ecc6e req-e47b10c2-6678-403b-b2c5-20eb5cf6d94e service nova] Acquiring lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:37:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d0ba1257-0746-4aa0-bfbe-31047d3ecc6e req-e47b10c2-6678-403b-b2c5-20eb5cf6d94e service nova] Lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:37:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d0ba1257-0746-4aa0-bfbe-31047d3ecc6e req-e47b10c2-6678-403b-b2c5-20eb5cf6d94e service nova] Lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:37:07 user nova-compute[73497]: DEBUG nova.compute.manager [req-d0ba1257-0746-4aa0-bfbe-31047d3ecc6e req-e47b10c2-6678-403b-b2c5-20eb5cf6d94e service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] No waiting events found dispatching network-vif-unplugged-4f594b38-986f-42c8-bb69-4caeabfe1b56 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:37:07 user nova-compute[73497]: WARNING nova.compute.manager [req-d0ba1257-0746-4aa0-bfbe-31047d3ecc6e req-e47b10c2-6678-403b-b2c5-20eb5cf6d94e service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Received unexpected event network-vif-unplugged-4f594b38-986f-42c8-bb69-4caeabfe1b56 for instance with vm_state active and task_state reboot_started.
Aug 26 23:37:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:08 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-8ceffa6c-5b61-4436-9d57-0f27740fed72 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Instance shutdown successfully.
Aug 26 23:37:08 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:37:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:09 user nova-compute[73497]: DEBUG nova.compute.manager [req-7dcdec59-100c-45d5-970f-8ca0fcb7bd8d req-b31b4b73-ba52-4031-951c-f76da3101f37 service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Received event network-vif-plugged-4f594b38-986f-42c8-bb69-4caeabfe1b56 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:37:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7dcdec59-100c-45d5-970f-8ca0fcb7bd8d req-b31b4b73-ba52-4031-951c-f76da3101f37 service nova] Acquiring lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:37:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7dcdec59-100c-45d5-970f-8ca0fcb7bd8d req-b31b4b73-ba52-4031-951c-f76da3101f37 service nova] Lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:37:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-7dcdec59-100c-45d5-970f-8ca0fcb7bd8d req-b31b4b73-ba52-4031-951c-f76da3101f37 service nova] Lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:37:09 user nova-compute[73497]: DEBUG nova.compute.manager [req-7dcdec59-100c-45d5-970f-8ca0fcb7bd8d req-b31b4b73-ba52-4031-951c-f76da3101f37 service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] No waiting events found dispatching network-vif-plugged-4f594b38-986f-42c8-bb69-4caeabfe1b56 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:37:09 user nova-compute[73497]: WARNING nova.compute.manager [req-7dcdec59-100c-45d5-970f-8ca0fcb7bd8d req-b31b4b73-ba52-4031-951c-f76da3101f37 service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Received unexpected event network-vif-plugged-4f594b38-986f-42c8-bb69-4caeabfe1b56 for instance with vm_state active and task_state reboot_started.
Aug 26 23:37:10 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:10 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:10 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:11 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:37:11 user nova-compute[73497]: DEBUG nova.compute.manager [req-279a4415-db61-4b32-9cb0-1e1cb62cc00a req-5329b77f-35c8-4f56-be43-db314b7bd03e service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Received event network-vif-plugged-4f594b38-986f-42c8-bb69-4caeabfe1b56 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:37:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-279a4415-db61-4b32-9cb0-1e1cb62cc00a req-5329b77f-35c8-4f56-be43-db314b7bd03e service nova] Acquiring lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:37:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-279a4415-db61-4b32-9cb0-1e1cb62cc00a req-5329b77f-35c8-4f56-be43-db314b7bd03e service nova] Lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:37:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-279a4415-db61-4b32-9cb0-1e1cb62cc00a req-5329b77f-35c8-4f56-be43-db314b7bd03e service nova] Lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:37:11 user nova-compute[73497]: DEBUG nova.compute.manager [req-279a4415-db61-4b32-9cb0-1e1cb62cc00a req-5329b77f-35c8-4f56-be43-db314b7bd03e service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] No waiting events found dispatching network-vif-plugged-4f594b38-986f-42c8-bb69-4caeabfe1b56 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:37:11 user nova-compute[73497]: WARNING nova.compute.manager [req-279a4415-db61-4b32-9cb0-1e1cb62cc00a req-5329b77f-35c8-4f56-be43-db314b7bd03e service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Received unexpected event network-vif-plugged-4f594b38-986f-42c8-bb69-4caeabfe1b56 for instance with vm_state active and task_state reboot_started.
Aug 26 23:37:11 user nova-compute[73497]: DEBUG nova.compute.manager [req-279a4415-db61-4b32-9cb0-1e1cb62cc00a req-5329b77f-35c8-4f56-be43-db314b7bd03e service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Received event network-vif-plugged-4f594b38-986f-42c8-bb69-4caeabfe1b56 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:37:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-279a4415-db61-4b32-9cb0-1e1cb62cc00a req-5329b77f-35c8-4f56-be43-db314b7bd03e service nova] Acquiring lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:37:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-279a4415-db61-4b32-9cb0-1e1cb62cc00a req-5329b77f-35c8-4f56-be43-db314b7bd03e service nova] Lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:37:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-279a4415-db61-4b32-9cb0-1e1cb62cc00a req-5329b77f-35c8-4f56-be43-db314b7bd03e service nova] Lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:37:11 user nova-compute[73497]: DEBUG nova.compute.manager [req-279a4415-db61-4b32-9cb0-1e1cb62cc00a req-5329b77f-35c8-4f56-be43-db314b7bd03e service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] No waiting events found dispatching network-vif-plugged-4f594b38-986f-42c8-bb69-4caeabfe1b56 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:37:11 user nova-compute[73497]: WARNING nova.compute.manager [req-279a4415-db61-4b32-9cb0-1e1cb62cc00a req-5329b77f-35c8-4f56-be43-db314b7bd03e service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Received unexpected event network-vif-plugged-4f594b38-986f-42c8-bb69-4caeabfe1b56 for instance with vm_state active and task_state reboot_started.
Aug 26 23:37:11 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-637e650d-452d-4192-8976-09f50273a439 None None] Removed pending event for f1fa7599-72de-487d-9b0e-0adf8c0120ca due to event {{(pid=73497) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 23:37:11 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693093031.922891, f1fa7599-72de-487d-9b0e-0adf8c0120ca => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:37:11 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] VM Resumed (Lifecycle Event)
Aug 26 23:37:11 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Instance running successfully.
Aug 26 23:37:11 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-8ceffa6c-5b61-4436-9d57-0f27740fed72 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Instance soft rebooted successfully.
Aug 26 23:37:11 user nova-compute[73497]: DEBUG nova.compute.manager [None req-8ceffa6c-5b61-4436-9d57-0f27740fed72 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:37:11 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:37:11 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:37:11 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 26 23:37:11 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693093031.9238575, f1fa7599-72de-487d-9b0e-0adf8c0120ca => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:37:11 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] VM Started (Lifecycle Event)
Aug 26 23:37:12 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:37:12 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:37:12 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 26 23:37:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8ceffa6c-5b61-4436-9d57-0f27740fed72 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.281s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:37:12 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:37:12 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:37:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:14 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:37:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Acquiring lock "71518c06-a7d0-49fa-88de-ffb4af927f47" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:37:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lock "71518c06-a7d0-49fa-88de-ffb4af927f47" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:37:14 user nova-compute[73497]: DEBUG nova.compute.manager [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:37:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:37:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:37:14 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:37:14 user nova-compute[73497]: INFO nova.compute.claims [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Claim successful on node user
Aug 26 23:37:14 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:37:14 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:37:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.334s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:37:14 user nova-compute[73497]: DEBUG nova.compute.manager [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:37:15 user nova-compute[73497]: DEBUG nova.compute.manager [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:37:15 user nova-compute[73497]: DEBUG nova.network.neutron [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:37:15 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:37:15 user nova-compute[73497]: DEBUG nova.compute.manager [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:37:15 user nova-compute[73497]: DEBUG nova.policy [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '77ec603ab2da4a3584b0e4b0bcf2984b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '216a6e017cd94bbe96525e413d893e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:37:15 user nova-compute[73497]: INFO nova.virt.block_device [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Booting with volume ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 at /dev/vda
Aug 26 23:37:15 user nova-compute[73497]: DEBUG os_brick.utils [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:37:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:15 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb381e52-cb89-4962-9d42-766f7bfc1366]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:15 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17c0779-f515-4ccc-8eb0-836862c6bb9d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:15 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[11705aa0-cdd4-4c3d-bbef-2d6175efd6b3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:15 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1a4109-3901-4221-a079-5ce152a87a5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:37:15 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:37:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:37:15 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:37:15 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a54251-62d2-4270-a3c5-a119e9cedfbe]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:15 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:37:15 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:37:15 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:37:15 user nova-compute[73497]: DEBUG os_brick.utils [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:37:15 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Updating existing volume attachment record: 9cd1b15c-ddbf-4b38-bd51-4c0d7ae4d7c9 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:37:16 user nova-compute[73497]: DEBUG nova.network.neutron [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Successfully created port: 8ec486c2-3507-4e88-8c66-d3db44578a1b {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:37:16 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:37:16 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:37:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-358ed2d7-4452-40cf-9fed-d9a8e45b5c99" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:37:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-358ed2d7-4452-40cf-9fed-d9a8e45b5c99" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:37:16 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:37:16 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Updating instance_info_cache with network_info: [{"id": "fbcd036f-eab6-435d-9eb6-856c76c37245", "address": "fa:16:3e:78:80:dc", "network": {"id": "ab93ff2a-6428-4e0e-a9a8-afbd83b56307", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-918557970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30fe9ca93aa48ba84fb9a5ad89334c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbcd036f-ea", "ovs_interfaceid": "fbcd036f-eab6-435d-9eb6-856c76c37245", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:37:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-358ed2d7-4452-40cf-9fed-d9a8e45b5c99" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:37:16 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:37:17 user nova-compute[73497]: DEBUG nova.network.neutron [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Successfully updated port: 8ec486c2-3507-4e88-8c66-d3db44578a1b {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:37:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Acquiring lock "refresh_cache-71518c06-a7d0-49fa-88de-ffb4af927f47" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:37:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Acquired lock "refresh_cache-71518c06-a7d0-49fa-88de-ffb4af927f47" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:37:17 user nova-compute[73497]: DEBUG nova.network.neutron [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:37:17 user nova-compute[73497]: DEBUG nova.compute.manager [req-cfcfbd3b-22c1-4b41-9f88-a8dd6fb6f793 req-6e22b854-0d26-45a7-82e0-70a8e75fba02 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Received event network-changed-8ec486c2-3507-4e88-8c66-d3db44578a1b {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:37:17 user nova-compute[73497]: DEBUG nova.compute.manager [req-cfcfbd3b-22c1-4b41-9f88-a8dd6fb6f793 req-6e22b854-0d26-45a7-82e0-70a8e75fba02 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Refreshing instance network info cache due to event network-changed-8ec486c2-3507-4e88-8c66-d3db44578a1b. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:37:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cfcfbd3b-22c1-4b41-9f88-a8dd6fb6f793 req-6e22b854-0d26-45a7-82e0-70a8e75fba02 service nova] Acquiring lock "refresh_cache-71518c06-a7d0-49fa-88de-ffb4af927f47" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:37:17 user nova-compute[73497]: DEBUG nova.network.neutron [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:37:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:17 user nova-compute[73497]: DEBUG nova.network.neutron [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Updating instance_info_cache with network_info: [{"id": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "address": "fa:16:3e:ad:51:e7", "network": {"id": "1b5f252b-ef13-47fa-a49c-53f70d79ae43", "bridge": "br-int", "label": "tempest-TestShelveInstance-125614022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "216a6e017cd94bbe96525e413d893e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ec486c2-35", "ovs_interfaceid": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:37:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Releasing lock "refresh_cache-71518c06-a7d0-49fa-88de-ffb4af927f47" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:37:17 user nova-compute[73497]: DEBUG nova.compute.manager [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Instance network_info: |[{"id": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "address": "fa:16:3e:ad:51:e7", "network": {"id": "1b5f252b-ef13-47fa-a49c-53f70d79ae43", "bridge": "br-int", "label": "tempest-TestShelveInstance-125614022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "216a6e017cd94bbe96525e413d893e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ec486c2-35", "ovs_interfaceid": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:37:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cfcfbd3b-22c1-4b41-9f88-a8dd6fb6f793 req-6e22b854-0d26-45a7-82e0-70a8e75fba02 service nova] Acquired lock "refresh_cache-71518c06-a7d0-49fa-88de-ffb4af927f47" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:37:17 user nova-compute[73497]: DEBUG nova.network.neutron [req-cfcfbd3b-22c1-4b41-9f88-a8dd6fb6f793 req-6e22b854-0d26-45a7-82e0-70a8e75fba02 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Refreshing network info cache for port 8ec486c2-3507-4e88-8c66-d3db44578a1b {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:37:17 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:37:18 user nova-compute[73497]: DEBUG nova.network.neutron [req-cfcfbd3b-22c1-4b41-9f88-a8dd6fb6f793 req-6e22b854-0d26-45a7-82e0-70a8e75fba02 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Updated VIF entry in instance network info cache for port 8ec486c2-3507-4e88-8c66-d3db44578a1b. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:37:18 user nova-compute[73497]: DEBUG nova.network.neutron [req-cfcfbd3b-22c1-4b41-9f88-a8dd6fb6f793 req-6e22b854-0d26-45a7-82e0-70a8e75fba02 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Updating instance_info_cache with network_info: [{"id": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "address": "fa:16:3e:ad:51:e7", "network": {"id": "1b5f252b-ef13-47fa-a49c-53f70d79ae43", "bridge": "br-int", "label": "tempest-TestShelveInstance-125614022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "216a6e017cd94bbe96525e413d893e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ec486c2-35", "ovs_interfaceid": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:37:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cfcfbd3b-22c1-4b41-9f88-a8dd6fb6f793 req-6e22b854-0d26-45a7-82e0-70a8e75fba02 service nova] Releasing lock "refresh_cache-71518c06-a7d0-49fa-88de-ffb4af927f47" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:37:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-18a33c73-868e-4816-9dc0-8ef487aa5646 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Acquiring lock "2b2d2380-d861-46c4-b13c-36b4f48cca77" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:37:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-18a33c73-868e-4816-9dc0-8ef487aa5646 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "2b2d2380-d861-46c4-b13c-36b4f48cca77" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:37:20 user nova-compute[73497]: INFO nova.compute.manager [None req-18a33c73-868e-4816-9dc0-8ef487aa5646 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Detaching volume 4772d294-ae64-43aa-beb4-d3ca4e63a6f3
Aug 26 23:37:20 user nova-compute[73497]: INFO nova.virt.block_device [None req-18a33c73-868e-4816-9dc0-8ef487aa5646 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Attempting to driver detach volume 4772d294-ae64-43aa-beb4-d3ca4e63a6f3 from mountpoint /dev/vdb
Aug 26 23:37:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-18a33c73-868e-4816-9dc0-8ef487aa5646 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Attempting to detach device vdb from instance 2b2d2380-d861-46c4-b13c-36b4f48cca77 from the persistent domain config. {{(pid=73497) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-18a33c73-868e-4816-9dc0-8ef487aa5646 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:37:20 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:37:20 user nova-compute[73497]:   <source dev="/dev/sdb"/>
Aug 26 23:37:20 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:37:20 user nova-compute[73497]:   <serial>4772d294-ae64-43aa-beb4-d3ca4e63a6f3</serial>
Aug 26 23:37:20 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:37:20 user nova-compute[73497]: </disk>
Aug 26 23:37:20 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:37:20 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-18a33c73-868e-4816-9dc0-8ef487aa5646 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Successfully detached device vdb from instance 2b2d2380-d861-46c4-b13c-36b4f48cca77 from the persistent domain config.
Aug 26 23:37:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-18a33c73-868e-4816-9dc0-8ef487aa5646 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2b2d2380-d861-46c4-b13c-36b4f48cca77 from the live domain config. {{(pid=73497) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-18a33c73-868e-4816-9dc0-8ef487aa5646 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:37:20 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:37:20 user nova-compute[73497]:   <source dev="/dev/sdb"/>
Aug 26 23:37:20 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:37:20 user nova-compute[73497]:   <serial>4772d294-ae64-43aa-beb4-d3ca4e63a6f3</serial>
Aug 26 23:37:20 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:37:20 user nova-compute[73497]: </disk>
Aug 26 23:37:20 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Acquiring lock "2b2d2380-d861-46c4-b13c-36b4f48cca77" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Received event <DeviceRemovedEvent: 1693093040.5528715, 2b2d2380-d861-46c4-b13c-36b4f48cca77 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73497) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-18a33c73-868e-4816-9dc0-8ef487aa5646 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2b2d2380-d861-46c4-b13c-36b4f48cca77 {{(pid=73497) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 23:37:20 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-18a33c73-868e-4816-9dc0-8ef487aa5646 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Successfully detached device vdb from instance 2b2d2380-d861-46c4-b13c-36b4f48cca77 from the live domain config.
Aug 26 23:37:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18a33c73-868e-4816-9dc0-8ef487aa5646 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a33c73-868e-4816-9dc0-8ef487aa5646 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RAizjZGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:37:20 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-18a33c73-868e-4816-9dc0-8ef487aa5646 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:37:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-18a33c73-868e-4816-9dc0-8ef487aa5646 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-18a33c73-868e-4816-9dc0-8ef487aa5646 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a33c73-868e-4816-9dc0-8ef487aa5646 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc89c605-ad14-4d4c-b081-510ef3b1efca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15b19d0-c9d5-49a9-ad65-f9b0d09fdf6e]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a33c73-868e-4816-9dc0-8ef487aa5646 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 (non-flash)
Aug 26 23:37:20 user nova-compute[73497]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)
Aug 26 23:37:20 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a33c73-868e-4816-9dc0-8ef487aa5646 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 (non-flash)
Aug 26 23:37:20 user nova-compute[73497]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)
Aug 26 23:37:20 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a33c73-868e-4816-9dc0-8ef487aa5646 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282c0e1f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3'): ({'sdb'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-18a33c73-868e-4816-9dc0-8ef487aa5646 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Removing single pathed devices sdb {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc202a38-bc67-4448-b870-9d1a14d1d2f7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cc46e6-e917-49ce-9219-ef296c0a3514]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-18a33c73-868e-4816-9dc0-8ef487aa5646 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Flushing IO for device /dev/sdb {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0f0596-5d61-4bea-a514-930d4265d97a]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-18a33c73-868e-4816-9dc0-8ef487aa5646 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[101f3521-5dc4-445c-a19b-774f408c9890]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-18a33c73-868e-4816-9dc0-8ef487aa5646 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-18a33c73-868e-4816-9dc0-8ef487aa5646 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a33c73-868e-4816-9dc0-8ef487aa5646 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62fb1e9-a16f-40e6-a1fa-defdf7fef77b]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a33c73-868e-4816-9dc0-8ef487aa5646 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e13bc95-f133-45ec-bf99-ea6af63e0317]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a33c73-868e-4816-9dc0-8ef487aa5646 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3, portal: 172.16.0.220,3260]
Aug 26 23:37:20 user nova-compute[73497]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3, portal: 172.16.0.220,3260] successful.
Aug 26 23:37:20 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d833036c-1a8c-4b50-b302-0b819d094082]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a33c73-868e-4816-9dc0-8ef487aa5646 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-18a33c73-868e-4816-9dc0-8ef487aa5646 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a33c73-868e-4816-9dc0-8ef487aa5646 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] <== disconnect_volume: return (278ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:37:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18a33c73-868e-4816-9dc0-8ef487aa5646 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:37:21 user nova-compute[73497]: DEBUG nova.objects.instance [None req-18a33c73-868e-4816-9dc0-8ef487aa5646 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lazy-loading 'flavor' on Instance uuid 2b2d2380-d861-46c4-b13c-36b4f48cca77 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:37:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-18a33c73-868e-4816-9dc0-8ef487aa5646 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "2b2d2380-d861-46c4-b13c-36b4f48cca77" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.840s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:37:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "2b2d2380-d861-46c4-b13c-36b4f48cca77" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.701s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:37:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Acquiring lock "2b2d2380-d861-46c4-b13c-36b4f48cca77-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:37:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "2b2d2380-d861-46c4-b13c-36b4f48cca77-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:37:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "2b2d2380-d861-46c4-b13c-36b4f48cca77-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:37:21 user nova-compute[73497]: INFO nova.compute.manager [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Terminating instance
Aug 26 23:37:21 user nova-compute[73497]: DEBUG nova.compute.manager [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:37:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:22 user nova-compute[73497]: DEBUG nova.compute.manager [req-a8c80c17-b5ac-4758-a9c0-78e444c4d092 req-161f4a5e-31e1-41da-9a97-ec369efe4d8d service nova] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Received event network-vif-unplugged-ac9386e4-01a7-4ccf-abf1-814e9f349fcf {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:37:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a8c80c17-b5ac-4758-a9c0-78e444c4d092 req-161f4a5e-31e1-41da-9a97-ec369efe4d8d service nova] Acquiring lock "2b2d2380-d861-46c4-b13c-36b4f48cca77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:37:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a8c80c17-b5ac-4758-a9c0-78e444c4d092 req-161f4a5e-31e1-41da-9a97-ec369efe4d8d service nova] Lock "2b2d2380-d861-46c4-b13c-36b4f48cca77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:37:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-a8c80c17-b5ac-4758-a9c0-78e444c4d092 req-161f4a5e-31e1-41da-9a97-ec369efe4d8d service nova] Lock "2b2d2380-d861-46c4-b13c-36b4f48cca77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:37:22 user nova-compute[73497]: DEBUG nova.compute.manager [req-a8c80c17-b5ac-4758-a9c0-78e444c4d092 req-161f4a5e-31e1-41da-9a97-ec369efe4d8d service nova] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] No waiting events found dispatching network-vif-unplugged-ac9386e4-01a7-4ccf-abf1-814e9f349fcf {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:37:22 user nova-compute[73497]: DEBUG nova.compute.manager [req-a8c80c17-b5ac-4758-a9c0-78e444c4d092 req-161f4a5e-31e1-41da-9a97-ec369efe4d8d service nova] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Received event network-vif-unplugged-ac9386e4-01a7-4ccf-abf1-814e9f349fcf for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:37:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:22 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Instance destroyed successfully.
Aug 26 23:37:22 user nova-compute[73497]: DEBUG nova.objects.instance [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lazy-loading 'resources' on Instance uuid 2b2d2380-d861-46c4-b13c-36b4f48cca77 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:37:22 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:33:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-851699194',display_name='tempest-VolumesSnapshotTestJSON-instance-851699194',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-851699194',id=39,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADhSirZNeH/xwmT/G7wQs0JZpJU5xUQhGSPJDEZaR1ZOJJSPSlcuY55n8ofcMtoZ9IvX9mbtU71roun/inb3maEu+tsO2cQmGo3MR66dVp17XYNlQ1bqC/hsRfQh3lefA==',key_name='tempest-keypair-794877025',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:34:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='077c6c937fcc4d8d95eb66d8d7f87167',ramdisk_id='',reservation_id='r-1b08sx0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1128972653',owner_user_name='tempest-VolumesSnapshotTestJSON-1128972653-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:34:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec43dd42316042a4895706726866b103',uuid=2b2d2380-d861-46c4-b13c-36b4f48cca77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac9386e4-01a7-4ccf-abf1-814e9f349fcf", "address": "fa:16:3e:8a:9c:5b", "network": {"id": "bc10efbc-a86e-4a1d-8a40-bc508dd2a6db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1634677403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "077c6c937fcc4d8d95eb66d8d7f87167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac9386e4-01", "ovs_interfaceid": "ac9386e4-01a7-4ccf-abf1-814e9f349fcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:37:22 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Converting VIF {"id": "ac9386e4-01a7-4ccf-abf1-814e9f349fcf", "address": "fa:16:3e:8a:9c:5b", "network": {"id": "bc10efbc-a86e-4a1d-8a40-bc508dd2a6db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1634677403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "077c6c937fcc4d8d95eb66d8d7f87167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac9386e4-01", "ovs_interfaceid": "ac9386e4-01a7-4ccf-abf1-814e9f349fcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:37:22 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:9c:5b,bridge_name='br-int',has_traffic_filtering=True,id=ac9386e4-01a7-4ccf-abf1-814e9f349fcf,network=Network(bc10efbc-a86e-4a1d-8a40-bc508dd2a6db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac9386e4-01') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:37:22 user nova-compute[73497]: DEBUG os_vif [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:9c:5b,bridge_name='br-int',has_traffic_filtering=True,id=ac9386e4-01a7-4ccf-abf1-814e9f349fcf,network=Network(bc10efbc-a86e-4a1d-8a40-bc508dd2a6db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac9386e4-01') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:37:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac9386e4-01, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:37:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:37:22 user nova-compute[73497]: INFO os_vif [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:9c:5b,bridge_name='br-int',has_traffic_filtering=True,id=ac9386e4-01a7-4ccf-abf1-814e9f349fcf,network=Network(bc10efbc-a86e-4a1d-8a40-bc508dd2a6db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac9386e4-01')
Aug 26 23:37:22 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:37:22 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RAizjZGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:37:22 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:37:22 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:37:22 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:37:22 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4772d294-ae64-43aa-beb4-d3ca4e63a6f3', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:37:22 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:22 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:22 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df045a5-9066-4659-9975-cdfb768f4fac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:22 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:22 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:22 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a94784c-4fed-443c-95eb-e49813932064]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:22 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)
Aug 26 23:37:22 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:37:22 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)
Aug 26 23:37:22 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:37:22 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281c578f70>, {}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:37:22 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Disconnecting from: [] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:37:22 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.055s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:37:22 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] <== disconnect_volume: return (55ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:37:22 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:37:22 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Deleting instance files /opt/stack/data/nova/instances/2b2d2380-d861-46c4-b13c-36b4f48cca77_del
Aug 26 23:37:22 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Deletion of /opt/stack/data/nova/instances/2b2d2380-d861-46c4-b13c-36b4f48cca77_del complete
Aug 26 23:37:22 user nova-compute[73497]: INFO nova.compute.manager [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 26 23:37:22 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:37:22 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:37:22 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:37:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:24 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:37:24 user nova-compute[73497]: DEBUG nova.compute.manager [req-1c93f62b-c615-442c-80e7-b57daadb28b9 req-0a09bf91-bf4b-47a4-b009-a743cb430944 service nova] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Received event network-vif-deleted-ac9386e4-01a7-4ccf-abf1-814e9f349fcf {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:37:24 user nova-compute[73497]: INFO nova.compute.manager [req-1c93f62b-c615-442c-80e7-b57daadb28b9 req-0a09bf91-bf4b-47a4-b009-a743cb430944 service nova] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Neutron deleted interface ac9386e4-01a7-4ccf-abf1-814e9f349fcf; detaching it from the instance and deleting it from the info cache
Aug 26 23:37:24 user nova-compute[73497]: DEBUG nova.network.neutron [req-1c93f62b-c615-442c-80e7-b57daadb28b9 req-0a09bf91-bf4b-47a4-b009-a743cb430944 service nova] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:37:24 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Took 1.45 seconds to deallocate network for instance.
Aug 26 23:37:24 user nova-compute[73497]: DEBUG nova.compute.manager [req-1c93f62b-c615-442c-80e7-b57daadb28b9 req-0a09bf91-bf4b-47a4-b009-a743cb430944 service nova] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Detach interface failed, port_id=ac9386e4-01a7-4ccf-abf1-814e9f349fcf, reason: Instance 2b2d2380-d861-46c4-b13c-36b4f48cca77 could not be found. {{(pid=73497) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 23:37:24 user nova-compute[73497]: WARNING nova.volume.cinder [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Attachment 04e87762-e5aa-460c-9cf9-bfcd3a75eeb3 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 04e87762-e5aa-460c-9cf9-bfcd3a75eeb3. (HTTP 404) (Request-ID: req-d692a93a-ad85-42fa-892c-32cf9e3e3178)
Aug 26 23:37:24 user nova-compute[73497]: INFO nova.compute.manager [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Took 0.03 seconds to detach 1 volumes for instance.
Aug 26 23:37:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:37:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:37:24 user nova-compute[73497]: DEBUG nova.compute.manager [req-420de2ca-c8dd-418e-8f2c-32c25907e648 req-bda7f745-a177-45ad-a5f5-c9ed440169aa service nova] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Received event network-vif-plugged-ac9386e4-01a7-4ccf-abf1-814e9f349fcf {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:37:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-420de2ca-c8dd-418e-8f2c-32c25907e648 req-bda7f745-a177-45ad-a5f5-c9ed440169aa service nova] Acquiring lock "2b2d2380-d861-46c4-b13c-36b4f48cca77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:37:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-420de2ca-c8dd-418e-8f2c-32c25907e648 req-bda7f745-a177-45ad-a5f5-c9ed440169aa service nova] Lock "2b2d2380-d861-46c4-b13c-36b4f48cca77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:37:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-420de2ca-c8dd-418e-8f2c-32c25907e648 req-bda7f745-a177-45ad-a5f5-c9ed440169aa service nova] Lock "2b2d2380-d861-46c4-b13c-36b4f48cca77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:37:24 user nova-compute[73497]: DEBUG nova.compute.manager [req-420de2ca-c8dd-418e-8f2c-32c25907e648 req-bda7f745-a177-45ad-a5f5-c9ed440169aa service nova] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] No waiting events found dispatching network-vif-plugged-ac9386e4-01a7-4ccf-abf1-814e9f349fcf {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:37:24 user nova-compute[73497]: WARNING nova.compute.manager [req-420de2ca-c8dd-418e-8f2c-32c25907e648 req-bda7f745-a177-45ad-a5f5-c9ed440169aa service nova] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Received unexpected event network-vif-plugged-ac9386e4-01a7-4ccf-abf1-814e9f349fcf for instance with vm_state deleted and task_state None.
Aug 26 23:37:24 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:37:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "db489468-154b-4238-8b81-f8fa2bc016b7" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:37:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "db489468-154b-4238-8b81-f8fa2bc016b7" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:37:24 user nova-compute[73497]: INFO nova.compute.manager [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Unshelving
Aug 26 23:37:24 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:37:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.253s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:37:24 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Deleted allocations for instance 2b2d2380-d861-46c4-b13c-36b4f48cca77
Aug 26 23:37:24 user nova-compute[73497]: INFO nova.virt.block_device [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Booting with volume 33321b8c-a031-4f7a-807f-4f10f54d086a at /dev/vdc
Aug 26 23:37:24 user nova-compute[73497]: DEBUG os_brick.utils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:37:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71c7130-2937-4463-9c82-d50db7dc219b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-16aca20b-9ca8-4784-a848-556c7bd7a266 tempest-VolumesSnapshotTestJSON-1128972653 tempest-VolumesSnapshotTestJSON-1128972653-project-member] Lock "2b2d2380-d861-46c4-b13c-36b4f48cca77" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.998s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:37:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16d04fb-561e-4a5a-af8e-747e49dcab23]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e336785-0435-4c6c-9f2d-406ee7199cf4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b61426-738d-4cd8-8efe-e3d5bf1975b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:37:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:37:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:37:24 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:37:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dff8c7b-4847-41c5-96c6-fb5231e320c8]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:37:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:37:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:37:24 user nova-compute[73497]: DEBUG os_brick.utils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:37:24 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Updating existing volume attachment record: 36a5c6e9-f7d5-4703-ac01-2cd288134470 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:37:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG nova.compute.manager [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:37:28 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Creating image(s)
Aug 26 23:37:28 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Did not create local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Ensure instance console log exists: /opt/stack/data/nova/instances/71518c06-a7d0-49fa-88de-ffb4af927f47/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Start _get_guest_xml network_info=[{"id": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "address": "fa:16:3e:ad:51:e7", "network": {"id": "1b5f252b-ef13-47fa-a49c-53f70d79ae43", "bridge": "br-int", "label": "tempest-TestShelveInstance-125614022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "216a6e017cd94bbe96525e413d893e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ec486c2-35", "ovs_interfaceid": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9cd1b15c-ddbf-4b38-bd51-4c0d7ae4d7c9', 'guest_format': None, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnJQIZbW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '71518c06-a7d0-49fa-88de-ffb4af927f47', 'attached_at': '', 'detached_at': '', 'volume_id': 'ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7', 'serial': 'ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7'}, 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:37:28 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:37:28 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:37:28 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnJQIZbW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:37:28 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:37:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:37:28 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:37:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:37:28 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:37:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d48d78b-d76f-49db-adf5-95c80e797e98]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:37:28 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe79bae9-3dd1-4f55-ba96-4bc487bfc76c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7] added
Aug 26 23:37:28 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[05acd496-41b4-4f21-8b2d-a71332c8242a]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec8c4fd-5610-4298-98fa-1da6e602b79e]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MnJQIZbW {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MnJQIZbW" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f99569-d6fb-4f1a-8fbc-14a872994e6f]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MnJQIZbW'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7373b76b-d892-450e-b94a-28a7bb53a7e7]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de4100d-ba28-479b-b596-4a60bbe01051]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)
Aug 26 23:37:28 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)
Aug 26 23:37:28 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[381010f8-4704-43c7-bb11-2b4d59683548]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7, portal: 172.16.0.220,3260]
Aug 26 23:37:28 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7, portal: 172.16.0.220,3260] successful.
Aug 26 23:37:28 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b20dd5-d6b0-4828-a3d9-a0b890aa9745]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[73388cff-298b-4b78-8654-18a45e25030b]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)
Aug 26 23:37:28 user nova-compute[73497]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)
Aug 26 23:37:28 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)
Aug 26 23:37:28 user nova-compute[73497]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)
Aug 26 23:37:28 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[859cb845-023d-4607-9071-b8d01a24bc30]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:37:28 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnJQIZbW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:37:29 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:37:29 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23837373531653665', 'path': '/dev/sdb'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:37:29 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837373531653665', 'path': '/dev/sdb'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:37:29 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1647360321',display_name='tempest-TestShelveInstance-server-1647360321',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1647360321',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxVoZl80WnvJYJlh+Emiq/FYRseABF+tnMH8/Nu6Tqd4TApwZ93uyb7meNhcldg7PthrIWqUW5HCXIe2CsTMsK6rSEmc5nqb7FAhWyDW0d7V7k8W7nfvRp0gAfaO0CY5A==',key_name='tempest-TestShelveInstance-1023296182',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='216a6e017cd94bbe96525e413d893e6d',ramdisk_id='',reservation_id='r-a97hsfck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2032732603',owner_user_name='tempest-TestShelveInstance-2032732603-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:37:15Z,user_data=None,user_id='77ec603ab2da4a3584b0e4b0bcf2984b',uuid=71518c06-a7d0-49fa-88de-ffb4af927f47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "address": "fa:16:3e:ad:51:e7", "network": {"id": "1b5f252b-ef13-47fa-a49c-53f70d79ae43", "bridge": "br-int", "label": "tempest-TestShelveInstance-125614022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "216a6e017cd94bbe96525e413d893e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ec486c2-35", "ovs_interfaceid": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:37:29 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Converting VIF {"id": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "address": "fa:16:3e:ad:51:e7", "network": {"id": "1b5f252b-ef13-47fa-a49c-53f70d79ae43", "bridge": "br-int", "label": "tempest-TestShelveInstance-125614022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "216a6e017cd94bbe96525e413d893e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ec486c2-35", "ovs_interfaceid": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:37:29 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:51:e7,bridge_name='br-int',has_traffic_filtering=True,id=8ec486c2-3507-4e88-8c66-d3db44578a1b,network=Network(1b5f252b-ef13-47fa-a49c-53f70d79ae43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ec486c2-35') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:37:29 user nova-compute[73497]: DEBUG nova.objects.instance [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lazy-loading 'pci_devices' on Instance uuid 71518c06-a7d0-49fa-88de-ffb4af927f47 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:37:29 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:37:29 user nova-compute[73497]:   <uuid>71518c06-a7d0-49fa-88de-ffb4af927f47</uuid>
Aug 26 23:37:29 user nova-compute[73497]:   <name>instance-0000002b</name>
Aug 26 23:37:29 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:37:29 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:37:29 user nova-compute[73497]:   <metadata>
Aug 26 23:37:29 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:37:29 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:37:29 user nova-compute[73497]:       <nova:name>tempest-TestShelveInstance-server-1647360321</nova:name>
Aug 26 23:37:29 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:37:28</nova:creationTime>
Aug 26 23:37:29 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:37:29 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:37:29 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:37:29 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:37:29 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:37:29 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:37:29 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:37:29 user nova-compute[73497]:       <nova:owner>
Aug 26 23:37:29 user nova-compute[73497]:         <nova:user uuid="77ec603ab2da4a3584b0e4b0bcf2984b">tempest-TestShelveInstance-2032732603-project-member</nova:user>
Aug 26 23:37:29 user nova-compute[73497]:         <nova:project uuid="216a6e017cd94bbe96525e413d893e6d">tempest-TestShelveInstance-2032732603</nova:project>
Aug 26 23:37:29 user nova-compute[73497]:       </nova:owner>
Aug 26 23:37:29 user nova-compute[73497]:       <nova:ports>
Aug 26 23:37:29 user nova-compute[73497]:         <nova:port uuid="8ec486c2-3507-4e88-8c66-d3db44578a1b">
Aug 26 23:37:29 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 23:37:29 user nova-compute[73497]:         </nova:port>
Aug 26 23:37:29 user nova-compute[73497]:       </nova:ports>
Aug 26 23:37:29 user nova-compute[73497]:     </nova:instance>
Aug 26 23:37:29 user nova-compute[73497]:   </metadata>
Aug 26 23:37:29 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:37:29 user nova-compute[73497]:     <system>
Aug 26 23:37:29 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:37:29 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:37:29 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:37:29 user nova-compute[73497]:       <entry name="serial">71518c06-a7d0-49fa-88de-ffb4af927f47</entry>
Aug 26 23:37:29 user nova-compute[73497]:       <entry name="uuid">71518c06-a7d0-49fa-88de-ffb4af927f47</entry>
Aug 26 23:37:29 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:37:29 user nova-compute[73497]:     </system>
Aug 26 23:37:29 user nova-compute[73497]:   </sysinfo>
Aug 26 23:37:29 user nova-compute[73497]:   <os>
Aug 26 23:37:29 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:37:29 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:37:29 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:37:29 user nova-compute[73497]:   </os>
Aug 26 23:37:29 user nova-compute[73497]:   <features>
Aug 26 23:37:29 user nova-compute[73497]:     <acpi/>
Aug 26 23:37:29 user nova-compute[73497]:     <apic/>
Aug 26 23:37:29 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:37:29 user nova-compute[73497]:   </features>
Aug 26 23:37:29 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:37:29 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:37:29 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:37:29 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:37:29 user nova-compute[73497]:   </clock>
Aug 26 23:37:29 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:37:29 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:37:29 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:37:29 user nova-compute[73497]:   </cpu>
Aug 26 23:37:29 user nova-compute[73497]:   <devices>
Aug 26 23:37:29 user nova-compute[73497]:     <disk type="block" device="disk">
Aug 26 23:37:29 user nova-compute[73497]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:37:29 user nova-compute[73497]:       <source dev="/dev/sdb"/>
Aug 26 23:37:29 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:37:29 user nova-compute[73497]:       <serial>ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7</serial>
Aug 26 23:37:29 user nova-compute[73497]:     </disk>
Aug 26 23:37:29 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:37:29 user nova-compute[73497]:       <mac address="fa:16:3e:ad:51:e7"/>
Aug 26 23:37:29 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:37:29 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:37:29 user nova-compute[73497]:       <target dev="tap8ec486c2-35"/>
Aug 26 23:37:29 user nova-compute[73497]:     </interface>
Aug 26 23:37:29 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:37:29 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/71518c06-a7d0-49fa-88de-ffb4af927f47/console.log" append="off"/>
Aug 26 23:37:29 user nova-compute[73497]:     </serial>
Aug 26 23:37:29 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:37:29 user nova-compute[73497]:     <video>
Aug 26 23:37:29 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:37:29 user nova-compute[73497]:     </video>
Aug 26 23:37:29 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:37:29 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:37:29 user nova-compute[73497]:     </rng>
Aug 26 23:37:29 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:37:29 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:37:29 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:37:29 user nova-compute[73497]:     </memballoon>
Aug 26 23:37:29 user nova-compute[73497]:   </devices>
Aug 26 23:37:29 user nova-compute[73497]: </domain>
Aug 26 23:37:29 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:37:29 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1647360321',display_name='tempest-TestShelveInstance-server-1647360321',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1647360321',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxVoZl80WnvJYJlh+Emiq/FYRseABF+tnMH8/Nu6Tqd4TApwZ93uyb7meNhcldg7PthrIWqUW5HCXIe2CsTMsK6rSEmc5nqb7FAhWyDW0d7V7k8W7nfvRp0gAfaO0CY5A==',key_name='tempest-TestShelveInstance-1023296182',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='216a6e017cd94bbe96525e413d893e6d',ramdisk_id='',reservation_id='r-a97hsfck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2032732603',owner_user_name='tempest-TestShelveInstance-2032732603-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:37:15Z,user_data=None,user_id='77ec603ab2da4a3584b0e4b0bcf2984b',uuid=71518c06-a7d0-49fa-88de-ffb4af927f47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "address": "fa:16:3e:ad:51:e7", "network": {"id": "1b5f252b-ef13-47fa-a49c-53f70d79ae43", "bridge": "br-int", "label": "tempest-TestShelveInstance-125614022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "216a6e017cd94bbe96525e413d893e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ec486c2-35", "ovs_interfaceid": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:37:29 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Converting VIF {"id": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "address": "fa:16:3e:ad:51:e7", "network": {"id": "1b5f252b-ef13-47fa-a49c-53f70d79ae43", "bridge": "br-int", "label": "tempest-TestShelveInstance-125614022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "216a6e017cd94bbe96525e413d893e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ec486c2-35", "ovs_interfaceid": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:37:29 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:51:e7,bridge_name='br-int',has_traffic_filtering=True,id=8ec486c2-3507-4e88-8c66-d3db44578a1b,network=Network(1b5f252b-ef13-47fa-a49c-53f70d79ae43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ec486c2-35') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:37:29 user nova-compute[73497]: DEBUG os_vif [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:51:e7,bridge_name='br-int',has_traffic_filtering=True,id=8ec486c2-3507-4e88-8c66-d3db44578a1b,network=Network(1b5f252b-ef13-47fa-a49c-53f70d79ae43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ec486c2-35') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:37:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:37:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:37:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ec486c2-35, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:37:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8ec486c2-35, col_values=(('external_ids', {'iface-id': '8ec486c2-3507-4e88-8c66-d3db44578a1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:51:e7', 'vm-uuid': '71518c06-a7d0-49fa-88de-ffb4af927f47'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:37:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:37:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:29 user nova-compute[73497]: INFO os_vif [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:51:e7,bridge_name='br-int',has_traffic_filtering=True,id=8ec486c2-3507-4e88-8c66-d3db44578a1b,network=Network(1b5f252b-ef13-47fa-a49c-53f70d79ae43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ec486c2-35')
Aug 26 23:37:29 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:37:29 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] No VIF found with MAC fa:16:3e:ad:51:e7, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:37:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:31 user nova-compute[73497]: DEBUG nova.compute.manager [req-79eee103-62d0-40ba-b898-ce4b0c2086fe req-bf682b17-361e-4536-b0ce-09ced66e2bf0 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Received event network-vif-plugged-8ec486c2-3507-4e88-8c66-d3db44578a1b {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:37:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-79eee103-62d0-40ba-b898-ce4b0c2086fe req-bf682b17-361e-4536-b0ce-09ced66e2bf0 service nova] Acquiring lock "71518c06-a7d0-49fa-88de-ffb4af927f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:37:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-79eee103-62d0-40ba-b898-ce4b0c2086fe req-bf682b17-361e-4536-b0ce-09ced66e2bf0 service nova] Lock "71518c06-a7d0-49fa-88de-ffb4af927f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:37:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-79eee103-62d0-40ba-b898-ce4b0c2086fe req-bf682b17-361e-4536-b0ce-09ced66e2bf0 service nova] Lock "71518c06-a7d0-49fa-88de-ffb4af927f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:37:31 user nova-compute[73497]: DEBUG nova.compute.manager [req-79eee103-62d0-40ba-b898-ce4b0c2086fe req-bf682b17-361e-4536-b0ce-09ced66e2bf0 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] No waiting events found dispatching network-vif-plugged-8ec486c2-3507-4e88-8c66-d3db44578a1b {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:37:31 user nova-compute[73497]: WARNING nova.compute.manager [req-79eee103-62d0-40ba-b898-ce4b0c2086fe req-bf682b17-361e-4536-b0ce-09ced66e2bf0 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Received unexpected event network-vif-plugged-8ec486c2-3507-4e88-8c66-d3db44578a1b for instance with vm_state building and task_state spawning.
Aug 26 23:37:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-253b1a25-dd9c-4a42-a6e2-497c4841acd1 req-5a4a535b-0b95-4f47-99aa-339917f88b6c service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Received event network-vif-plugged-8ec486c2-3507-4e88-8c66-d3db44578a1b {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:37:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-253b1a25-dd9c-4a42-a6e2-497c4841acd1 req-5a4a535b-0b95-4f47-99aa-339917f88b6c service nova] Acquiring lock "71518c06-a7d0-49fa-88de-ffb4af927f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:37:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-253b1a25-dd9c-4a42-a6e2-497c4841acd1 req-5a4a535b-0b95-4f47-99aa-339917f88b6c service nova] Lock "71518c06-a7d0-49fa-88de-ffb4af927f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:37:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-253b1a25-dd9c-4a42-a6e2-497c4841acd1 req-5a4a535b-0b95-4f47-99aa-339917f88b6c service nova] Lock "71518c06-a7d0-49fa-88de-ffb4af927f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:37:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-253b1a25-dd9c-4a42-a6e2-497c4841acd1 req-5a4a535b-0b95-4f47-99aa-339917f88b6c service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] No waiting events found dispatching network-vif-plugged-8ec486c2-3507-4e88-8c66-d3db44578a1b {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:37:33 user nova-compute[73497]: WARNING nova.compute.manager [req-253b1a25-dd9c-4a42-a6e2-497c4841acd1 req-5a4a535b-0b95-4f47-99aa-339917f88b6c service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Received unexpected event network-vif-plugged-8ec486c2-3507-4e88-8c66-d3db44578a1b for instance with vm_state building and task_state spawning.
Aug 26 23:37:33 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693093053.5551627, 71518c06-a7d0-49fa-88de-ffb4af927f47 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:37:33 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] VM Resumed (Lifecycle Event)
Aug 26 23:37:33 user nova-compute[73497]: DEBUG nova.compute.manager [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:37:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:37:33 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Instance spawned successfully.
Aug 26 23:37:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:37:33 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:37:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:37:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:37:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:37:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:37:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:37:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:37:33 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:37:33 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:37:33 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693093053.5554092, 71518c06-a7d0-49fa-88de-ffb4af927f47 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:37:33 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] VM Started (Lifecycle Event)
Aug 26 23:37:33 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:37:33 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:37:33 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:37:33 user nova-compute[73497]: INFO nova.compute.manager [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Took 5.42 seconds to spawn the instance on the hypervisor.
Aug 26 23:37:33 user nova-compute[73497]: DEBUG nova.compute.manager [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:37:33 user nova-compute[73497]: INFO nova.compute.manager [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Took 19.23 seconds to build instance.
Aug 26 23:37:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-475fa648-efa0-495c-b558-0a9a55d14f4f tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lock "71518c06-a7d0-49fa-88de-ffb4af927f47" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.345s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:37:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:37:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:37:36 user nova-compute[73497]: DEBUG nova.objects.instance [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lazy-loading 'pci_requests' on Instance uuid db489468-154b-4238-8b81-f8fa2bc016b7 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:37:36 user nova-compute[73497]: DEBUG nova.objects.instance [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lazy-loading 'numa_topology' on Instance uuid db489468-154b-4238-8b81-f8fa2bc016b7 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:37:36 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:37:36 user nova-compute[73497]: INFO nova.compute.claims [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Claim successful on node user
Aug 26 23:37:37 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:37:37 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:37:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.520s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:37:37 user nova-compute[73497]: INFO nova.network.neutron [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Updating port fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 26 23:37:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:37 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693093042.6135595, 2b2d2380-d861-46c4-b13c-36b4f48cca77 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:37:37 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] VM Stopped (Lifecycle Event)
Aug 26 23:37:37 user nova-compute[73497]: DEBUG nova.compute.manager [None req-0c2c7f63-f745-47b6-97e3-d94f950de0d8 None None] [instance: 2b2d2380-d861-46c4-b13c-36b4f48cca77] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:37:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "refresh_cache-db489468-154b-4238-8b81-f8fa2bc016b7" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:37:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquired lock "refresh_cache-db489468-154b-4238-8b81-f8fa2bc016b7" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:37:38 user nova-compute[73497]: DEBUG nova.network.neutron [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:37:38 user nova-compute[73497]: DEBUG nova.compute.manager [req-d96fa819-1d2a-423d-9003-e00a10881395 req-9f013841-ba2c-485f-ae99-93db76e2887b service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Received event network-changed-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:37:38 user nova-compute[73497]: DEBUG nova.compute.manager [req-d96fa819-1d2a-423d-9003-e00a10881395 req-9f013841-ba2c-485f-ae99-93db76e2887b service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Refreshing instance network info cache due to event network-changed-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:37:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d96fa819-1d2a-423d-9003-e00a10881395 req-9f013841-ba2c-485f-ae99-93db76e2887b service nova] Acquiring lock "refresh_cache-db489468-154b-4238-8b81-f8fa2bc016b7" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:37:38 user nova-compute[73497]: DEBUG nova.network.neutron [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Updating instance_info_cache with network_info: [{"id": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "address": "fa:16:3e:ad:7f:ad", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc782cdf-fe", "ovs_interfaceid": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:37:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Releasing lock "refresh_cache-db489468-154b-4238-8b81-f8fa2bc016b7" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:37:39 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:37:39 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Creating image(s)
Aug 26 23:37:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "/opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:37:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "/opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:37:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "/opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:37:39 user nova-compute[73497]: DEBUG nova.objects.instance [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lazy-loading 'trusted_certs' on Instance uuid db489468-154b-4238-8b81-f8fa2bc016b7 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:37:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d96fa819-1d2a-423d-9003-e00a10881395 req-9f013841-ba2c-485f-ae99-93db76e2887b service nova] Acquired lock "refresh_cache-db489468-154b-4238-8b81-f8fa2bc016b7" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:37:39 user nova-compute[73497]: DEBUG nova.network.neutron [req-d96fa819-1d2a-423d-9003-e00a10881395 req-9f013841-ba2c-485f-ae99-93db76e2887b service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Refreshing network info cache for port fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:37:39 user nova-compute[73497]: DEBUG nova.objects.base [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Object Instance<db489468-154b-4238-8b81-f8fa2bc016b7> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:37:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "c6f1b512f47f2bd534f5e05671634bf5116c3e50" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:37:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "c6f1b512f47f2bd534f5e05671634bf5116c3e50" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:37:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c6f1b512f47f2bd534f5e05671634bf5116c3e50.part --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:40 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c6f1b512f47f2bd534f5e05671634bf5116c3e50.part --force-share --output=json" returned: 0 in 0.222s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:40 user nova-compute[73497]: DEBUG nova.virt.images [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] 19064d93-0426-401c-9dc3-d65e7832d59d was qcow2, converting to raw {{(pid=73497) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 23:37:40 user nova-compute[73497]: DEBUG nova.privsep.utils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73497) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 23:37:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c6f1b512f47f2bd534f5e05671634bf5116c3e50.part /opt/stack/data/nova/instances/_base/c6f1b512f47f2bd534f5e05671634bf5116c3e50.converted {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:40 user nova-compute[73497]: DEBUG nova.network.neutron [req-d96fa819-1d2a-423d-9003-e00a10881395 req-9f013841-ba2c-485f-ae99-93db76e2887b service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Updated VIF entry in instance network info cache for port fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:37:40 user nova-compute[73497]: DEBUG nova.network.neutron [req-d96fa819-1d2a-423d-9003-e00a10881395 req-9f013841-ba2c-485f-ae99-93db76e2887b service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Updating instance_info_cache with network_info: [{"id": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "address": "fa:16:3e:ad:7f:ad", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc782cdf-fe", "ovs_interfaceid": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:37:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d96fa819-1d2a-423d-9003-e00a10881395 req-9f013841-ba2c-485f-ae99-93db76e2887b service nova] Releasing lock "refresh_cache-db489468-154b-4238-8b81-f8fa2bc016b7" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:37:41 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c6f1b512f47f2bd534f5e05671634bf5116c3e50.part /opt/stack/data/nova/instances/_base/c6f1b512f47f2bd534f5e05671634bf5116c3e50.converted" returned: 0 in 0.502s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:41 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c6f1b512f47f2bd534f5e05671634bf5116c3e50.converted --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:41 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c6f1b512f47f2bd534f5e05671634bf5116c3e50.converted --force-share --output=json" returned: 0 in 0.192s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "c6f1b512f47f2bd534f5e05671634bf5116c3e50" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.340s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:37:41 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c6f1b512f47f2bd534f5e05671634bf5116c3e50 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:41 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c6f1b512f47f2bd534f5e05671634bf5116c3e50 --force-share --output=json" returned: 0 in 0.177s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "c6f1b512f47f2bd534f5e05671634bf5116c3e50" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:37:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "c6f1b512f47f2bd534f5e05671634bf5116c3e50" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:37:41 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c6f1b512f47f2bd534f5e05671634bf5116c3e50 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:41 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c6f1b512f47f2bd534f5e05671634bf5116c3e50 --force-share --output=json" returned: 0 in 0.191s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:41 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c6f1b512f47f2bd534f5e05671634bf5116c3e50,backing_fmt=raw /opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:41 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c6f1b512f47f2bd534f5e05671634bf5116c3e50,backing_fmt=raw /opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/disk 1073741824" returned: 0 in 0.055s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "c6f1b512f47f2bd534f5e05671634bf5116c3e50" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:37:41 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c6f1b512f47f2bd534f5e05671634bf5116c3e50 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c6f1b512f47f2bd534f5e05671634bf5116c3e50 --force-share --output=json" returned: 0 in 0.188s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:42 user nova-compute[73497]: DEBUG nova.objects.instance [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lazy-loading 'migration_context' on Instance uuid db489468-154b-4238-8b81-f8fa2bc016b7 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:37:42 user nova-compute[73497]: DEBUG nova.objects.base [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Object Instance<db489468-154b-4238-8b81-f8fa2bc016b7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:37:42 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Rebasing disk image.
Aug 26 23:37:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.194s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 -F raw /opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/disk {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5dc2e280-cfb1-4794-a0ad-ce5721d55a56 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Acquiring lock "358ed2d7-4452-40cf-9fed-d9a8e45b5c99" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:37:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5dc2e280-cfb1-4794-a0ad-ce5721d55a56 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Lock "358ed2d7-4452-40cf-9fed-d9a8e45b5c99" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:37:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5dc2e280-cfb1-4794-a0ad-ce5721d55a56 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Acquiring lock "358ed2d7-4452-40cf-9fed-d9a8e45b5c99-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:37:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5dc2e280-cfb1-4794-a0ad-ce5721d55a56 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Lock "358ed2d7-4452-40cf-9fed-d9a8e45b5c99-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:37:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5dc2e280-cfb1-4794-a0ad-ce5721d55a56 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Lock "358ed2d7-4452-40cf-9fed-d9a8e45b5c99-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:37:43 user nova-compute[73497]: INFO nova.compute.manager [None req-5dc2e280-cfb1-4794-a0ad-ce5721d55a56 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Terminating instance
Aug 26 23:37:43 user nova-compute[73497]: DEBUG nova.compute.manager [None req-5dc2e280-cfb1-4794-a0ad-ce5721d55a56 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:37:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:43 user nova-compute[73497]: DEBUG nova.compute.manager [req-cb4480cc-5692-48fa-ba78-67374e043f9d req-85d29df9-5fc0-43ab-98cf-cacb07c08216 service nova] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Received event network-vif-unplugged-fbcd036f-eab6-435d-9eb6-856c76c37245 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:37:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cb4480cc-5692-48fa-ba78-67374e043f9d req-85d29df9-5fc0-43ab-98cf-cacb07c08216 service nova] Acquiring lock "358ed2d7-4452-40cf-9fed-d9a8e45b5c99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:37:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cb4480cc-5692-48fa-ba78-67374e043f9d req-85d29df9-5fc0-43ab-98cf-cacb07c08216 service nova] Lock "358ed2d7-4452-40cf-9fed-d9a8e45b5c99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:37:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-cb4480cc-5692-48fa-ba78-67374e043f9d req-85d29df9-5fc0-43ab-98cf-cacb07c08216 service nova] Lock "358ed2d7-4452-40cf-9fed-d9a8e45b5c99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:37:43 user nova-compute[73497]: DEBUG nova.compute.manager [req-cb4480cc-5692-48fa-ba78-67374e043f9d req-85d29df9-5fc0-43ab-98cf-cacb07c08216 service nova] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] No waiting events found dispatching network-vif-unplugged-fbcd036f-eab6-435d-9eb6-856c76c37245 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:37:43 user nova-compute[73497]: DEBUG nova.compute.manager [req-cb4480cc-5692-48fa-ba78-67374e043f9d req-85d29df9-5fc0-43ab-98cf-cacb07c08216 service nova] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Received event network-vif-unplugged-fbcd036f-eab6-435d-9eb6-856c76c37245 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:37:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:44 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Instance destroyed successfully.
Aug 26 23:37:44 user nova-compute[73497]: DEBUG nova.objects.instance [None req-5dc2e280-cfb1-4794-a0ad-ce5721d55a56 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Lazy-loading 'resources' on Instance uuid 358ed2d7-4452-40cf-9fed-d9a8e45b5c99 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:37:44 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-5dc2e280-cfb1-4794-a0ad-ce5721d55a56 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1594102110',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1594102110',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1594102',id=40,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL1TrlNrrZZLYhoWTd8xeTDH3XD5a19EFGBLeQg3aqUycO1k5frRMS2pcGfB8VSVSrjqKJXhfht5b8LeITFx2hnZmZbkWc0zWT7YwTep1ezQNXCkWZKMsSGy3UltJeDKDA==',key_name='tempest-keypair-508003349',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:34:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c30fe9ca93aa48ba84fb9a5ad89334c7',ramdisk_id='',reservation_id='r-9ejzcpgz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-131421111',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:34:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7864f3cb23546a9b747390135bd1f0d',uuid=358ed2d7-4452-40cf-9fed-d9a8e45b5c99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fbcd036f-eab6-435d-9eb6-856c76c37245", "address": "fa:16:3e:78:80:dc", "network": {"id": "ab93ff2a-6428-4e0e-a9a8-afbd83b56307", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-918557970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30fe9ca93aa48ba84fb9a5ad89334c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbcd036f-ea", "ovs_interfaceid": "fbcd036f-eab6-435d-9eb6-856c76c37245", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:37:44 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-5dc2e280-cfb1-4794-a0ad-ce5721d55a56 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Converting VIF {"id": "fbcd036f-eab6-435d-9eb6-856c76c37245", "address": "fa:16:3e:78:80:dc", "network": {"id": "ab93ff2a-6428-4e0e-a9a8-afbd83b56307", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-918557970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30fe9ca93aa48ba84fb9a5ad89334c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbcd036f-ea", "ovs_interfaceid": "fbcd036f-eab6-435d-9eb6-856c76c37245", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:37:44 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-5dc2e280-cfb1-4794-a0ad-ce5721d55a56 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:80:dc,bridge_name='br-int',has_traffic_filtering=True,id=fbcd036f-eab6-435d-9eb6-856c76c37245,network=Network(ab93ff2a-6428-4e0e-a9a8-afbd83b56307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbcd036f-ea') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:37:44 user nova-compute[73497]: DEBUG os_vif [None req-5dc2e280-cfb1-4794-a0ad-ce5721d55a56 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:80:dc,bridge_name='br-int',has_traffic_filtering=True,id=fbcd036f-eab6-435d-9eb6-856c76c37245,network=Network(ab93ff2a-6428-4e0e-a9a8-afbd83b56307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbcd036f-ea') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:37:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfbcd036f-ea, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:37:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:37:44 user nova-compute[73497]: INFO os_vif [None req-5dc2e280-cfb1-4794-a0ad-ce5721d55a56 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:80:dc,bridge_name='br-int',has_traffic_filtering=True,id=fbcd036f-eab6-435d-9eb6-856c76c37245,network=Network(ab93ff2a-6428-4e0e-a9a8-afbd83b56307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbcd036f-ea')
Aug 26 23:37:44 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-5dc2e280-cfb1-4794-a0ad-ce5721d55a56 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Deleting instance files /opt/stack/data/nova/instances/358ed2d7-4452-40cf-9fed-d9a8e45b5c99_del
Aug 26 23:37:44 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-5dc2e280-cfb1-4794-a0ad-ce5721d55a56 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Deletion of /opt/stack/data/nova/instances/358ed2d7-4452-40cf-9fed-d9a8e45b5c99_del complete
Aug 26 23:37:44 user nova-compute[73497]: INFO nova.compute.manager [None req-5dc2e280-cfb1-4794-a0ad-ce5721d55a56 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Took 1.26 seconds to destroy the instance on the hypervisor.
Aug 26 23:37:44 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-5dc2e280-cfb1-4794-a0ad-ce5721d55a56 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:37:44 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:37:44 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 -F raw /opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/disk" returned: 0 in 2.816s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Ensure instance console log exists: /opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Start _get_guest_xml network_info=[{"id": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "address": "fa:16:3e:ad:7f:ad", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc782cdf-fe", "ovs_interfaceid": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='6f59d779ac5cbd76d3b11f60e81c6dd0',container_format='bare',created_at=2023-08-26T23:35:31Z,direct_url=<?>,disk_format='qcow2',id=19064d93-0426-401c-9dc3-d65e7832d59d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1477188239-shelved',owner='f777a90b660e48cdb1f5a453fbe2f806',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T23:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '36a5c6e9-f7d5-4703-ac01-2cd288134470', 'guest_format': None, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SdolFTgZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'db489468-154b-4238-8b81-f8fa2bc016b7', 'attached_at': '', 'detached_at': '', 'volume_id': '33321b8c-a031-4f7a-807f-4f10f54d086a', 'serial': '33321b8c-a031-4f7a-807f-4f10f54d086a'}, 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:37:45 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:37:45 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:37:45 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='6f59d779ac5cbd76d3b11f60e81c6dd0',container_format='bare',created_at=2023-08-26T23:35:31Z,direct_url=<?>,disk_format='qcow2',id=19064d93-0426-401c-9dc3-d65e7832d59d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1477188239-shelved',owner='f777a90b660e48cdb1f5a453fbe2f806',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T23:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG nova.objects.instance [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lazy-loading 'vcpu_model' on Instance uuid db489468-154b-4238-8b81-f8fa2bc016b7 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG nova.objects.base [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Object Instance<db489468-154b-4238-8b81-f8fa2bc016b7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SdolFTgZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:37:45 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:37:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:37:45 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:37:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:37:45 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5669816-7b5e-4798-864a-d3840aad3c98]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:37:45 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[753c8793-7efe-49df-a29c-c0f1ef28c233]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a] added
Aug 26 23:37:45 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91344b6-d285-4072-9fca-47bf817315c3]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a93da0-e6c1-4aa8-bf50-f96db7f06b29]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SdolFTgZ {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SdolFTgZ" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4e8ce0-3663-4768-9c96-ddf04b64e9a7]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SdolFTgZ'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff716664-a9ba-4810-a315-e701883ca4a1]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84c4e72-6c41-43e0-9a65-a1ad541b6fc2]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)
Aug 26 23:37:45 user nova-compute[73497]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)
Aug 26 23:37:45 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)
Aug 26 23:37:45 user nova-compute[73497]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)
Aug 26 23:37:45 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b18b3e-450f-4121-a3c1-a87101985db9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a, portal: 172.16.0.220,3260]
Aug 26 23:37:45 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a, portal: 172.16.0.220,3260] successful.
Aug 26 23:37:45 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7d3ac6-b2a4-4f64-9a67-ab509611f846]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7d2073-e524-4e2b-9ee3-7a66dd12955c]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)
Aug 26 23:37:45 user nova-compute[73497]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)
Aug 26 23:37:45 user nova-compute[73497]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a (non-flash)
Aug 26 23:37:45 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)
Aug 26 23:37:45 user nova-compute[73497]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)
Aug 26 23:37:45 user nova-compute[73497]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a (non-flash)
Aug 26 23:37:45 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.029s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e17b0ce-2ff1-45c7-940f-7169f1a74bbe]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SdolFTgZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:37:45 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Took 1.07 seconds to deallocate network for instance.
Aug 26 23:37:45 user nova-compute[73497]: DEBUG nova.compute.manager [req-a8bf4b84-05db-4b19-89bd-d2587a035a94 req-102a3b95-11ef-4e5c-b07c-69d061498424 service nova] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Received event network-vif-deleted-fbcd036f-eab6-435d-9eb6-856c76c37245 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:37:45 user nova-compute[73497]: INFO nova.compute.manager [req-a8bf4b84-05db-4b19-89bd-d2587a035a94 req-102a3b95-11ef-4e5c-b07c-69d061498424 service nova] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Neutron deleted interface fbcd036f-eab6-435d-9eb6-856c76c37245; detaching it from the instance and deleting it from the info cache
Aug 26 23:37:45 user nova-compute[73497]: DEBUG nova.network.neutron [req-a8bf4b84-05db-4b19-89bd-d2587a035a94 req-102a3b95-11ef-4e5c-b07c-69d061498424 service nova] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG nova.compute.manager [req-a8bf4b84-05db-4b19-89bd-d2587a035a94 req-102a3b95-11ef-4e5c-b07c-69d061498424 service nova] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Detach interface failed, port_id=fbcd036f-eab6-435d-9eb6-856c76c37245, reason: Instance 358ed2d7-4452-40cf-9fed-d9a8e45b5c99 could not be found. {{(pid=73497) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5dc2e280-cfb1-4794-a0ad-ce5721d55a56 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5dc2e280-cfb1-4794-a0ad-ce5721d55a56 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-5dc2e280-cfb1-4794-a0ad-ce5721d55a56 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:37:45 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-5dc2e280-cfb1-4794-a0ad-ce5721d55a56 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:37:46 user nova-compute[73497]: DEBUG nova.compute.manager [req-57cc18ca-4ad5-47eb-bae7-c4c0f9f377c4 req-c65ca512-f719-4441-8f97-afcba23d767d service nova] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Received event network-vif-plugged-fbcd036f-eab6-435d-9eb6-856c76c37245 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:37:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-57cc18ca-4ad5-47eb-bae7-c4c0f9f377c4 req-c65ca512-f719-4441-8f97-afcba23d767d service nova] Acquiring lock "358ed2d7-4452-40cf-9fed-d9a8e45b5c99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:37:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-57cc18ca-4ad5-47eb-bae7-c4c0f9f377c4 req-c65ca512-f719-4441-8f97-afcba23d767d service nova] Lock "358ed2d7-4452-40cf-9fed-d9a8e45b5c99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:37:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-57cc18ca-4ad5-47eb-bae7-c4c0f9f377c4 req-c65ca512-f719-4441-8f97-afcba23d767d service nova] Lock "358ed2d7-4452-40cf-9fed-d9a8e45b5c99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:37:46 user nova-compute[73497]: DEBUG nova.compute.manager [req-57cc18ca-4ad5-47eb-bae7-c4c0f9f377c4 req-c65ca512-f719-4441-8f97-afcba23d767d service nova] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] No waiting events found dispatching network-vif-plugged-fbcd036f-eab6-435d-9eb6-856c76c37245 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:37:46 user nova-compute[73497]: WARNING nova.compute.manager [req-57cc18ca-4ad5-47eb-bae7-c4c0f9f377c4 req-c65ca512-f719-4441-8f97-afcba23d767d service nova] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Received unexpected event network-vif-plugged-fbcd036f-eab6-435d-9eb6-856c76c37245 for instance with vm_state deleted and task_state None.
Aug 26 23:37:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5dc2e280-cfb1-4794-a0ad-ce5721d55a56 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.252s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:37:46 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-5dc2e280-cfb1-4794-a0ad-ce5721d55a56 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Deleted allocations for instance 358ed2d7-4452-40cf-9fed-d9a8e45b5c99
Aug 26 23:37:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5dc2e280-cfb1-4794-a0ad-ce5721d55a56 tempest-TestServerVolumeAttachScenarioOldVersion-131421111 tempest-TestServerVolumeAttachScenarioOldVersion-131421111-project-member] Lock "358ed2d7-4452-40cf-9fed-d9a8e45b5c99" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.823s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:37:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:37:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '26333383434633339', 'path': '/dev/sdd'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:37:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333383434633339', 'path': '/dev/sdd'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:37:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T23:33:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1477188239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1477188239',id=38,image_ref='19064d93-0426-401c-9dc3-d65e7832d59d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1630262803',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:33:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f777a90b660e48cdb1f5a453fbe2f806',ramdisk_id='',reservation_id='r-f3c038xw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-389793905',owner_user_name='tempest-AttachVolumeShelveTestJSON-389793905-project-member',shelved_at='2023-08-26T23:35:35.581660',shelved_host='user',shelved_image_id='19064d93-0426-401c-9dc3-d65e7832d59d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:37:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d0fa85485fe42fc8a3b884f71db5669',uuid=db489468-154b-4238-8b81-f8fa2bc016b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "address": "fa:16:3e:ad:7f:ad", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc782cdf-fe", "ovs_interfaceid": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:37:46 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Converting VIF {"id": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "address": "fa:16:3e:ad:7f:ad", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc782cdf-fe", "ovs_interfaceid": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:37:46 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:7f:ad,bridge_name='br-int',has_traffic_filtering=True,id=fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5,network=Network(39b40d3c-dae0-4dcf-a0de-b77899879f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc782cdf-fe') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:37:46 user nova-compute[73497]: DEBUG nova.objects.instance [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lazy-loading 'pci_devices' on Instance uuid db489468-154b-4238-8b81-f8fa2bc016b7 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:37:46 user nova-compute[73497]: DEBUG nova.objects.base [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Object Instance<db489468-154b-4238-8b81-f8fa2bc016b7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:37:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:37:46 user nova-compute[73497]:   <uuid>db489468-154b-4238-8b81-f8fa2bc016b7</uuid>
Aug 26 23:37:46 user nova-compute[73497]:   <name>instance-00000026</name>
Aug 26 23:37:46 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:37:46 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:37:46 user nova-compute[73497]:   <metadata>
Aug 26 23:37:46 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:37:46 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:37:46 user nova-compute[73497]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1477188239</nova:name>
Aug 26 23:37:46 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:37:45</nova:creationTime>
Aug 26 23:37:46 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:37:46 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:37:46 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:37:46 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:37:46 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:37:46 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:37:46 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:37:46 user nova-compute[73497]:       <nova:owner>
Aug 26 23:37:46 user nova-compute[73497]:         <nova:user uuid="7d0fa85485fe42fc8a3b884f71db5669">tempest-AttachVolumeShelveTestJSON-389793905-project-member</nova:user>
Aug 26 23:37:46 user nova-compute[73497]:         <nova:project uuid="f777a90b660e48cdb1f5a453fbe2f806">tempest-AttachVolumeShelveTestJSON-389793905</nova:project>
Aug 26 23:37:46 user nova-compute[73497]:       </nova:owner>
Aug 26 23:37:46 user nova-compute[73497]:       <nova:root type="image" uuid="19064d93-0426-401c-9dc3-d65e7832d59d"/>
Aug 26 23:37:46 user nova-compute[73497]:       <nova:ports>
Aug 26 23:37:46 user nova-compute[73497]:         <nova:port uuid="fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5">
Aug 26 23:37:46 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 23:37:46 user nova-compute[73497]:         </nova:port>
Aug 26 23:37:46 user nova-compute[73497]:       </nova:ports>
Aug 26 23:37:46 user nova-compute[73497]:     </nova:instance>
Aug 26 23:37:46 user nova-compute[73497]:   </metadata>
Aug 26 23:37:46 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:37:46 user nova-compute[73497]:     <system>
Aug 26 23:37:46 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:37:46 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:37:46 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:37:46 user nova-compute[73497]:       <entry name="serial">db489468-154b-4238-8b81-f8fa2bc016b7</entry>
Aug 26 23:37:46 user nova-compute[73497]:       <entry name="uuid">db489468-154b-4238-8b81-f8fa2bc016b7</entry>
Aug 26 23:37:46 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:37:46 user nova-compute[73497]:     </system>
Aug 26 23:37:46 user nova-compute[73497]:   </sysinfo>
Aug 26 23:37:46 user nova-compute[73497]:   <os>
Aug 26 23:37:46 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:37:46 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:37:46 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:37:46 user nova-compute[73497]:   </os>
Aug 26 23:37:46 user nova-compute[73497]:   <features>
Aug 26 23:37:46 user nova-compute[73497]:     <acpi/>
Aug 26 23:37:46 user nova-compute[73497]:     <apic/>
Aug 26 23:37:46 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:37:46 user nova-compute[73497]:   </features>
Aug 26 23:37:46 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:37:46 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:37:46 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:37:46 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:37:46 user nova-compute[73497]:   </clock>
Aug 26 23:37:46 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:37:46 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:37:46 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:37:46 user nova-compute[73497]:   </cpu>
Aug 26 23:37:46 user nova-compute[73497]:   <devices>
Aug 26 23:37:46 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:37:46 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:37:46 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/disk"/>
Aug 26 23:37:46 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:37:46 user nova-compute[73497]:     </disk>
Aug 26 23:37:46 user nova-compute[73497]:     <disk type="block" device="disk">
Aug 26 23:37:46 user nova-compute[73497]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:37:46 user nova-compute[73497]:       <source dev="/dev/sdd"/>
Aug 26 23:37:46 user nova-compute[73497]:       <target dev="vdc" bus="virtio"/>
Aug 26 23:37:46 user nova-compute[73497]:       <serial>33321b8c-a031-4f7a-807f-4f10f54d086a</serial>
Aug 26 23:37:46 user nova-compute[73497]:     </disk>
Aug 26 23:37:46 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:37:46 user nova-compute[73497]:       <mac address="fa:16:3e:ad:7f:ad"/>
Aug 26 23:37:46 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:37:46 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:37:46 user nova-compute[73497]:       <target dev="tapfc782cdf-fe"/>
Aug 26 23:37:46 user nova-compute[73497]:     </interface>
Aug 26 23:37:46 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:37:46 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/console.log" append="off"/>
Aug 26 23:37:46 user nova-compute[73497]:     </serial>
Aug 26 23:37:46 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:37:46 user nova-compute[73497]:     <video>
Aug 26 23:37:46 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:37:46 user nova-compute[73497]:     </video>
Aug 26 23:37:46 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:37:46 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:37:46 user nova-compute[73497]:     </rng>
Aug 26 23:37:46 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:37:46 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:37:46 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:37:46 user nova-compute[73497]:     </memballoon>
Aug 26 23:37:46 user nova-compute[73497]:   </devices>
Aug 26 23:37:46 user nova-compute[73497]: </domain>
Aug 26 23:37:46 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:37:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T23:33:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1477188239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1477188239',id=38,image_ref='19064d93-0426-401c-9dc3-d65e7832d59d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1630262803',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:33:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f777a90b660e48cdb1f5a453fbe2f806',ramdisk_id='',reservation_id='r-f3c038xw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-389793905',owner_user_name='tempest-AttachVolumeShelveTestJSON-389793905-project-member',shelved_at='2023-08-26T23:35:35.581660',shelved_host='user',shelved_image_id='19064d93-0426-401c-9dc3-d65e7832d59d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:37:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d0fa85485fe42fc8a3b884f71db5669',uuid=db489468-154b-4238-8b81-f8fa2bc016b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "address": "fa:16:3e:ad:7f:ad", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc782cdf-fe", "ovs_interfaceid": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:37:46 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Converting VIF {"id": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "address": "fa:16:3e:ad:7f:ad", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc782cdf-fe", "ovs_interfaceid": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:37:46 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:7f:ad,bridge_name='br-int',has_traffic_filtering=True,id=fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5,network=Network(39b40d3c-dae0-4dcf-a0de-b77899879f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc782cdf-fe') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:37:46 user nova-compute[73497]: DEBUG os_vif [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:7f:ad,bridge_name='br-int',has_traffic_filtering=True,id=fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5,network=Network(39b40d3c-dae0-4dcf-a0de-b77899879f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc782cdf-fe') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:37:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:37:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:37:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc782cdf-fe, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:37:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfc782cdf-fe, col_values=(('external_ids', {'iface-id': 'fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:7f:ad', 'vm-uuid': 'db489468-154b-4238-8b81-f8fa2bc016b7'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:37:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:37:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:46 user nova-compute[73497]: INFO os_vif [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:7f:ad,bridge_name='br-int',has_traffic_filtering=True,id=fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5,network=Network(39b40d3c-dae0-4dcf-a0de-b77899879f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc782cdf-fe')
Aug 26 23:37:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:37:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:37:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] No VIF found with MAC fa:16:3e:ad:7f:ad, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:37:48 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:48 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:48 user nova-compute[73497]: DEBUG nova.compute.manager [req-103296f6-1d57-4512-ac26-1bdc1d0c40b8 req-5089b5e0-4a21-4029-9557-1cbaa8cce236 service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Received event network-vif-plugged-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:37:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-103296f6-1d57-4512-ac26-1bdc1d0c40b8 req-5089b5e0-4a21-4029-9557-1cbaa8cce236 service nova] Acquiring lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:37:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-103296f6-1d57-4512-ac26-1bdc1d0c40b8 req-5089b5e0-4a21-4029-9557-1cbaa8cce236 service nova] Lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:37:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-103296f6-1d57-4512-ac26-1bdc1d0c40b8 req-5089b5e0-4a21-4029-9557-1cbaa8cce236 service nova] Lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:37:48 user nova-compute[73497]: DEBUG nova.compute.manager [req-103296f6-1d57-4512-ac26-1bdc1d0c40b8 req-5089b5e0-4a21-4029-9557-1cbaa8cce236 service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] No waiting events found dispatching network-vif-plugged-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:37:48 user nova-compute[73497]: WARNING nova.compute.manager [req-103296f6-1d57-4512-ac26-1bdc1d0c40b8 req-5089b5e0-4a21-4029-9557-1cbaa8cce236 service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Received unexpected event network-vif-plugged-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 23:37:48 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:48 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:48 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:50 user nova-compute[73497]: DEBUG nova.compute.manager [req-d2cfc6a4-884e-45a3-8a97-dd65d1ac1a52 req-f3840f79-70c4-45e9-aab5-84e00af3bf12 service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Received event network-vif-plugged-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:37:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d2cfc6a4-884e-45a3-8a97-dd65d1ac1a52 req-f3840f79-70c4-45e9-aab5-84e00af3bf12 service nova] Acquiring lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:37:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d2cfc6a4-884e-45a3-8a97-dd65d1ac1a52 req-f3840f79-70c4-45e9-aab5-84e00af3bf12 service nova] Lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:37:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d2cfc6a4-884e-45a3-8a97-dd65d1ac1a52 req-f3840f79-70c4-45e9-aab5-84e00af3bf12 service nova] Lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:37:50 user nova-compute[73497]: DEBUG nova.compute.manager [req-d2cfc6a4-884e-45a3-8a97-dd65d1ac1a52 req-f3840f79-70c4-45e9-aab5-84e00af3bf12 service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] No waiting events found dispatching network-vif-plugged-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:37:50 user nova-compute[73497]: WARNING nova.compute.manager [req-d2cfc6a4-884e-45a3-8a97-dd65d1ac1a52 req-f3840f79-70c4-45e9-aab5-84e00af3bf12 service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Received unexpected event network-vif-plugged-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 23:37:50 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693093070.5390086, db489468-154b-4238-8b81-f8fa2bc016b7 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:37:50 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] VM Resumed (Lifecycle Event)
Aug 26 23:37:50 user nova-compute[73497]: DEBUG nova.compute.manager [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:37:50 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:37:50 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Instance spawned successfully.
Aug 26 23:37:50 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:37:50 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:37:50 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:37:50 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693093070.5405858, db489468-154b-4238-8b81-f8fa2bc016b7 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:37:50 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] VM Started (Lifecycle Event)
Aug 26 23:37:50 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:37:50 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:37:50 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:37:50 user nova-compute[73497]: DEBUG nova.compute.manager [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:37:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-94fc51ba-d3d9-4795-b633-3bb06e2f3872 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "db489468-154b-4238-8b81-f8fa2bc016b7" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 26.233s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:37:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:37:59 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693093064.2024803, 358ed2d7-4452-40cf-9fed-d9a8e45b5c99 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:37:59 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] VM Stopped (Lifecycle Event)
Aug 26 23:37:59 user nova-compute[73497]: DEBUG nova.compute.manager [None req-09ad8f37-fd8f-4a19-9c8a-275740718b52 None None] [instance: 358ed2d7-4452-40cf-9fed-d9a8e45b5c99] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:38:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:38:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:38:03 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:38:03 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:38:04 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:38:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:38:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:38:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:38:04 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:38:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:04 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:38:04 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:38:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1fa7599-72de-487d-9b0e-0adf8c0120ca/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1fa7599-72de-487d-9b0e-0adf8c0120ca/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1fa7599-72de-487d-9b0e-0adf8c0120ca/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1fa7599-72de-487d-9b0e-0adf8c0120ca/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:05 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:38:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94425d3d-4703-434f-8a58-19a334b44d69/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94425d3d-4703-434f-8a58-19a334b44d69/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94425d3d-4703-434f-8a58-19a334b44d69/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:05 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94425d3d-4703-434f-8a58-19a334b44d69/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:06 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:38:06 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:38:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=7970MB free_disk=25.081356048583984GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:38:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:38:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:38:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance f1fa7599-72de-487d-9b0e-0adf8c0120ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:38:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 94425d3d-4703-434f-8a58-19a334b44d69 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:38:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 71518c06-a7d0-49fa-88de-ffb4af927f47 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:38:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance db489468-154b-4238-8b81-f8fa2bc016b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:38:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:38:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:38:06 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:38:06 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:38:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:38:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.312s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:38:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:38:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:38:08 user nova-compute[73497]: DEBUG nova.compute.manager [req-eb23006e-26b7-48bd-878d-663e003c074b req-dfd45e81-1a73-425a-a33f-4b4cfdd98106 service nova] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Received event network-changed-cbcbd7d5-cca7-4e29-bf12-e472b1730340 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:38:08 user nova-compute[73497]: DEBUG nova.compute.manager [req-eb23006e-26b7-48bd-878d-663e003c074b req-dfd45e81-1a73-425a-a33f-4b4cfdd98106 service nova] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Refreshing instance network info cache due to event network-changed-cbcbd7d5-cca7-4e29-bf12-e472b1730340. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:38:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-eb23006e-26b7-48bd-878d-663e003c074b req-dfd45e81-1a73-425a-a33f-4b4cfdd98106 service nova] Acquiring lock "refresh_cache-94425d3d-4703-434f-8a58-19a334b44d69" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:38:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-eb23006e-26b7-48bd-878d-663e003c074b req-dfd45e81-1a73-425a-a33f-4b4cfdd98106 service nova] Acquired lock "refresh_cache-94425d3d-4703-434f-8a58-19a334b44d69" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:38:08 user nova-compute[73497]: DEBUG nova.network.neutron [req-eb23006e-26b7-48bd-878d-663e003c074b req-dfd45e81-1a73-425a-a33f-4b4cfdd98106 service nova] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Refreshing network info cache for port cbcbd7d5-cca7-4e29-bf12-e472b1730340 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:38:08 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:38:08 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:38:08 user nova-compute[73497]: DEBUG nova.network.neutron [req-eb23006e-26b7-48bd-878d-663e003c074b req-dfd45e81-1a73-425a-a33f-4b4cfdd98106 service nova] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Updated VIF entry in instance network info cache for port cbcbd7d5-cca7-4e29-bf12-e472b1730340. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:38:08 user nova-compute[73497]: DEBUG nova.network.neutron [req-eb23006e-26b7-48bd-878d-663e003c074b req-dfd45e81-1a73-425a-a33f-4b4cfdd98106 service nova] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Updating instance_info_cache with network_info: [{"id": "cbcbd7d5-cca7-4e29-bf12-e472b1730340", "address": "fa:16:3e:f0:47:cf", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbcbd7d5-cc", "ovs_interfaceid": "cbcbd7d5-cca7-4e29-bf12-e472b1730340", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:38:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-eb23006e-26b7-48bd-878d-663e003c074b req-dfd45e81-1a73-425a-a33f-4b4cfdd98106 service nova] Releasing lock "refresh_cache-94425d3d-4703-434f-8a58-19a334b44d69" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:38:11 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:38:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:38:12 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:38:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:38:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "94425d3d-4703-434f-8a58-19a334b44d69" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:38:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "94425d3d-4703-434f-8a58-19a334b44d69" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:38:12 user nova-compute[73497]: DEBUG nova.objects.instance [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lazy-loading 'flavor' on Instance uuid 94425d3d-4703-434f-8a58-19a334b44d69 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:38:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "94425d3d-4703-434f-8a58-19a334b44d69" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:38:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "94425d3d-4703-434f-8a58-19a334b44d69" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:38:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "94425d3d-4703-434f-8a58-19a334b44d69" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:38:13 user nova-compute[73497]: INFO nova.compute.manager [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Attaching volume 408efd96-971c-4eb5-ac2f-b8866e3554a3 to /dev/vdb
Aug 26 23:38:13 user nova-compute[73497]: DEBUG os_brick.utils [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:38:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:13 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a664b220-1280-4281-89d2-ddb087ccc498]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:13 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9e1b71-683b-4c11-944e-805498f78243]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:13 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[184ecf62-ce99-4021-874f-68b74f28acad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:13 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[964b7a40-36cd-417a-a985-9105b3b2d18c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:38:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:38:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:38:13 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:38:13 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97a3a04-22b8-44ac-88fe-ecdce1c11332]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:38:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:38:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:38:13 user nova-compute[73497]: DEBUG os_brick.utils [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:38:13 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Updating existing volume attachment record: d12006f8-3671-4edc-b6b1-f245b5fcc207 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:38:14 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:38:15 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:38:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:38:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:38:18 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:38:18 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:38:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-f1fa7599-72de-487d-9b0e-0adf8c0120ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:38:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-f1fa7599-72de-487d-9b0e-0adf8c0120ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:38:18 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:38:18 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Updating instance_info_cache with network_info: [{"id": "4f594b38-986f-42c8-bb69-4caeabfe1b56", "address": "fa:16:3e:f0:fe:b5", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f594b38-98", "ovs_interfaceid": "4f594b38-986f-42c8-bb69-4caeabfe1b56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:38:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-f1fa7599-72de-487d-9b0e-0adf8c0120ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:38:18 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:38:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:38:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MPhCrTKN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:38:24 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:38:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:38:24 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:38:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:38:24 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:38:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f48966-0454-4020-96bc-93ab1930aa29]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:38:24 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfd994e-0a3c-4131-8f75-05e1714cc1ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3] added
Aug 26 23:38:24 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4758c0-d9a0-4f5d-9104-d9837a701559]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d10be9f-1ef7-4e2e-9fd3-79e1389db45b]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MPhCrTKN {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MPhCrTKN" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01d14dd-b765-44ce-9f6f-3d07bf3af09f]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MPhCrTKN'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d5be10-a887-45a4-9037-1392e7a5e86e]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae688016-6f07-4177-8d8d-7c8f7fba39b0]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)
Aug 26 23:38:24 user nova-compute[73497]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)
Aug 26 23:38:24 user nova-compute[73497]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a (non-flash)
Aug 26 23:38:24 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)
Aug 26 23:38:24 user nova-compute[73497]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)
Aug 26 23:38:24 user nova-compute[73497]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a (non-flash)
Aug 26 23:38:24 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[04422a3d-cc57-47dc-9b89-eead596d66ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3, portal: 172.16.0.220,3260]
Aug 26 23:38:24 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3, portal: 172.16.0.220,3260] successful.
Aug 26 23:38:24 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6b20c7-c818-4ee8-9b23-6ccb1709151a]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:38:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:25 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54f4883-b5ed-4e9c-acb8-dde45b688495]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)
Aug 26 23:38:25 user nova-compute[73497]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)
Aug 26 23:38:25 user nova-compute[73497]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a (non-flash)
Aug 26 23:38:25 user nova-compute[73497]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3 (non-flash)
Aug 26 23:38:25 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:38:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)
Aug 26 23:38:25 user nova-compute[73497]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)
Aug 26 23:38:25 user nova-compute[73497]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a (non-flash)
Aug 26 23:38:25 user nova-compute[73497]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3 (non-flash)
Aug 26 23:38:25 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:38:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:38:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:38:25 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] HCTL ('36', '-', '-', 0) found on session 47 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:38:25 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:38:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:25 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b5e828-50b4-484d-b9bd-307a10c62bf8]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:25 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Searching for a device in session 47 and hctl ['36', '*', '*', 0] yield: None {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:38:26 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Searching for a device in session 47 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:38:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MPhCrTKN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:38:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:38:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23963646264623465', 'path': '/dev/sde'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:38:26 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963646264623465', 'path': '/dev/sde'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:38:26 user nova-compute[73497]: DEBUG nova.objects.instance [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lazy-loading 'flavor' on Instance uuid 94425d3d-4703-434f-8a58-19a334b44d69 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:38:26 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 23:38:26 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:38:26 user nova-compute[73497]:   <source dev="/dev/sde"/>
Aug 26 23:38:26 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:38:26 user nova-compute[73497]:   <serial>408efd96-971c-4eb5-ac2f-b8866e3554a3</serial>
Aug 26 23:38:26 user nova-compute[73497]: </disk>
Aug 26 23:38:26 user nova-compute[73497]:  {{(pid=73497) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 23:38:26 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:38:26 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:38:26 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] No VIF found with MAC fa:16:3e:f0:47:cf, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:38:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:38:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ced44a59-e9dd-4b6d-bc2d-15b040e9d838 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "94425d3d-4703-434f-8a58-19a334b44d69" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.525s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:38:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:38:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:38:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:38:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:38:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:38:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:38:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:38:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:38:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:38:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "94425d3d-4703-434f-8a58-19a334b44d69" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:38:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "94425d3d-4703-434f-8a58-19a334b44d69" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:38:40 user nova-compute[73497]: DEBUG nova.objects.instance [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lazy-loading 'flavor' on Instance uuid 94425d3d-4703-434f-8a58-19a334b44d69 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:38:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "94425d3d-4703-434f-8a58-19a334b44d69" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:38:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "94425d3d-4703-434f-8a58-19a334b44d69" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:38:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "94425d3d-4703-434f-8a58-19a334b44d69" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:38:40 user nova-compute[73497]: INFO nova.compute.manager [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Attaching volume c09b37d5-7201-4a0f-9089-cc2793f7c515 to /dev/vdc
Aug 26 23:38:40 user nova-compute[73497]: DEBUG os_brick.utils [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:38:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:40 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d622ec9c-8b9e-4bf5-81da-ca1cfafffdc4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:40 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d37886-9016-4948-8bcf-87030a584afe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:40 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[116c048f-3f3a-486b-83df-d1c6c3488eeb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:40 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd3969a-e0c5-4b9d-9a38-61a4fae5dd77]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:38:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:38:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:38:40 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:38:40 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:38:40 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b9c47c-e026-4498-af11-acac6b982ba4]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:38:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:38:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:38:40 user nova-compute[73497]: DEBUG os_brick.utils [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:38:40 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Updating existing volume attachment record: 6ee4e9bf-ff8d-4c04-a267-e7b52fc74cef {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:38:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:38:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:38:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:38:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'skxqIyFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:38:52 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:38:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:38:52 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:38:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:38:52 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:38:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2af64f-9308-4f40-a317-08539747511e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:38:52 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a309ee4-46cb-48fa-8cb8-e1b93b0fee13]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515] added
Aug 26 23:38:52 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5634a78-4174-4936-a1c2-56a09b963faf]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[494da4af-8df2-4493-bea3-6c9ef7e19401]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v skxqIyFg {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v skxqIyFg" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf460e06-1999-4f26-9a0d-d401ed9e235c]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'skxqIyFg'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b747298f-567f-4d90-ae80-8b677c795001]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3bc70e-9c9e-48da-a892-59c531a326bc]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)
Aug 26 23:38:52 user nova-compute[73497]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)
Aug 26 23:38:52 user nova-compute[73497]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a (non-flash)
Aug 26 23:38:52 user nova-compute[73497]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3 (non-flash)
Aug 26 23:38:52 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)
Aug 26 23:38:52 user nova-compute[73497]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)
Aug 26 23:38:52 user nova-compute[73497]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a (non-flash)
Aug 26 23:38:52 user nova-compute[73497]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3 (non-flash)
Aug 26 23:38:52 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f97161-7d17-477c-a94c-8d72d78d0320]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515, portal: 172.16.0.220,3260]
Aug 26 23:38:52 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515, portal: 172.16.0.220,3260] successful.
Aug 26 23:38:52 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[51004181-f837-4de3-9d84-40d5fe01719a]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f07f8c-70c1-4f84-9a12-cc3699adce72]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)
Aug 26 23:38:52 user nova-compute[73497]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)
Aug 26 23:38:52 user nova-compute[73497]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a (non-flash)
Aug 26 23:38:52 user nova-compute[73497]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3 (non-flash)
Aug 26 23:38:52 user nova-compute[73497]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515 (non-flash)
Aug 26 23:38:52 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)
Aug 26 23:38:52 user nova-compute[73497]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)
Aug 26 23:38:52 user nova-compute[73497]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a (non-flash)
Aug 26 23:38:52 user nova-compute[73497]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3 (non-flash)
Aug 26 23:38:52 user nova-compute[73497]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515 (non-flash)
Aug 26 23:38:52 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] HCTL ('37', '-', '-', 0) found on session 48 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a208ef7-0ea2-438c-99c3-c9ec496d52c9]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Searching for a device in session 48 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:38:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'skxqIyFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:38:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:38:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23232613236623639', 'path': '/dev/sdf'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:38:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232613236623639', 'path': '/dev/sdf'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:38:53 user nova-compute[73497]: DEBUG nova.objects.instance [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lazy-loading 'flavor' on Instance uuid 94425d3d-4703-434f-8a58-19a334b44d69 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:38:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 23:38:53 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:38:53 user nova-compute[73497]:   <source dev="/dev/sdf"/>
Aug 26 23:38:53 user nova-compute[73497]:   <target dev="vdc" bus="virtio"/>
Aug 26 23:38:53 user nova-compute[73497]:   <serial>c09b37d5-7201-4a0f-9089-cc2793f7c515</serial>
Aug 26 23:38:53 user nova-compute[73497]: </disk>
Aug 26 23:38:53 user nova-compute[73497]:  {{(pid=73497) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 23:38:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:38:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:38:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:38:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] No VIF found with MAC fa:16:3e:f0:47:cf, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:38:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-cf6999eb-3b49-44fd-877d-d54bedb7a930 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "94425d3d-4703-434f-8a58-19a334b44d69" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.565s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-dcbdb40a-4084-4cf6-ba7c-85d3843d3ffb tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "94425d3d-4703-434f-8a58-19a334b44d69" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-dcbdb40a-4084-4cf6-ba7c-85d3843d3ffb tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "94425d3d-4703-434f-8a58-19a334b44d69" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:38:55 user nova-compute[73497]: INFO nova.compute.manager [None req-dcbdb40a-4084-4cf6-ba7c-85d3843d3ffb tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Detaching volume 408efd96-971c-4eb5-ac2f-b8866e3554a3
Aug 26 23:38:55 user nova-compute[73497]: INFO nova.virt.block_device [None req-dcbdb40a-4084-4cf6-ba7c-85d3843d3ffb tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Attempting to driver detach volume 408efd96-971c-4eb5-ac2f-b8866e3554a3 from mountpoint /dev/vdb
Aug 26 23:38:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-dcbdb40a-4084-4cf6-ba7c-85d3843d3ffb tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Attempting to detach device vdb from instance 94425d3d-4703-434f-8a58-19a334b44d69 from the persistent domain config. {{(pid=73497) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-dcbdb40a-4084-4cf6-ba7c-85d3843d3ffb tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:38:55 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:38:55 user nova-compute[73497]:   <source dev="/dev/sde"/>
Aug 26 23:38:55 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:38:55 user nova-compute[73497]:   <serial>408efd96-971c-4eb5-ac2f-b8866e3554a3</serial>
Aug 26 23:38:55 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:38:55 user nova-compute[73497]: </disk>
Aug 26 23:38:55 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:38:55 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-dcbdb40a-4084-4cf6-ba7c-85d3843d3ffb tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Successfully detached device vdb from instance 94425d3d-4703-434f-8a58-19a334b44d69 from the persistent domain config.
Aug 26 23:38:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-dcbdb40a-4084-4cf6-ba7c-85d3843d3ffb tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 94425d3d-4703-434f-8a58-19a334b44d69 from the live domain config. {{(pid=73497) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-dcbdb40a-4084-4cf6-ba7c-85d3843d3ffb tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:38:55 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:38:55 user nova-compute[73497]:   <source dev="/dev/sde"/>
Aug 26 23:38:55 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:38:55 user nova-compute[73497]:   <serial>408efd96-971c-4eb5-ac2f-b8866e3554a3</serial>
Aug 26 23:38:55 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:38:55 user nova-compute[73497]: </disk>
Aug 26 23:38:55 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Received event <DeviceRemovedEvent: 1693093135.7027307, 94425d3d-4703-434f-8a58-19a334b44d69 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73497) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-dcbdb40a-4084-4cf6-ba7c-85d3843d3ffb tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 94425d3d-4703-434f-8a58-19a334b44d69 {{(pid=73497) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 23:38:55 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-dcbdb40a-4084-4cf6-ba7c-85d3843d3ffb tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Successfully detached device vdb from instance 94425d3d-4703-434f-8a58-19a334b44d69 from the live domain config.
Aug 26 23:38:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcbdb40a-4084-4cf6-ba7c-85d3843d3ffb tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbdb40a-4084-4cf6-ba7c-85d3843d3ffb tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MPhCrTKN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:38:55 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-dcbdb40a-4084-4cf6-ba7c-85d3843d3ffb tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:38:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-dcbdb40a-4084-4cf6-ba7c-85d3843d3ffb tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-dcbdb40a-4084-4cf6-ba7c-85d3843d3ffb tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbdb40a-4084-4cf6-ba7c-85d3843d3ffb tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca53f247-e500-4355-b800-b31f0613e8a9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57a0809-b91b-4645-bb94-091dc7700835]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbdb40a-4084-4cf6-ba7c-85d3843d3ffb tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)
Aug 26 23:38:55 user nova-compute[73497]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)
Aug 26 23:38:55 user nova-compute[73497]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a (non-flash)
Aug 26 23:38:55 user nova-compute[73497]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3 (non-flash)
Aug 26 23:38:55 user nova-compute[73497]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515 (non-flash)
Aug 26 23:38:55 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbdb40a-4084-4cf6-ba7c-85d3843d3ffb tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)
Aug 26 23:38:55 user nova-compute[73497]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)
Aug 26 23:38:55 user nova-compute[73497]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a (non-flash)
Aug 26 23:38:55 user nova-compute[73497]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3 (non-flash)
Aug 26 23:38:55 user nova-compute[73497]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515 (non-flash)
Aug 26 23:38:55 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbdb40a-4084-4cf6-ba7c-85d3843d3ffb tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281c57a7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3'): ({'sde'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-dcbdb40a-4084-4cf6-ba7c-85d3843d3ffb tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Removing single pathed devices sde {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[58dbd9b2-5f45-460d-8c25-0e777a6e4335]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac8d917-c57e-4165-80c2-e4f544fb83e6]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-dcbdb40a-4084-4cf6-ba7c-85d3843d3ffb tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Flushing IO for device /dev/sde {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[15496a6e-c098-4f8f-981f-f370109b2b6c]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-dcbdb40a-4084-4cf6-ba7c-85d3843d3ffb tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9581eeb5-ad5d-4558-a7a3-696b9646b07b]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-dcbdb40a-4084-4cf6-ba7c-85d3843d3ffb tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-dcbdb40a-4084-4cf6-ba7c-85d3843d3ffb tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] SCSI volumes sde have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbdb40a-4084-4cf6-ba7c-85d3843d3ffb tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b132a24a-fc8d-4e06-82d2-034c5745cfde]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbdb40a-4084-4cf6-ba7c-85d3843d3ffb tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[81344822-a43e-403e-8e35-82accefbf600]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbdb40a-4084-4cf6-ba7c-85d3843d3ffb tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3, portal: 172.16.0.220,3260]
Aug 26 23:38:55 user nova-compute[73497]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3, portal: 172.16.0.220,3260] successful.
Aug 26 23:38:55 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:38:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:408efd96-971c-4eb5-ac2f-b8866e3554a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:56 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c044fc-ad00-45b2-93f9-292b8b54de72]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbdb40a-4084-4cf6-ba7c-85d3843d3ffb tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:38:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-dcbdb40a-4084-4cf6-ba7c-85d3843d3ffb tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:38:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbdb40a-4084-4cf6-ba7c-85d3843d3ffb tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] <== disconnect_volume: return (305ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:38:56 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcbdb40a-4084-4cf6-ba7c-85d3843d3ffb tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:38:56 user nova-compute[73497]: DEBUG nova.compute.manager [req-6cd8f77c-9d87-40a1-903d-f7c1f6daf734 req-09731763-26ab-408e-8085-df399dc0b810 service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Received event network-changed-4f594b38-986f-42c8-bb69-4caeabfe1b56 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:38:56 user nova-compute[73497]: DEBUG nova.compute.manager [req-6cd8f77c-9d87-40a1-903d-f7c1f6daf734 req-09731763-26ab-408e-8085-df399dc0b810 service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Refreshing instance network info cache due to event network-changed-4f594b38-986f-42c8-bb69-4caeabfe1b56. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:38:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6cd8f77c-9d87-40a1-903d-f7c1f6daf734 req-09731763-26ab-408e-8085-df399dc0b810 service nova] Acquiring lock "refresh_cache-f1fa7599-72de-487d-9b0e-0adf8c0120ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:38:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6cd8f77c-9d87-40a1-903d-f7c1f6daf734 req-09731763-26ab-408e-8085-df399dc0b810 service nova] Acquired lock "refresh_cache-f1fa7599-72de-487d-9b0e-0adf8c0120ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:38:56 user nova-compute[73497]: DEBUG nova.network.neutron [req-6cd8f77c-9d87-40a1-903d-f7c1f6daf734 req-09731763-26ab-408e-8085-df399dc0b810 service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Refreshing network info cache for port 4f594b38-986f-42c8-bb69-4caeabfe1b56 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:38:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:38:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:38:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:38:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:38:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:38:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:38:56 user nova-compute[73497]: DEBUG nova.objects.instance [None req-dcbdb40a-4084-4cf6-ba7c-85d3843d3ffb tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lazy-loading 'flavor' on Instance uuid 94425d3d-4703-434f-8a58-19a334b44d69 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:38:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-dcbdb40a-4084-4cf6-ba7c-85d3843d3ffb tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "94425d3d-4703-434f-8a58-19a334b44d69" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.840s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:38:57 user nova-compute[73497]: DEBUG nova.network.neutron [req-6cd8f77c-9d87-40a1-903d-f7c1f6daf734 req-09731763-26ab-408e-8085-df399dc0b810 service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Updated VIF entry in instance network info cache for port 4f594b38-986f-42c8-bb69-4caeabfe1b56. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:38:57 user nova-compute[73497]: DEBUG nova.network.neutron [req-6cd8f77c-9d87-40a1-903d-f7c1f6daf734 req-09731763-26ab-408e-8085-df399dc0b810 service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Updating instance_info_cache with network_info: [{"id": "4f594b38-986f-42c8-bb69-4caeabfe1b56", "address": "fa:16:3e:f0:fe:b5", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f594b38-98", "ovs_interfaceid": "4f594b38-986f-42c8-bb69-4caeabfe1b56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:38:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6cd8f77c-9d87-40a1-903d-f7c1f6daf734 req-09731763-26ab-408e-8085-df399dc0b810 service nova] Releasing lock "refresh_cache-f1fa7599-72de-487d-9b0e-0adf8c0120ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:38:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:38:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c8e87f67-8768-431a-8e66-89ec43fdfaa5 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "94425d3d-4703-434f-8a58-19a334b44d69" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:38:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c8e87f67-8768-431a-8e66-89ec43fdfaa5 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "94425d3d-4703-434f-8a58-19a334b44d69" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:38:57 user nova-compute[73497]: INFO nova.compute.manager [None req-c8e87f67-8768-431a-8e66-89ec43fdfaa5 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Detaching volume c09b37d5-7201-4a0f-9089-cc2793f7c515
Aug 26 23:38:57 user nova-compute[73497]: DEBUG nova.compute.manager [req-efa8ff8f-fbb5-453e-836f-61c8c4b72959 req-98daa81d-e58d-4f11-ac1d-69b7a72bbfb5 service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Received event network-changed-4f594b38-986f-42c8-bb69-4caeabfe1b56 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:38:57 user nova-compute[73497]: DEBUG nova.compute.manager [req-efa8ff8f-fbb5-453e-836f-61c8c4b72959 req-98daa81d-e58d-4f11-ac1d-69b7a72bbfb5 service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Refreshing instance network info cache due to event network-changed-4f594b38-986f-42c8-bb69-4caeabfe1b56. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:38:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-efa8ff8f-fbb5-453e-836f-61c8c4b72959 req-98daa81d-e58d-4f11-ac1d-69b7a72bbfb5 service nova] Acquiring lock "refresh_cache-f1fa7599-72de-487d-9b0e-0adf8c0120ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:38:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-efa8ff8f-fbb5-453e-836f-61c8c4b72959 req-98daa81d-e58d-4f11-ac1d-69b7a72bbfb5 service nova] Acquired lock "refresh_cache-f1fa7599-72de-487d-9b0e-0adf8c0120ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:38:57 user nova-compute[73497]: DEBUG nova.network.neutron [req-efa8ff8f-fbb5-453e-836f-61c8c4b72959 req-98daa81d-e58d-4f11-ac1d-69b7a72bbfb5 service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Refreshing network info cache for port 4f594b38-986f-42c8-bb69-4caeabfe1b56 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:38:57 user nova-compute[73497]: INFO nova.virt.block_device [None req-c8e87f67-8768-431a-8e66-89ec43fdfaa5 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Attempting to driver detach volume c09b37d5-7201-4a0f-9089-cc2793f7c515 from mountpoint /dev/vdc
Aug 26 23:38:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c8e87f67-8768-431a-8e66-89ec43fdfaa5 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Attempting to detach device vdc from instance 94425d3d-4703-434f-8a58-19a334b44d69 from the persistent domain config. {{(pid=73497) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 23:38:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-c8e87f67-8768-431a-8e66-89ec43fdfaa5 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:38:57 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:38:57 user nova-compute[73497]:   <source dev="/dev/sdf"/>
Aug 26 23:38:57 user nova-compute[73497]:   <target dev="vdc" bus="virtio"/>
Aug 26 23:38:57 user nova-compute[73497]:   <serial>c09b37d5-7201-4a0f-9089-cc2793f7c515</serial>
Aug 26 23:38:57 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 23:38:57 user nova-compute[73497]: </disk>
Aug 26 23:38:57 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:38:57 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-c8e87f67-8768-431a-8e66-89ec43fdfaa5 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Successfully detached device vdc from instance 94425d3d-4703-434f-8a58-19a334b44d69 from the persistent domain config.
Aug 26 23:38:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c8e87f67-8768-431a-8e66-89ec43fdfaa5 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 94425d3d-4703-434f-8a58-19a334b44d69 from the live domain config. {{(pid=73497) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 23:38:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-c8e87f67-8768-431a-8e66-89ec43fdfaa5 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:38:57 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:38:57 user nova-compute[73497]:   <source dev="/dev/sdf"/>
Aug 26 23:38:57 user nova-compute[73497]:   <target dev="vdc" bus="virtio"/>
Aug 26 23:38:57 user nova-compute[73497]:   <serial>c09b37d5-7201-4a0f-9089-cc2793f7c515</serial>
Aug 26 23:38:57 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 23:38:57 user nova-compute[73497]: </disk>
Aug 26 23:38:57 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:38:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b1a5890e-f3fe-4061-bd3f-9926c524a8a6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:38:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b1a5890e-f3fe-4061-bd3f-9926c524a8a6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:38:57 user nova-compute[73497]: INFO nova.compute.manager [None req-b1a5890e-f3fe-4061-bd3f-9926c524a8a6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Detaching volume 5df2b0ba-df91-442b-bc03-1781ad1ee6f5
Aug 26 23:38:58 user nova-compute[73497]: INFO nova.virt.block_device [None req-b1a5890e-f3fe-4061-bd3f-9926c524a8a6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Attempting to driver detach volume 5df2b0ba-df91-442b-bc03-1781ad1ee6f5 from mountpoint /dev/vdb
Aug 26 23:38:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b1a5890e-f3fe-4061-bd3f-9926c524a8a6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Attempting to detach device vdb from instance f1fa7599-72de-487d-9b0e-0adf8c0120ca from the persistent domain config. {{(pid=73497) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-b1a5890e-f3fe-4061-bd3f-9926c524a8a6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:38:58 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:38:58 user nova-compute[73497]:   <source dev="/dev/sdc"/>
Aug 26 23:38:58 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:38:58 user nova-compute[73497]:   <serial>5df2b0ba-df91-442b-bc03-1781ad1ee6f5</serial>
Aug 26 23:38:58 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:38:58 user nova-compute[73497]: </disk>
Aug 26 23:38:58 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:38:58 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-b1a5890e-f3fe-4061-bd3f-9926c524a8a6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Successfully detached device vdb from instance f1fa7599-72de-487d-9b0e-0adf8c0120ca from the persistent domain config.
Aug 26 23:38:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b1a5890e-f3fe-4061-bd3f-9926c524a8a6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f1fa7599-72de-487d-9b0e-0adf8c0120ca from the live domain config. {{(pid=73497) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-b1a5890e-f3fe-4061-bd3f-9926c524a8a6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:38:58 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:38:58 user nova-compute[73497]:   <source dev="/dev/sdc"/>
Aug 26 23:38:58 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:38:58 user nova-compute[73497]:   <serial>5df2b0ba-df91-442b-bc03-1781ad1ee6f5</serial>
Aug 26 23:38:58 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:38:58 user nova-compute[73497]: </disk>
Aug 26 23:38:58 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Received event <DeviceRemovedEvent: 1693093138.202925, 94425d3d-4703-434f-8a58-19a334b44d69 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73497) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG nova.network.neutron [req-efa8ff8f-fbb5-453e-836f-61c8c4b72959 req-98daa81d-e58d-4f11-ac1d-69b7a72bbfb5 service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Updated VIF entry in instance network info cache for port 4f594b38-986f-42c8-bb69-4caeabfe1b56. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG nova.network.neutron [req-efa8ff8f-fbb5-453e-836f-61c8c4b72959 req-98daa81d-e58d-4f11-ac1d-69b7a72bbfb5 service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Updating instance_info_cache with network_info: [{"id": "4f594b38-986f-42c8-bb69-4caeabfe1b56", "address": "fa:16:3e:f0:fe:b5", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f594b38-98", "ovs_interfaceid": "4f594b38-986f-42c8-bb69-4caeabfe1b56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-c8e87f67-8768-431a-8e66-89ec43fdfaa5 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 94425d3d-4703-434f-8a58-19a334b44d69 {{(pid=73497) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 23:38:58 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-c8e87f67-8768-431a-8e66-89ec43fdfaa5 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Successfully detached device vdc from instance 94425d3d-4703-434f-8a58-19a334b44d69 from the live domain config.
Aug 26 23:38:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8e87f67-8768-431a-8e66-89ec43fdfaa5 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e87f67-8768-431a-8e66-89ec43fdfaa5 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'skxqIyFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:38:58 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-c8e87f67-8768-431a-8e66-89ec43fdfaa5 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:38:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-c8e87f67-8768-431a-8e66-89ec43fdfaa5 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-c8e87f67-8768-431a-8e66-89ec43fdfaa5 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e87f67-8768-431a-8e66-89ec43fdfaa5 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-efa8ff8f-fbb5-453e-836f-61c8c4b72959 req-98daa81d-e58d-4f11-ac1d-69b7a72bbfb5 service nova] Releasing lock "refresh_cache-f1fa7599-72de-487d-9b0e-0adf8c0120ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[495a6e6f-3d76-43b5-9e8a-a530c279f062]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[61970e3b-cd64-4d54-b0d2-e9e8e0fd7ab1]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e87f67-8768-431a-8e66-89ec43fdfaa5 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)
Aug 26 23:38:58 user nova-compute[73497]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)
Aug 26 23:38:58 user nova-compute[73497]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a (non-flash)
Aug 26 23:38:58 user nova-compute[73497]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515 (non-flash)
Aug 26 23:38:58 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e87f67-8768-431a-8e66-89ec43fdfaa5 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)
Aug 26 23:38:58 user nova-compute[73497]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)
Aug 26 23:38:58 user nova-compute[73497]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a (non-flash)
Aug 26 23:38:58 user nova-compute[73497]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515 (non-flash)
Aug 26 23:38:58 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e87f67-8768-431a-8e66-89ec43fdfaa5 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281c3d5090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515'): ({'sdf'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-c8e87f67-8768-431a-8e66-89ec43fdfaa5 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Removing single pathed devices sdf {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d1ee82-4caf-4648-88e9-82a04cc69c3d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a7611b-4c3e-42c5-bb81-3e3e51d19a9a]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-c8e87f67-8768-431a-8e66-89ec43fdfaa5 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Flushing IO for device /dev/sdf {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbda330f-fa2a-4ae5-a23b-3f5186de069b]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-c8e87f67-8768-431a-8e66-89ec43fdfaa5 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.036s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f64f66f-d202-43c9-9176-39ebcf56b8ac]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-c8e87f67-8768-431a-8e66-89ec43fdfaa5 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-c8e87f67-8768-431a-8e66-89ec43fdfaa5 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] SCSI volumes sdf have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e87f67-8768-431a-8e66-89ec43fdfaa5 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc23475e-f2fe-49cb-a3e6-d1f601e21d1e]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e87f67-8768-431a-8e66-89ec43fdfaa5 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515 -p 172.16.0.220:3260 --logout" returned: 0 in 0.112s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5faf18e7-915e-4c31-983f-2469e60b3bec]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e87f67-8768-431a-8e66-89ec43fdfaa5 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515, portal: 172.16.0.220,3260]
Aug 26 23:38:58 user nova-compute[73497]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515, portal: 172.16.0.220,3260] successful.
Aug 26 23:38:58 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Received event <DeviceRemovedEvent: 1693093138.5396485, f1fa7599-72de-487d-9b0e-0adf8c0120ca => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73497) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b1a5890e-f3fe-4061-bd3f-9926c524a8a6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f1fa7599-72de-487d-9b0e-0adf8c0120ca {{(pid=73497) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 23:38:58 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-b1a5890e-f3fe-4061-bd3f-9926c524a8a6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Successfully detached device vdb from instance f1fa7599-72de-487d-9b0e-0adf8c0120ca from the live domain config.
Aug 26 23:38:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1a5890e-f3fe-4061-bd3f-9926c524a8a6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a5890e-f3fe-4061-bd3f-9926c524a8a6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dkxrWfmD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:38:58 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-b1a5890e-f3fe-4061-bd3f-9926c524a8a6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:38:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-b1a5890e-f3fe-4061-bd3f-9926c524a8a6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c09b37d5-7201-4a0f-9089-cc2793f7c515 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[219ef733-37e2-46d4-9e62-1bcdf2efb93d]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e87f67-8768-431a-8e66-89ec43fdfaa5 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-c8e87f67-8768-431a-8e66-89ec43fdfaa5 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e87f67-8768-431a-8e66-89ec43fdfaa5 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] <== disconnect_volume: return (333ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8e87f67-8768-431a-8e66-89ec43fdfaa5 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-b1a5890e-f3fe-4061-bd3f-9926c524a8a6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.009s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a5890e-f3fe-4061-bd3f-9926c524a8a6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[116c85a8-6493-4245-a920-13c5dce4cdbe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6b9c71-44da-4ebc-af88-399ac59c947f]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a5890e-f3fe-4061-bd3f-9926c524a8a6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)
Aug 26 23:38:58 user nova-compute[73497]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)
Aug 26 23:38:58 user nova-compute[73497]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a (non-flash)
Aug 26 23:38:58 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a5890e-f3fe-4061-bd3f-9926c524a8a6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 (non-flash)
Aug 26 23:38:58 user nova-compute[73497]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)
Aug 26 23:38:58 user nova-compute[73497]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a (non-flash)
Aug 26 23:38:58 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a5890e-f3fe-4061-bd3f-9926c524a8a6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281c56de10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5'): ({'sdc'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-b1a5890e-f3fe-4061-bd3f-9926c524a8a6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Removing single pathed devices sdc {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a0adde-9ac6-4277-b323-afcd16d2454e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd99e3f-7b3e-467d-8426-3929f375bb52]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-b1a5890e-f3fe-4061-bd3f-9926c524a8a6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Flushing IO for device /dev/sdc {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e17900-8f48-4e39-a6bd-ce2cb8422e27]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-b1a5890e-f3fe-4061-bd3f-9926c524a8a6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[24087dfc-e760-4101-bf6f-6c5c36ba28e5]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-b1a5890e-f3fe-4061-bd3f-9926c524a8a6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-b1a5890e-f3fe-4061-bd3f-9926c524a8a6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] SCSI volumes sdc have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a5890e-f3fe-4061-bd3f-9926c524a8a6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0ede7d-384a-46c6-b36a-819fc9c80994]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a5890e-f3fe-4061-bd3f-9926c524a8a6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba8a85f-aa71-4da3-809a-be9b98c16b41]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a5890e-f3fe-4061-bd3f-9926c524a8a6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5, portal: 172.16.0.220,3260]
Aug 26 23:38:58 user nova-compute[73497]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5, portal: 172.16.0.220,3260] successful.
Aug 26 23:38:58 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df2b0ba-df91-442b-bc03-1781ad1ee6f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece7bb12-803f-46c0-a52e-891cad40291a]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a5890e-f3fe-4061-bd3f-9926c524a8a6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-b1a5890e-f3fe-4061-bd3f-9926c524a8a6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a5890e-f3fe-4061-bd3f-9926c524a8a6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] <== disconnect_volume: return (311ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:38:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1a5890e-f3fe-4061-bd3f-9926c524a8a6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:38:59 user nova-compute[73497]: DEBUG nova.objects.instance [None req-c8e87f67-8768-431a-8e66-89ec43fdfaa5 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lazy-loading 'flavor' on Instance uuid 94425d3d-4703-434f-8a58-19a334b44d69 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:38:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c8e87f67-8768-431a-8e66-89ec43fdfaa5 tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "94425d3d-4703-434f-8a58-19a334b44d69" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.707s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:38:59 user nova-compute[73497]: DEBUG nova.objects.instance [None req-b1a5890e-f3fe-4061-bd3f-9926c524a8a6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lazy-loading 'flavor' on Instance uuid f1fa7599-72de-487d-9b0e-0adf8c0120ca {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:38:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b1a5890e-f3fe-4061-bd3f-9926c524a8a6 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.793s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:39:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-bfda6dc2-9aee-48df-a778-2adfc0e3c8aa tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "94425d3d-4703-434f-8a58-19a334b44d69" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:39:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-bfda6dc2-9aee-48df-a778-2adfc0e3c8aa tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "94425d3d-4703-434f-8a58-19a334b44d69" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:39:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-bfda6dc2-9aee-48df-a778-2adfc0e3c8aa tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "94425d3d-4703-434f-8a58-19a334b44d69-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:39:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-bfda6dc2-9aee-48df-a778-2adfc0e3c8aa tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "94425d3d-4703-434f-8a58-19a334b44d69-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:39:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-bfda6dc2-9aee-48df-a778-2adfc0e3c8aa tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "94425d3d-4703-434f-8a58-19a334b44d69-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:39:00 user nova-compute[73497]: INFO nova.compute.manager [None req-bfda6dc2-9aee-48df-a778-2adfc0e3c8aa tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Terminating instance
Aug 26 23:39:00 user nova-compute[73497]: DEBUG nova.compute.manager [None req-bfda6dc2-9aee-48df-a778-2adfc0e3c8aa tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:39:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:00 user nova-compute[73497]: DEBUG nova.compute.manager [req-9338df13-3305-4b95-b3f1-02b670090d12 req-43d631ab-bc3d-4f02-81e6-17324ce2d23f service nova] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Received event network-vif-unplugged-cbcbd7d5-cca7-4e29-bf12-e472b1730340 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:39:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9338df13-3305-4b95-b3f1-02b670090d12 req-43d631ab-bc3d-4f02-81e6-17324ce2d23f service nova] Acquiring lock "94425d3d-4703-434f-8a58-19a334b44d69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:39:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9338df13-3305-4b95-b3f1-02b670090d12 req-43d631ab-bc3d-4f02-81e6-17324ce2d23f service nova] Lock "94425d3d-4703-434f-8a58-19a334b44d69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:39:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9338df13-3305-4b95-b3f1-02b670090d12 req-43d631ab-bc3d-4f02-81e6-17324ce2d23f service nova] Lock "94425d3d-4703-434f-8a58-19a334b44d69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:39:00 user nova-compute[73497]: DEBUG nova.compute.manager [req-9338df13-3305-4b95-b3f1-02b670090d12 req-43d631ab-bc3d-4f02-81e6-17324ce2d23f service nova] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] No waiting events found dispatching network-vif-unplugged-cbcbd7d5-cca7-4e29-bf12-e472b1730340 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:39:00 user nova-compute[73497]: DEBUG nova.compute.manager [req-9338df13-3305-4b95-b3f1-02b670090d12 req-43d631ab-bc3d-4f02-81e6-17324ce2d23f service nova] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Received event network-vif-unplugged-cbcbd7d5-cca7-4e29-bf12-e472b1730340 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:39:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:01 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Instance destroyed successfully.
Aug 26 23:39:01 user nova-compute[73497]: DEBUG nova.objects.instance [None req-bfda6dc2-9aee-48df-a778-2adfc0e3c8aa tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lazy-loading 'resources' on Instance uuid 94425d3d-4703-434f-8a58-19a334b44d69 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:39:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-bfda6dc2-9aee-48df-a778-2adfc0e3c8aa tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:36:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-482333375',display_name='tempest-AttachVolumeTestJSON-server-482333375',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-482333375',id=42,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7js1I6AOeoJbMn1fKsKWTF8NDeLnfY1+8BDEUbhNcbAycSF0YDPQzJdXj2iWTcBPceKtMnptzdgQ8G5hDS9Tn89hww77OvBvIkPOfGE6dVydq19WOqLo0tSRsjfNgJ/Q==',key_name='tempest-keypair-672246647',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:36:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e10f2d1336284b42a8dcbb05e509e9bd',ramdisk_id='',reservation_id='r-3jcqkh96',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1929388969',owner_user_name='tempest-AttachVolumeTestJSON-1929388969-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:36:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e2c1f8d06854e579ee634e33e6de920',uuid=94425d3d-4703-434f-8a58-19a334b44d69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cbcbd7d5-cca7-4e29-bf12-e472b1730340", "address": "fa:16:3e:f0:47:cf", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbcbd7d5-cc", "ovs_interfaceid": "cbcbd7d5-cca7-4e29-bf12-e472b1730340", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:39:01 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-bfda6dc2-9aee-48df-a778-2adfc0e3c8aa tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Converting VIF {"id": "cbcbd7d5-cca7-4e29-bf12-e472b1730340", "address": "fa:16:3e:f0:47:cf", "network": {"id": "77d468df-32fe-45fb-afe7-7ebf9b6b428f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-389325427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f2d1336284b42a8dcbb05e509e9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbcbd7d5-cc", "ovs_interfaceid": "cbcbd7d5-cca7-4e29-bf12-e472b1730340", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:39:01 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-bfda6dc2-9aee-48df-a778-2adfc0e3c8aa tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:47:cf,bridge_name='br-int',has_traffic_filtering=True,id=cbcbd7d5-cca7-4e29-bf12-e472b1730340,network=Network(77d468df-32fe-45fb-afe7-7ebf9b6b428f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbcbd7d5-cc') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:39:01 user nova-compute[73497]: DEBUG os_vif [None req-bfda6dc2-9aee-48df-a778-2adfc0e3c8aa tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:47:cf,bridge_name='br-int',has_traffic_filtering=True,id=cbcbd7d5-cca7-4e29-bf12-e472b1730340,network=Network(77d468df-32fe-45fb-afe7-7ebf9b6b428f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbcbd7d5-cc') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:39:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcbcbd7d5-cc, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:39:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:39:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:01 user nova-compute[73497]: INFO os_vif [None req-bfda6dc2-9aee-48df-a778-2adfc0e3c8aa tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:47:cf,bridge_name='br-int',has_traffic_filtering=True,id=cbcbd7d5-cca7-4e29-bf12-e472b1730340,network=Network(77d468df-32fe-45fb-afe7-7ebf9b6b428f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbcbd7d5-cc')
Aug 26 23:39:01 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-bfda6dc2-9aee-48df-a778-2adfc0e3c8aa tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Deleting instance files /opt/stack/data/nova/instances/94425d3d-4703-434f-8a58-19a334b44d69_del
Aug 26 23:39:01 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-bfda6dc2-9aee-48df-a778-2adfc0e3c8aa tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Deletion of /opt/stack/data/nova/instances/94425d3d-4703-434f-8a58-19a334b44d69_del complete
Aug 26 23:39:01 user nova-compute[73497]: INFO nova.compute.manager [None req-bfda6dc2-9aee-48df-a778-2adfc0e3c8aa tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 26 23:39:01 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-bfda6dc2-9aee-48df-a778-2adfc0e3c8aa tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:39:01 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:39:01 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:39:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:02 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:39:02 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Took 1.42 seconds to deallocate network for instance.
Aug 26 23:39:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-bfda6dc2-9aee-48df-a778-2adfc0e3c8aa tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:39:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-bfda6dc2-9aee-48df-a778-2adfc0e3c8aa tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:39:02 user nova-compute[73497]: DEBUG nova.compute.manager [req-9912b482-7026-4712-b789-be6ed4ad8687 req-b315f0b0-af98-462c-8502-ca6678fa0c4a service nova] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Received event network-vif-plugged-cbcbd7d5-cca7-4e29-bf12-e472b1730340 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:39:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9912b482-7026-4712-b789-be6ed4ad8687 req-b315f0b0-af98-462c-8502-ca6678fa0c4a service nova] Acquiring lock "94425d3d-4703-434f-8a58-19a334b44d69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:39:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9912b482-7026-4712-b789-be6ed4ad8687 req-b315f0b0-af98-462c-8502-ca6678fa0c4a service nova] Lock "94425d3d-4703-434f-8a58-19a334b44d69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:39:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9912b482-7026-4712-b789-be6ed4ad8687 req-b315f0b0-af98-462c-8502-ca6678fa0c4a service nova] Lock "94425d3d-4703-434f-8a58-19a334b44d69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:39:02 user nova-compute[73497]: DEBUG nova.compute.manager [req-9912b482-7026-4712-b789-be6ed4ad8687 req-b315f0b0-af98-462c-8502-ca6678fa0c4a service nova] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] No waiting events found dispatching network-vif-plugged-cbcbd7d5-cca7-4e29-bf12-e472b1730340 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:39:02 user nova-compute[73497]: WARNING nova.compute.manager [req-9912b482-7026-4712-b789-be6ed4ad8687 req-b315f0b0-af98-462c-8502-ca6678fa0c4a service nova] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Received unexpected event network-vif-plugged-cbcbd7d5-cca7-4e29-bf12-e472b1730340 for instance with vm_state deleted and task_state None.
Aug 26 23:39:02 user nova-compute[73497]: DEBUG nova.compute.manager [req-9912b482-7026-4712-b789-be6ed4ad8687 req-b315f0b0-af98-462c-8502-ca6678fa0c4a service nova] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Received event network-vif-plugged-cbcbd7d5-cca7-4e29-bf12-e472b1730340 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:39:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9912b482-7026-4712-b789-be6ed4ad8687 req-b315f0b0-af98-462c-8502-ca6678fa0c4a service nova] Acquiring lock "94425d3d-4703-434f-8a58-19a334b44d69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:39:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9912b482-7026-4712-b789-be6ed4ad8687 req-b315f0b0-af98-462c-8502-ca6678fa0c4a service nova] Lock "94425d3d-4703-434f-8a58-19a334b44d69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:39:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9912b482-7026-4712-b789-be6ed4ad8687 req-b315f0b0-af98-462c-8502-ca6678fa0c4a service nova] Lock "94425d3d-4703-434f-8a58-19a334b44d69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:39:02 user nova-compute[73497]: DEBUG nova.compute.manager [req-9912b482-7026-4712-b789-be6ed4ad8687 req-b315f0b0-af98-462c-8502-ca6678fa0c4a service nova] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] No waiting events found dispatching network-vif-plugged-cbcbd7d5-cca7-4e29-bf12-e472b1730340 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:39:02 user nova-compute[73497]: WARNING nova.compute.manager [req-9912b482-7026-4712-b789-be6ed4ad8687 req-b315f0b0-af98-462c-8502-ca6678fa0c4a service nova] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Received unexpected event network-vif-plugged-cbcbd7d5-cca7-4e29-bf12-e472b1730340 for instance with vm_state deleted and task_state None.
Aug 26 23:39:02 user nova-compute[73497]: DEBUG nova.compute.manager [req-9912b482-7026-4712-b789-be6ed4ad8687 req-b315f0b0-af98-462c-8502-ca6678fa0c4a service nova] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Received event network-vif-plugged-cbcbd7d5-cca7-4e29-bf12-e472b1730340 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:39:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9912b482-7026-4712-b789-be6ed4ad8687 req-b315f0b0-af98-462c-8502-ca6678fa0c4a service nova] Acquiring lock "94425d3d-4703-434f-8a58-19a334b44d69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:39:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9912b482-7026-4712-b789-be6ed4ad8687 req-b315f0b0-af98-462c-8502-ca6678fa0c4a service nova] Lock "94425d3d-4703-434f-8a58-19a334b44d69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:39:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9912b482-7026-4712-b789-be6ed4ad8687 req-b315f0b0-af98-462c-8502-ca6678fa0c4a service nova] Lock "94425d3d-4703-434f-8a58-19a334b44d69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:39:02 user nova-compute[73497]: DEBUG nova.compute.manager [req-9912b482-7026-4712-b789-be6ed4ad8687 req-b315f0b0-af98-462c-8502-ca6678fa0c4a service nova] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] No waiting events found dispatching network-vif-plugged-cbcbd7d5-cca7-4e29-bf12-e472b1730340 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:39:02 user nova-compute[73497]: WARNING nova.compute.manager [req-9912b482-7026-4712-b789-be6ed4ad8687 req-b315f0b0-af98-462c-8502-ca6678fa0c4a service nova] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Received unexpected event network-vif-plugged-cbcbd7d5-cca7-4e29-bf12-e472b1730340 for instance with vm_state deleted and task_state None.
Aug 26 23:39:02 user nova-compute[73497]: DEBUG nova.compute.manager [req-9912b482-7026-4712-b789-be6ed4ad8687 req-b315f0b0-af98-462c-8502-ca6678fa0c4a service nova] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Received event network-vif-unplugged-cbcbd7d5-cca7-4e29-bf12-e472b1730340 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:39:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9912b482-7026-4712-b789-be6ed4ad8687 req-b315f0b0-af98-462c-8502-ca6678fa0c4a service nova] Acquiring lock "94425d3d-4703-434f-8a58-19a334b44d69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:39:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9912b482-7026-4712-b789-be6ed4ad8687 req-b315f0b0-af98-462c-8502-ca6678fa0c4a service nova] Lock "94425d3d-4703-434f-8a58-19a334b44d69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:39:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9912b482-7026-4712-b789-be6ed4ad8687 req-b315f0b0-af98-462c-8502-ca6678fa0c4a service nova] Lock "94425d3d-4703-434f-8a58-19a334b44d69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:39:02 user nova-compute[73497]: DEBUG nova.compute.manager [req-9912b482-7026-4712-b789-be6ed4ad8687 req-b315f0b0-af98-462c-8502-ca6678fa0c4a service nova] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] No waiting events found dispatching network-vif-unplugged-cbcbd7d5-cca7-4e29-bf12-e472b1730340 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:39:02 user nova-compute[73497]: WARNING nova.compute.manager [req-9912b482-7026-4712-b789-be6ed4ad8687 req-b315f0b0-af98-462c-8502-ca6678fa0c4a service nova] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Received unexpected event network-vif-unplugged-cbcbd7d5-cca7-4e29-bf12-e472b1730340 for instance with vm_state deleted and task_state None.
Aug 26 23:39:02 user nova-compute[73497]: DEBUG nova.compute.manager [req-9912b482-7026-4712-b789-be6ed4ad8687 req-b315f0b0-af98-462c-8502-ca6678fa0c4a service nova] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Received event network-vif-plugged-cbcbd7d5-cca7-4e29-bf12-e472b1730340 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:39:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9912b482-7026-4712-b789-be6ed4ad8687 req-b315f0b0-af98-462c-8502-ca6678fa0c4a service nova] Acquiring lock "94425d3d-4703-434f-8a58-19a334b44d69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:39:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9912b482-7026-4712-b789-be6ed4ad8687 req-b315f0b0-af98-462c-8502-ca6678fa0c4a service nova] Lock "94425d3d-4703-434f-8a58-19a334b44d69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:39:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9912b482-7026-4712-b789-be6ed4ad8687 req-b315f0b0-af98-462c-8502-ca6678fa0c4a service nova] Lock "94425d3d-4703-434f-8a58-19a334b44d69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:39:02 user nova-compute[73497]: DEBUG nova.compute.manager [req-9912b482-7026-4712-b789-be6ed4ad8687 req-b315f0b0-af98-462c-8502-ca6678fa0c4a service nova] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] No waiting events found dispatching network-vif-plugged-cbcbd7d5-cca7-4e29-bf12-e472b1730340 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:39:02 user nova-compute[73497]: WARNING nova.compute.manager [req-9912b482-7026-4712-b789-be6ed4ad8687 req-b315f0b0-af98-462c-8502-ca6678fa0c4a service nova] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Received unexpected event network-vif-plugged-cbcbd7d5-cca7-4e29-bf12-e472b1730340 for instance with vm_state deleted and task_state None.
Aug 26 23:39:02 user nova-compute[73497]: DEBUG nova.compute.manager [req-9912b482-7026-4712-b789-be6ed4ad8687 req-b315f0b0-af98-462c-8502-ca6678fa0c4a service nova] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Received event network-vif-deleted-cbcbd7d5-cca7-4e29-bf12-e472b1730340 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:39:02 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-bfda6dc2-9aee-48df-a778-2adfc0e3c8aa tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:39:02 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-bfda6dc2-9aee-48df-a778-2adfc0e3c8aa tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:39:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-bfda6dc2-9aee-48df-a778-2adfc0e3c8aa tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:39:03 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-bfda6dc2-9aee-48df-a778-2adfc0e3c8aa tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Deleted allocations for instance 94425d3d-4703-434f-8a58-19a334b44d69
Aug 26 23:39:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-bfda6dc2-9aee-48df-a778-2adfc0e3c8aa tempest-AttachVolumeTestJSON-1929388969 tempest-AttachVolumeTestJSON-1929388969-project-member] Lock "94425d3d-4703-434f-8a58-19a334b44d69" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.749s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:39:03 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:39:03 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:39:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:06 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:39:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:39:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:39:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:39:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:39:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:39:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:39:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:39:06 user nova-compute[73497]: DEBUG nova.compute.manager [req-c107e0f7-dcdc-4df0-bece-4cb1200fce4b req-b6e92fbc-d8f8-4d90-9c50-cdc59d658571 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Received event network-changed-8ec486c2-3507-4e88-8c66-d3db44578a1b {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:39:06 user nova-compute[73497]: DEBUG nova.compute.manager [req-c107e0f7-dcdc-4df0-bece-4cb1200fce4b req-b6e92fbc-d8f8-4d90-9c50-cdc59d658571 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Refreshing instance network info cache due to event network-changed-8ec486c2-3507-4e88-8c66-d3db44578a1b. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:39:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c107e0f7-dcdc-4df0-bece-4cb1200fce4b req-b6e92fbc-d8f8-4d90-9c50-cdc59d658571 service nova] Acquiring lock "refresh_cache-71518c06-a7d0-49fa-88de-ffb4af927f47" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:39:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c107e0f7-dcdc-4df0-bece-4cb1200fce4b req-b6e92fbc-d8f8-4d90-9c50-cdc59d658571 service nova] Acquired lock "refresh_cache-71518c06-a7d0-49fa-88de-ffb4af927f47" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:39:06 user nova-compute[73497]: DEBUG nova.network.neutron [req-c107e0f7-dcdc-4df0-bece-4cb1200fce4b req-b6e92fbc-d8f8-4d90-9c50-cdc59d658571 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Refreshing network info cache for port 8ec486c2-3507-4e88-8c66-d3db44578a1b {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:39:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:39:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:39:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:39:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1fa7599-72de-487d-9b0e-0adf8c0120ca/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:39:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1fa7599-72de-487d-9b0e-0adf8c0120ca/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:39:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1fa7599-72de-487d-9b0e-0adf8c0120ca/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:39:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1fa7599-72de-487d-9b0e-0adf8c0120ca/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:39:07 user nova-compute[73497]: DEBUG nova.network.neutron [req-c107e0f7-dcdc-4df0-bece-4cb1200fce4b req-b6e92fbc-d8f8-4d90-9c50-cdc59d658571 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Updated VIF entry in instance network info cache for port 8ec486c2-3507-4e88-8c66-d3db44578a1b. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:39:07 user nova-compute[73497]: DEBUG nova.network.neutron [req-c107e0f7-dcdc-4df0-bece-4cb1200fce4b req-b6e92fbc-d8f8-4d90-9c50-cdc59d658571 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Updating instance_info_cache with network_info: [{"id": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "address": "fa:16:3e:ad:51:e7", "network": {"id": "1b5f252b-ef13-47fa-a49c-53f70d79ae43", "bridge": "br-int", "label": "tempest-TestShelveInstance-125614022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "216a6e017cd94bbe96525e413d893e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ec486c2-35", "ovs_interfaceid": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:39:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:07 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:39:07 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:39:07 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8274MB free_disk=25.096988677978516GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:39:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:39:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:39:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c107e0f7-dcdc-4df0-bece-4cb1200fce4b req-b6e92fbc-d8f8-4d90-9c50-cdc59d658571 service nova] Releasing lock "refresh_cache-71518c06-a7d0-49fa-88de-ffb4af927f47" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:39:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Acquiring lock "71518c06-a7d0-49fa-88de-ffb4af927f47" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:39:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lock "71518c06-a7d0-49fa-88de-ffb4af927f47" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:39:07 user nova-compute[73497]: INFO nova.compute.manager [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Shelve offloading
Aug 26 23:39:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:07 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance f1fa7599-72de-487d-9b0e-0adf8c0120ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:39:07 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 71518c06-a7d0-49fa-88de-ffb4af927f47 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:39:08 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance db489468-154b-4238-8b81-f8fa2bc016b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:39:08 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:39:08 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:39:08 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:39:08 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:39:08 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:39:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.456s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:39:08 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:08 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:08 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Instance destroyed successfully.
Aug 26 23:39:08 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:39:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Acquiring lock "refresh_cache-71518c06-a7d0-49fa-88de-ffb4af927f47" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:39:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Acquired lock "refresh_cache-71518c06-a7d0-49fa-88de-ffb4af927f47" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:39:08 user nova-compute[73497]: DEBUG nova.network.neutron [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:39:08 user nova-compute[73497]: DEBUG nova.compute.manager [req-abae8102-273c-431b-aa63-f1e202bb1cf8 req-bc77614e-79b8-4080-bf44-929667a66a13 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Received event network-vif-unplugged-8ec486c2-3507-4e88-8c66-d3db44578a1b {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:39:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-abae8102-273c-431b-aa63-f1e202bb1cf8 req-bc77614e-79b8-4080-bf44-929667a66a13 service nova] Acquiring lock "71518c06-a7d0-49fa-88de-ffb4af927f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:39:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-abae8102-273c-431b-aa63-f1e202bb1cf8 req-bc77614e-79b8-4080-bf44-929667a66a13 service nova] Lock "71518c06-a7d0-49fa-88de-ffb4af927f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:39:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-abae8102-273c-431b-aa63-f1e202bb1cf8 req-bc77614e-79b8-4080-bf44-929667a66a13 service nova] Lock "71518c06-a7d0-49fa-88de-ffb4af927f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:39:08 user nova-compute[73497]: DEBUG nova.compute.manager [req-abae8102-273c-431b-aa63-f1e202bb1cf8 req-bc77614e-79b8-4080-bf44-929667a66a13 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] No waiting events found dispatching network-vif-unplugged-8ec486c2-3507-4e88-8c66-d3db44578a1b {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:39:08 user nova-compute[73497]: WARNING nova.compute.manager [req-abae8102-273c-431b-aa63-f1e202bb1cf8 req-bc77614e-79b8-4080-bf44-929667a66a13 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Received unexpected event network-vif-unplugged-8ec486c2-3507-4e88-8c66-d3db44578a1b for instance with vm_state active and task_state shelving.
Aug 26 23:39:08 user nova-compute[73497]: DEBUG nova.compute.manager [req-abae8102-273c-431b-aa63-f1e202bb1cf8 req-bc77614e-79b8-4080-bf44-929667a66a13 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Received event network-vif-plugged-8ec486c2-3507-4e88-8c66-d3db44578a1b {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:39:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-abae8102-273c-431b-aa63-f1e202bb1cf8 req-bc77614e-79b8-4080-bf44-929667a66a13 service nova] Acquiring lock "71518c06-a7d0-49fa-88de-ffb4af927f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:39:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-abae8102-273c-431b-aa63-f1e202bb1cf8 req-bc77614e-79b8-4080-bf44-929667a66a13 service nova] Lock "71518c06-a7d0-49fa-88de-ffb4af927f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:39:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-abae8102-273c-431b-aa63-f1e202bb1cf8 req-bc77614e-79b8-4080-bf44-929667a66a13 service nova] Lock "71518c06-a7d0-49fa-88de-ffb4af927f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:39:08 user nova-compute[73497]: DEBUG nova.compute.manager [req-abae8102-273c-431b-aa63-f1e202bb1cf8 req-bc77614e-79b8-4080-bf44-929667a66a13 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] No waiting events found dispatching network-vif-plugged-8ec486c2-3507-4e88-8c66-d3db44578a1b {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:39:08 user nova-compute[73497]: WARNING nova.compute.manager [req-abae8102-273c-431b-aa63-f1e202bb1cf8 req-bc77614e-79b8-4080-bf44-929667a66a13 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Received unexpected event network-vif-plugged-8ec486c2-3507-4e88-8c66-d3db44578a1b for instance with vm_state active and task_state shelving.
Aug 26 23:39:09 user nova-compute[73497]: DEBUG nova.network.neutron [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Updating instance_info_cache with network_info: [{"id": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "address": "fa:16:3e:ad:51:e7", "network": {"id": "1b5f252b-ef13-47fa-a49c-53f70d79ae43", "bridge": "br-int", "label": "tempest-TestShelveInstance-125614022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "216a6e017cd94bbe96525e413d893e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ec486c2-35", "ovs_interfaceid": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:39:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Releasing lock "refresh_cache-71518c06-a7d0-49fa-88de-ffb4af927f47" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:39:09 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:39:09 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Instance destroyed successfully.
Aug 26 23:39:09 user nova-compute[73497]: DEBUG nova.objects.instance [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lazy-loading 'resources' on Instance uuid 71518c06-a7d0-49fa-88de-ffb4af927f47 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:39:09 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1647360321',display_name='tempest-TestShelveInstance-server-1647360321',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1647360321',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxVoZl80WnvJYJlh+Emiq/FYRseABF+tnMH8/Nu6Tqd4TApwZ93uyb7meNhcldg7PthrIWqUW5HCXIe2CsTMsK6rSEmc5nqb7FAhWyDW0d7V7k8W7nfvRp0gAfaO0CY5A==',key_name='tempest-TestShelveInstance-1023296182',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:37:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='216a6e017cd94bbe96525e413d893e6d',ramdisk_id='',reservation_id='r-a97hsfck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2032732603',owner_user_name='tempest-TestShelveInstance-2032732603-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:37:34Z,user_data=None,user_id='77ec603ab2da4a3584b0e4b0bcf2984b',uuid=71518c06-a7d0-49fa-88de-ffb4af927f47,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "address": "fa:16:3e:ad:51:e7", "network": {"id": "1b5f252b-ef13-47fa-a49c-53f70d79ae43", "bridge": "br-int", "label": "tempest-TestShelveInstance-125614022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "216a6e017cd94bbe96525e413d893e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ec486c2-35", "ovs_interfaceid": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:39:09 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Converting VIF {"id": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "address": "fa:16:3e:ad:51:e7", "network": {"id": "1b5f252b-ef13-47fa-a49c-53f70d79ae43", "bridge": "br-int", "label": "tempest-TestShelveInstance-125614022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "216a6e017cd94bbe96525e413d893e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ec486c2-35", "ovs_interfaceid": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:39:09 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:51:e7,bridge_name='br-int',has_traffic_filtering=True,id=8ec486c2-3507-4e88-8c66-d3db44578a1b,network=Network(1b5f252b-ef13-47fa-a49c-53f70d79ae43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ec486c2-35') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:39:09 user nova-compute[73497]: DEBUG os_vif [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:51:e7,bridge_name='br-int',has_traffic_filtering=True,id=8ec486c2-3507-4e88-8c66-d3db44578a1b,network=Network(1b5f252b-ef13-47fa-a49c-53f70d79ae43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ec486c2-35') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:39:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ec486c2-35, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:39:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:39:09 user nova-compute[73497]: INFO os_vif [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:51:e7,bridge_name='br-int',has_traffic_filtering=True,id=8ec486c2-3507-4e88-8c66-d3db44578a1b,network=Network(1b5f252b-ef13-47fa-a49c-53f70d79ae43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ec486c2-35')
Aug 26 23:39:09 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:39:09 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnJQIZbW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:39:09 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:39:09 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:39:09 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:39:09 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:39:09 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:39:09 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:39:09 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d077946-56a3-4dce-867f-bd98ffe6fd22]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:39:09 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:39:09 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:39:09 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[689e006b-aed9-446d-97ed-b49061b8a827]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:39:09 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)
Aug 26 23:39:09 user nova-compute[73497]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a (non-flash)
Aug 26 23:39:09 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:39:09 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)
Aug 26 23:39:09 user nova-compute[73497]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a (non-flash)
Aug 26 23:39:09 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:39:09 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2839aa9990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7'): ({'sdb'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:39:09 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Removing single pathed devices sdb {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:39:09 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:39:09 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:39:09 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1513b87-85c5-45ad-a89a-b30995b68b85]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:39:09 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:39:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:39:10 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e70ebb-8ed2-4c77-bec7-75e1c9744b4c]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:39:10 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Flushing IO for device /dev/sdb {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:39:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:39:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:39:10 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[136071cc-1301-465b-b59d-f4454dd98b4f]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:39:10 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:39:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:39:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:39:10 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f318f7-3663-43ae-a9ec-c44bf8efccd5]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:39:10 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:39:10 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:39:10 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:39:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:39:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:39:10 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7025cb6e-71c5-44af-861b-60a6ac51b136]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:39:10 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:39:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:39:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:39:10 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f22efb4-d5f9-438e-a7f4-2b466ebfb839]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:39:10 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7, portal: 172.16.0.220,3260]
Aug 26 23:39:10 user nova-compute[73497]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7, portal: 172.16.0.220,3260] successful.
Aug 26 23:39:10 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:39:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:39:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:39:10 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d89cde-7caa-46c4-b4ce-c493fb39e063]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:39:10 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:39:10 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:39:10 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] <== disconnect_volume: return (283ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:39:10 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:39:10 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Deleting instance files /opt/stack/data/nova/instances/71518c06-a7d0-49fa-88de-ffb4af927f47_del
Aug 26 23:39:10 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Deletion of /opt/stack/data/nova/instances/71518c06-a7d0-49fa-88de-ffb4af927f47_del complete
Aug 26 23:39:10 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:39:11 user nova-compute[73497]: DEBUG nova.compute.manager [req-dadeb813-3a75-49a6-bb40-3c87077046b7 req-624a5599-dca3-4410-b065-7214d0468022 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Received event network-changed-8ec486c2-3507-4e88-8c66-d3db44578a1b {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:39:11 user nova-compute[73497]: DEBUG nova.compute.manager [req-dadeb813-3a75-49a6-bb40-3c87077046b7 req-624a5599-dca3-4410-b065-7214d0468022 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Refreshing instance network info cache due to event network-changed-8ec486c2-3507-4e88-8c66-d3db44578a1b. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:39:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-dadeb813-3a75-49a6-bb40-3c87077046b7 req-624a5599-dca3-4410-b065-7214d0468022 service nova] Acquiring lock "refresh_cache-71518c06-a7d0-49fa-88de-ffb4af927f47" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:39:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-dadeb813-3a75-49a6-bb40-3c87077046b7 req-624a5599-dca3-4410-b065-7214d0468022 service nova] Acquired lock "refresh_cache-71518c06-a7d0-49fa-88de-ffb4af927f47" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:39:11 user nova-compute[73497]: DEBUG nova.network.neutron [req-dadeb813-3a75-49a6-bb40-3c87077046b7 req-624a5599-dca3-4410-b065-7214d0468022 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Refreshing network info cache for port 8ec486c2-3507-4e88-8c66-d3db44578a1b {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:39:11 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Deleted allocations for instance 71518c06-a7d0-49fa-88de-ffb4af927f47
Aug 26 23:39:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:39:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:39:11 user nova-compute[73497]: DEBUG nova.objects.instance [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lazy-loading 'numa_topology' on Instance uuid 71518c06-a7d0-49fa-88de-ffb4af927f47 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:39:11 user nova-compute[73497]: DEBUG nova.objects.base [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Object Instance<71518c06-a7d0-49fa-88de-ffb4af927f47> lazy-loaded attributes: resources,numa_topology {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:39:11 user nova-compute[73497]: DEBUG nova.network.neutron [req-dadeb813-3a75-49a6-bb40-3c87077046b7 req-624a5599-dca3-4410-b065-7214d0468022 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Updated VIF entry in instance network info cache for port 8ec486c2-3507-4e88-8c66-d3db44578a1b. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:39:11 user nova-compute[73497]: DEBUG nova.network.neutron [req-dadeb813-3a75-49a6-bb40-3c87077046b7 req-624a5599-dca3-4410-b065-7214d0468022 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Updating instance_info_cache with network_info: [{"id": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "address": "fa:16:3e:ad:51:e7", "network": {"id": "1b5f252b-ef13-47fa-a49c-53f70d79ae43", "bridge": null, "label": "tempest-TestShelveInstance-125614022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "216a6e017cd94bbe96525e413d893e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8ec486c2-35", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:39:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-dadeb813-3a75-49a6-bb40-3c87077046b7 req-624a5599-dca3-4410-b065-7214d0468022 service nova] Releasing lock "refresh_cache-71518c06-a7d0-49fa-88de-ffb4af927f47" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:39:11 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:39:11 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:39:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:39:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-637fbf0c-0cde-4099-8f65-96c3aec2d133 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lock "71518c06-a7d0-49fa-88de-ffb4af927f47" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.877s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:39:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:13 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:39:14 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:39:14 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:39:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9613b416-d0c9-4a5a-bbbd-fe0b47266235 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "db489468-154b-4238-8b81-f8fa2bc016b7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:39:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9613b416-d0c9-4a5a-bbbd-fe0b47266235 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "db489468-154b-4238-8b81-f8fa2bc016b7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:39:14 user nova-compute[73497]: INFO nova.compute.manager [None req-9613b416-d0c9-4a5a-bbbd-fe0b47266235 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Detaching volume 33321b8c-a031-4f7a-807f-4f10f54d086a
Aug 26 23:39:14 user nova-compute[73497]: INFO nova.virt.block_device [None req-9613b416-d0c9-4a5a-bbbd-fe0b47266235 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Attempting to driver detach volume 33321b8c-a031-4f7a-807f-4f10f54d086a from mountpoint /dev/vdc
Aug 26 23:39:14 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9613b416-d0c9-4a5a-bbbd-fe0b47266235 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Attempting to detach device vdc from instance db489468-154b-4238-8b81-f8fa2bc016b7 from the persistent domain config. {{(pid=73497) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 23:39:14 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-9613b416-d0c9-4a5a-bbbd-fe0b47266235 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:39:14 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:39:14 user nova-compute[73497]:   <source dev="/dev/sdd"/>
Aug 26 23:39:14 user nova-compute[73497]:   <target dev="vdc" bus="virtio"/>
Aug 26 23:39:14 user nova-compute[73497]:   <serial>33321b8c-a031-4f7a-807f-4f10f54d086a</serial>
Aug 26 23:39:14 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 23:39:14 user nova-compute[73497]: </disk>
Aug 26 23:39:14 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:39:14 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-9613b416-d0c9-4a5a-bbbd-fe0b47266235 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Successfully detached device vdc from instance db489468-154b-4238-8b81-f8fa2bc016b7 from the persistent domain config.
Aug 26 23:39:14 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9613b416-d0c9-4a5a-bbbd-fe0b47266235 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance db489468-154b-4238-8b81-f8fa2bc016b7 from the live domain config. {{(pid=73497) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 23:39:14 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-9613b416-d0c9-4a5a-bbbd-fe0b47266235 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:39:14 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:39:14 user nova-compute[73497]:   <source dev="/dev/sdd"/>
Aug 26 23:39:14 user nova-compute[73497]:   <target dev="vdc" bus="virtio"/>
Aug 26 23:39:14 user nova-compute[73497]:   <serial>33321b8c-a031-4f7a-807f-4f10f54d086a</serial>
Aug 26 23:39:14 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 23:39:14 user nova-compute[73497]: </disk>
Aug 26 23:39:14 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:39:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Received event <DeviceRemovedEvent: 1693093155.2325606, db489468-154b-4238-8b81-f8fa2bc016b7 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73497) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9613b416-d0c9-4a5a-bbbd-fe0b47266235 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance db489468-154b-4238-8b81-f8fa2bc016b7 {{(pid=73497) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 23:39:15 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-9613b416-d0c9-4a5a-bbbd-fe0b47266235 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Successfully detached device vdc from instance db489468-154b-4238-8b81-f8fa2bc016b7 from the live domain config.
Aug 26 23:39:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9613b416-d0c9-4a5a-bbbd-fe0b47266235 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9613b416-d0c9-4a5a-bbbd-fe0b47266235 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SdolFTgZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:39:15 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-9613b416-d0c9-4a5a-bbbd-fe0b47266235 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:39:15 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-9613b416-d0c9-4a5a-bbbd-fe0b47266235 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-9613b416-d0c9-4a5a-bbbd-fe0b47266235 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9613b416-d0c9-4a5a-bbbd-fe0b47266235 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb721d4-0c62-43f1-beda-9265331cce4f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[691a5943-2dcf-47dc-8f77-24818c193453]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9613b416-d0c9-4a5a-bbbd-fe0b47266235 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a (non-flash)
Aug 26 23:39:15 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9613b416-d0c9-4a5a-bbbd-fe0b47266235 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a (non-flash)
Aug 26 23:39:15 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9613b416-d0c9-4a5a-bbbd-fe0b47266235 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281c382290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a'): ({'sdd'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-9613b416-d0c9-4a5a-bbbd-fe0b47266235 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Removing single pathed devices sdd {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1801efc3-5fb8-4f15-8754-0e5adab89ea5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[818c52f3-948f-42fc-a663-b15d77019baf]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-9613b416-d0c9-4a5a-bbbd-fe0b47266235 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Flushing IO for device /dev/sdd {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[592a0857-4239-4d17-9d4e-ca777f716d42]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-9613b416-d0c9-4a5a-bbbd-fe0b47266235 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bb3c96-91fb-43e6-8635-f639ca706be5]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-9613b416-d0c9-4a5a-bbbd-fe0b47266235 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-9613b416-d0c9-4a5a-bbbd-fe0b47266235 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] SCSI volumes sdd have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9613b416-d0c9-4a5a-bbbd-fe0b47266235 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[df651638-fb6f-4505-8062-eb7aa7a31e1a]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9613b416-d0c9-4a5a-bbbd-fe0b47266235 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8e4ced-e374-4660-8834-89a5c3b242ae]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9613b416-d0c9-4a5a-bbbd-fe0b47266235 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a, portal: 172.16.0.220,3260]
Aug 26 23:39:15 user nova-compute[73497]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a, portal: 172.16.0.220,3260] successful.
Aug 26 23:39:15 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33321b8c-a031-4f7a-807f-4f10f54d086a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3982ebc6-29f7-4ab8-866c-c19c21d0058b]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9613b416-d0c9-4a5a-bbbd-fe0b47266235 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-9613b416-d0c9-4a5a-bbbd-fe0b47266235 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.255s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9613b416-d0c9-4a5a-bbbd-fe0b47266235 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] <== disconnect_volume: return (256ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:39:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9613b416-d0c9-4a5a-bbbd-fe0b47266235 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:39:16 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693093141.1586602, 94425d3d-4703-434f-8a58-19a334b44d69 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:39:16 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] VM Stopped (Lifecycle Event)
Aug 26 23:39:16 user nova-compute[73497]: DEBUG nova.compute.manager [None req-17f18561-c5a7-4ee1-866e-2a3673743d14 None None] [instance: 94425d3d-4703-434f-8a58-19a334b44d69] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:39:16 user nova-compute[73497]: DEBUG nova.objects.instance [None req-9613b416-d0c9-4a5a-bbbd-fe0b47266235 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lazy-loading 'flavor' on Instance uuid db489468-154b-4238-8b81-f8fa2bc016b7 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:39:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9613b416-d0c9-4a5a-bbbd-fe0b47266235 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "db489468-154b-4238-8b81-f8fa2bc016b7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.628s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:39:17 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:39:17 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Cleaning up deleted instances {{(pid=73497) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 23:39:17 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] There are 0 instances to clean {{(pid=73497) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 23:39:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:18 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:39:18 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:39:18 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Rebuilding the list of instances to heal {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 23:39:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-f1fa7599-72de-487d-9b0e-0adf8c0120ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:39:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-f1fa7599-72de-487d-9b0e-0adf8c0120ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:39:18 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:39:18 user nova-compute[73497]: DEBUG nova.objects.instance [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lazy-loading 'info_cache' on Instance uuid f1fa7599-72de-487d-9b0e-0adf8c0120ca {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:39:18 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Updating instance_info_cache with network_info: [{"id": "4f594b38-986f-42c8-bb69-4caeabfe1b56", "address": "fa:16:3e:f0:fe:b5", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f594b38-98", "ovs_interfaceid": "4f594b38-986f-42c8-bb69-4caeabfe1b56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:39:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-f1fa7599-72de-487d-9b0e-0adf8c0120ca" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:39:18 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:39:19 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:39:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:20 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:39:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:23 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693093148.5240479, 71518c06-a7d0-49fa-88de-ffb4af927f47 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:39:23 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] VM Stopped (Lifecycle Event)
Aug 26 23:39:23 user nova-compute[73497]: DEBUG nova.compute.manager [None req-f3f88b6e-7e19-4590-b5a8-da9daa3c9a47 None None] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:39:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:25 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:39:25 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Cleaning up deleted instances with incomplete migration  {{(pid=73497) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 23:39:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:39:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:39:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:39:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:39:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:39:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:39:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:39:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:39:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:49 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_power_states {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:39:49 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Triggering sync for uuid f1fa7599-72de-487d-9b0e-0adf8c0120ca {{(pid=73497) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 23:39:49 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Triggering sync for uuid db489468-154b-4238-8b81-f8fa2bc016b7 {{(pid=73497) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 23:39:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:39:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:39:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "db489468-154b-4238-8b81-f8fa2bc016b7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:39:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "db489468-154b-4238-8b81-f8fa2bc016b7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:39:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:39:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "db489468-154b-4238-8b81-f8fa2bc016b7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:39:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:39:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:39:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:39:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:39:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:39:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:39:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:39:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:39:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:39:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:39:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:40:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-59b8ecd5-1531-4606-92be-27f4d7e1ac53 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:40:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-59b8ecd5-1531-4606-92be-27f4d7e1ac53 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:40:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-59b8ecd5-1531-4606-92be-27f4d7e1ac53 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:40:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-59b8ecd5-1531-4606-92be-27f4d7e1ac53 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:40:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-59b8ecd5-1531-4606-92be-27f4d7e1ac53 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:40:01 user nova-compute[73497]: INFO nova.compute.manager [None req-59b8ecd5-1531-4606-92be-27f4d7e1ac53 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Terminating instance
Aug 26 23:40:01 user nova-compute[73497]: DEBUG nova.compute.manager [None req-59b8ecd5-1531-4606-92be-27f4d7e1ac53 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:40:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:40:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:40:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:40:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:40:01 user nova-compute[73497]: DEBUG nova.compute.manager [req-8994c75b-50ea-44a6-9a3c-1a57824b607e req-c07453c1-f30e-4015-846b-7a48d7502021 service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Received event network-vif-unplugged-4f594b38-986f-42c8-bb69-4caeabfe1b56 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:40:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8994c75b-50ea-44a6-9a3c-1a57824b607e req-c07453c1-f30e-4015-846b-7a48d7502021 service nova] Acquiring lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:40:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8994c75b-50ea-44a6-9a3c-1a57824b607e req-c07453c1-f30e-4015-846b-7a48d7502021 service nova] Lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:40:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8994c75b-50ea-44a6-9a3c-1a57824b607e req-c07453c1-f30e-4015-846b-7a48d7502021 service nova] Lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:40:01 user nova-compute[73497]: DEBUG nova.compute.manager [req-8994c75b-50ea-44a6-9a3c-1a57824b607e req-c07453c1-f30e-4015-846b-7a48d7502021 service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] No waiting events found dispatching network-vif-unplugged-4f594b38-986f-42c8-bb69-4caeabfe1b56 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:40:01 user nova-compute[73497]: DEBUG nova.compute.manager [req-8994c75b-50ea-44a6-9a3c-1a57824b607e req-c07453c1-f30e-4015-846b-7a48d7502021 service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Received event network-vif-unplugged-4f594b38-986f-42c8-bb69-4caeabfe1b56 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:40:01 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Instance destroyed successfully.
Aug 26 23:40:01 user nova-compute[73497]: DEBUG nova.objects.instance [None req-59b8ecd5-1531-4606-92be-27f4d7e1ac53 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lazy-loading 'resources' on Instance uuid f1fa7599-72de-487d-9b0e-0adf8c0120ca {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:40:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-59b8ecd5-1531-4606-92be-27f4d7e1ac53 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:34:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-549290483',display_name='tempest-TestMinimumBasicScenario-server-549290483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-549290483',id=41,image_ref='3fe91fd7-2b21-49d2-861d-888133645deb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFp0321fyFq5IIm16kujwtj0S2cVboytsRtGtxrq/1GtohTpLpvFdJjWsEqvcpe7am9mD7J7VLkWOe7vbZg3rj/Crv7hqi590DhxlWKDIwRe+6CMVAXZHeg50oax6vALiA==',key_name='tempest-TestMinimumBasicScenario-1558020918',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:34:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ae441ca35d847e89eb99397fe167960',ramdisk_id='',reservation_id='r-08yvfvzy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3fe91fd7-2b21-49d2-861d-888133645deb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1836970755',owner_user_name='tempest-TestMinimumBasicScenario-1836970755-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:37:12Z,user_data=None,user_id='948c44e55c7c404fb660394a747cf162',uuid=f1fa7599-72de-487d-9b0e-0adf8c0120ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f594b38-986f-42c8-bb69-4caeabfe1b56", "address": "fa:16:3e:f0:fe:b5", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f594b38-98", "ovs_interfaceid": "4f594b38-986f-42c8-bb69-4caeabfe1b56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:40:01 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-59b8ecd5-1531-4606-92be-27f4d7e1ac53 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Converting VIF {"id": "4f594b38-986f-42c8-bb69-4caeabfe1b56", "address": "fa:16:3e:f0:fe:b5", "network": {"id": "f11c42be-cba6-4e59-80b1-6fdd90a41c47", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1275637488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae441ca35d847e89eb99397fe167960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f594b38-98", "ovs_interfaceid": "4f594b38-986f-42c8-bb69-4caeabfe1b56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:40:01 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-59b8ecd5-1531-4606-92be-27f4d7e1ac53 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:fe:b5,bridge_name='br-int',has_traffic_filtering=True,id=4f594b38-986f-42c8-bb69-4caeabfe1b56,network=Network(f11c42be-cba6-4e59-80b1-6fdd90a41c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f594b38-98') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:40:01 user nova-compute[73497]: DEBUG os_vif [None req-59b8ecd5-1531-4606-92be-27f4d7e1ac53 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:fe:b5,bridge_name='br-int',has_traffic_filtering=True,id=4f594b38-986f-42c8-bb69-4caeabfe1b56,network=Network(f11c42be-cba6-4e59-80b1-6fdd90a41c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f594b38-98') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:40:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:40:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f594b38-98, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:40:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:40:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:40:01 user nova-compute[73497]: INFO os_vif [None req-59b8ecd5-1531-4606-92be-27f4d7e1ac53 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:fe:b5,bridge_name='br-int',has_traffic_filtering=True,id=4f594b38-986f-42c8-bb69-4caeabfe1b56,network=Network(f11c42be-cba6-4e59-80b1-6fdd90a41c47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f594b38-98')
Aug 26 23:40:01 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-59b8ecd5-1531-4606-92be-27f4d7e1ac53 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Deleting instance files /opt/stack/data/nova/instances/f1fa7599-72de-487d-9b0e-0adf8c0120ca_del
Aug 26 23:40:01 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-59b8ecd5-1531-4606-92be-27f4d7e1ac53 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Deletion of /opt/stack/data/nova/instances/f1fa7599-72de-487d-9b0e-0adf8c0120ca_del complete
Aug 26 23:40:01 user nova-compute[73497]: INFO nova.compute.manager [None req-59b8ecd5-1531-4606-92be-27f4d7e1ac53 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Took 0.83 seconds to destroy the instance on the hypervisor.
Aug 26 23:40:01 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-59b8ecd5-1531-4606-92be-27f4d7e1ac53 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:40:01 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:40:01 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:40:02 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:40:02 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Took 0.56 seconds to deallocate network for instance.
Aug 26 23:40:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-59b8ecd5-1531-4606-92be-27f4d7e1ac53 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:40:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-59b8ecd5-1531-4606-92be-27f4d7e1ac53 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:40:02 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-59b8ecd5-1531-4606-92be-27f4d7e1ac53 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:40:02 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-59b8ecd5-1531-4606-92be-27f4d7e1ac53 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:40:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-59b8ecd5-1531-4606-92be-27f4d7e1ac53 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:40:02 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-59b8ecd5-1531-4606-92be-27f4d7e1ac53 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Deleted allocations for instance f1fa7599-72de-487d-9b0e-0adf8c0120ca
Aug 26 23:40:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-59b8ecd5-1531-4606-92be-27f4d7e1ac53 tempest-TestMinimumBasicScenario-1836970755 tempest-TestMinimumBasicScenario-1836970755-project-member] Lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.715s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:40:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-1fba940d-356e-4703-808d-f3884306d772 req-8ad79b4f-c74c-4460-92ab-1ea71239017f service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Received event network-vif-plugged-4f594b38-986f-42c8-bb69-4caeabfe1b56 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:40:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1fba940d-356e-4703-808d-f3884306d772 req-8ad79b4f-c74c-4460-92ab-1ea71239017f service nova] Acquiring lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:40:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1fba940d-356e-4703-808d-f3884306d772 req-8ad79b4f-c74c-4460-92ab-1ea71239017f service nova] Lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:40:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1fba940d-356e-4703-808d-f3884306d772 req-8ad79b4f-c74c-4460-92ab-1ea71239017f service nova] Lock "f1fa7599-72de-487d-9b0e-0adf8c0120ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:40:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-1fba940d-356e-4703-808d-f3884306d772 req-8ad79b4f-c74c-4460-92ab-1ea71239017f service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] No waiting events found dispatching network-vif-plugged-4f594b38-986f-42c8-bb69-4caeabfe1b56 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:40:03 user nova-compute[73497]: WARNING nova.compute.manager [req-1fba940d-356e-4703-808d-f3884306d772 req-8ad79b4f-c74c-4460-92ab-1ea71239017f service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Received unexpected event network-vif-plugged-4f594b38-986f-42c8-bb69-4caeabfe1b56 for instance with vm_state deleted and task_state None.
Aug 26 23:40:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-1fba940d-356e-4703-808d-f3884306d772 req-8ad79b4f-c74c-4460-92ab-1ea71239017f service nova] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Received event network-vif-deleted-4f594b38-986f-42c8-bb69-4caeabfe1b56 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:40:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2736138f-49a6-430b-b39a-8a4021dadf80 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "db489468-154b-4238-8b81-f8fa2bc016b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:40:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2736138f-49a6-430b-b39a-8a4021dadf80 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "db489468-154b-4238-8b81-f8fa2bc016b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:40:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2736138f-49a6-430b-b39a-8a4021dadf80 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:40:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2736138f-49a6-430b-b39a-8a4021dadf80 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:40:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2736138f-49a6-430b-b39a-8a4021dadf80 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:40:05 user nova-compute[73497]: INFO nova.compute.manager [None req-2736138f-49a6-430b-b39a-8a4021dadf80 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Terminating instance
Aug 26 23:40:05 user nova-compute[73497]: DEBUG nova.compute.manager [None req-2736138f-49a6-430b-b39a-8a4021dadf80 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:40:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:40:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:40:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:40:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:40:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:40:05 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:40:05 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:40:05 user nova-compute[73497]: DEBUG nova.compute.manager [req-bda5956c-b12b-4c13-ad27-e269b58c9360 req-e308171a-9f1e-4eb7-8fc7-33b8b211bda6 service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Received event network-vif-unplugged-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:40:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-bda5956c-b12b-4c13-ad27-e269b58c9360 req-e308171a-9f1e-4eb7-8fc7-33b8b211bda6 service nova] Acquiring lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:40:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-bda5956c-b12b-4c13-ad27-e269b58c9360 req-e308171a-9f1e-4eb7-8fc7-33b8b211bda6 service nova] Lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:40:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-bda5956c-b12b-4c13-ad27-e269b58c9360 req-e308171a-9f1e-4eb7-8fc7-33b8b211bda6 service nova] Lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:40:05 user nova-compute[73497]: DEBUG nova.compute.manager [req-bda5956c-b12b-4c13-ad27-e269b58c9360 req-e308171a-9f1e-4eb7-8fc7-33b8b211bda6 service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] No waiting events found dispatching network-vif-unplugged-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:40:05 user nova-compute[73497]: DEBUG nova.compute.manager [req-bda5956c-b12b-4c13-ad27-e269b58c9360 req-e308171a-9f1e-4eb7-8fc7-33b8b211bda6 service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Received event network-vif-unplugged-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:40:05 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Instance destroyed successfully.
Aug 26 23:40:05 user nova-compute[73497]: DEBUG nova.objects.instance [None req-2736138f-49a6-430b-b39a-8a4021dadf80 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lazy-loading 'resources' on Instance uuid db489468-154b-4238-8b81-f8fa2bc016b7 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:40:05 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-2736138f-49a6-430b-b39a-8a4021dadf80 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T23:33:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1477188239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1477188239',id=38,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+zEsK4nQOioc9Qi0jnFjzykCg6/wtaz/sC0lOshmN9CO3QLXyXzCiB5KfNY2kjTWjUnRt570zcgoTQZLHEtWlYsJLi3kOwtzDS+5T0Z6DQJ/tppWJ0iSc7illPDBtpJQ==',key_name='tempest-keypair-1630262803',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:37:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f777a90b660e48cdb1f5a453fbe2f806',ramdisk_id='',reservation_id='r-f3c038xw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-389793905',owner_user_name='tempest-AttachVolumeShelveTestJSON-389793905-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:37:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d0fa85485fe42fc8a3b884f71db5669',uuid=db489468-154b-4238-8b81-f8fa2bc016b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "address": "fa:16:3e:ad:7f:ad", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc782cdf-fe", "ovs_interfaceid": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:40:05 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-2736138f-49a6-430b-b39a-8a4021dadf80 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Converting VIF {"id": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "address": "fa:16:3e:ad:7f:ad", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc782cdf-fe", "ovs_interfaceid": "fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:40:05 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-2736138f-49a6-430b-b39a-8a4021dadf80 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:7f:ad,bridge_name='br-int',has_traffic_filtering=True,id=fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5,network=Network(39b40d3c-dae0-4dcf-a0de-b77899879f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc782cdf-fe') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:40:05 user nova-compute[73497]: DEBUG os_vif [None req-2736138f-49a6-430b-b39a-8a4021dadf80 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:7f:ad,bridge_name='br-int',has_traffic_filtering=True,id=fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5,network=Network(39b40d3c-dae0-4dcf-a0de-b77899879f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc782cdf-fe') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:40:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:40:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc782cdf-fe, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:40:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:40:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:40:05 user nova-compute[73497]: INFO os_vif [None req-2736138f-49a6-430b-b39a-8a4021dadf80 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:7f:ad,bridge_name='br-int',has_traffic_filtering=True,id=fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5,network=Network(39b40d3c-dae0-4dcf-a0de-b77899879f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc782cdf-fe')
Aug 26 23:40:05 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-2736138f-49a6-430b-b39a-8a4021dadf80 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Deleting instance files /opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7_del
Aug 26 23:40:05 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-2736138f-49a6-430b-b39a-8a4021dadf80 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Deletion of /opt/stack/data/nova/instances/db489468-154b-4238-8b81-f8fa2bc016b7_del complete
Aug 26 23:40:05 user nova-compute[73497]: INFO nova.compute.manager [None req-2736138f-49a6-430b-b39a-8a4021dadf80 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 26 23:40:05 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-2736138f-49a6-430b-b39a-8a4021dadf80 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:40:05 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:40:05 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:40:06 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:40:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:40:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:40:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:40:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:40:06 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:40:06 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:40:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8631MB free_disk=25.142532348632812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:40:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:40:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:40:06 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:40:06 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Took 0.81 seconds to deallocate network for instance.
Aug 26 23:40:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance db489468-154b-4238-8b81-f8fa2bc016b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:40:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:40:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:40:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2736138f-49a6-430b-b39a-8a4021dadf80 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:40:06 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:40:06 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:40:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:40:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:40:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2736138f-49a6-430b-b39a-8a4021dadf80 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.092s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:40:06 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-2736138f-49a6-430b-b39a-8a4021dadf80 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:40:06 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-2736138f-49a6-430b-b39a-8a4021dadf80 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:40:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2736138f-49a6-430b-b39a-8a4021dadf80 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.115s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:40:07 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-2736138f-49a6-430b-b39a-8a4021dadf80 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Deleted allocations for instance db489468-154b-4238-8b81-f8fa2bc016b7
Aug 26 23:40:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-2736138f-49a6-430b-b39a-8a4021dadf80 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "db489468-154b-4238-8b81-f8fa2bc016b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.105s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:40:07 user nova-compute[73497]: DEBUG nova.compute.manager [req-1fa2f370-ca15-42e1-bbfd-b5e072dc471b req-aca8eebd-2e8d-4a62-867d-ba7bc858c770 service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Received event network-vif-plugged-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:40:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1fa2f370-ca15-42e1-bbfd-b5e072dc471b req-aca8eebd-2e8d-4a62-867d-ba7bc858c770 service nova] Acquiring lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:40:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1fa2f370-ca15-42e1-bbfd-b5e072dc471b req-aca8eebd-2e8d-4a62-867d-ba7bc858c770 service nova] Lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:40:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1fa2f370-ca15-42e1-bbfd-b5e072dc471b req-aca8eebd-2e8d-4a62-867d-ba7bc858c770 service nova] Lock "db489468-154b-4238-8b81-f8fa2bc016b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:40:07 user nova-compute[73497]: DEBUG nova.compute.manager [req-1fa2f370-ca15-42e1-bbfd-b5e072dc471b req-aca8eebd-2e8d-4a62-867d-ba7bc858c770 service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] No waiting events found dispatching network-vif-plugged-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:40:07 user nova-compute[73497]: WARNING nova.compute.manager [req-1fa2f370-ca15-42e1-bbfd-b5e072dc471b req-aca8eebd-2e8d-4a62-867d-ba7bc858c770 service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Received unexpected event network-vif-plugged-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 for instance with vm_state deleted and task_state None.
Aug 26 23:40:07 user nova-compute[73497]: DEBUG nova.compute.manager [req-1fa2f370-ca15-42e1-bbfd-b5e072dc471b req-aca8eebd-2e8d-4a62-867d-ba7bc858c770 service nova] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Received event network-vif-deleted-fc782cdf-fe9b-4cfc-b660-54e9bafcfbc5 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:40:07 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:40:10 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:40:10 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:40:14 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:40:15 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:40:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:40:16 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:40:16 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693093201.8536475, f1fa7599-72de-487d-9b0e-0adf8c0120ca => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:40:16 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] VM Stopped (Lifecycle Event)
Aug 26 23:40:16 user nova-compute[73497]: DEBUG nova.compute.manager [None req-046bbe09-fa42-4243-8e62-ab8efaa70a70 None None] [instance: f1fa7599-72de-487d-9b0e-0adf8c0120ca] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:40:17 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:40:19 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:40:19 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:40:19 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Didn't find any instances for network info cache update. {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 23:40:20 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693093205.8013706, db489468-154b-4238-8b81-f8fa2bc016b7 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:40:20 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] VM Stopped (Lifecycle Event)
Aug 26 23:40:20 user nova-compute[73497]: DEBUG nova.compute.manager [None req-02431881-ed17-4672-9d9f-6efe600c7609 None None] [instance: db489468-154b-4238-8b81-f8fa2bc016b7] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:40:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:40:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:40:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:40:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:40:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:40:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:40:25 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:40:30 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:40:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:40:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:40:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:40:40 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:40:45 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:40:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:40:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:40:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:40:58 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Acquiring lock "71518c06-a7d0-49fa-88de-ffb4af927f47" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lock "71518c06-a7d0-49fa-88de-ffb4af927f47" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:40:59 user nova-compute[73497]: INFO nova.compute.manager [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Unshelving
Aug 26 23:40:59 user nova-compute[73497]: DEBUG nova.compute.manager [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:40:59 user nova-compute[73497]: INFO nova.virt.block_device [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Booting with volume ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 at /dev/vda
Aug 26 23:40:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:40:59 user nova-compute[73497]: INFO nova.compute.claims [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Claim successful on node user
Aug 26 23:40:59 user nova-compute[73497]: DEBUG os_brick.utils [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3116ab5-3e19-4345-9d30-5ccb18d7e4bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b68799f-feb6-4ffc-be39-3c4aa6864e8c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Refreshing inventories for resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee237ba-81e5-4ac3-a8b0-0c77ee74ba36]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c41f7fa-dc23-4a31-a303-c7f1cb314037]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Updating ProviderTree inventory for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Updating inventory in ProviderTree for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:40:59 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:40:59 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f879e382-0698-4952-89a2-3c217a0fc665]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Refreshing aggregate associations for resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1, aggregates: None {{(pid=73497) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG os_brick.utils [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Updating existing volume attachment record: 8efb3f78-0060-4ebc-8f55-79c9259d8deb {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Refreshing trait associations for resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING {{(pid=73497) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG nova.compute.manager [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG nova.compute.manager [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG nova.network.neutron [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:40:59 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:40:59 user nova-compute[73497]: DEBUG nova.compute.manager [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG nova.policy [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7d0fa85485fe42fc8a3b884f71db5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f777a90b660e48cdb1f5a453fbe2f806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG nova.compute.manager [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:40:59 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Creating image(s)
Aug 26 23:40:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "/opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:40:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "/opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:41:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "/opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:41:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:41:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.220s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:41:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:41:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:41:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:41:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.197s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:41:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:41:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/disk 1073741824" returned: 0 in 0.066s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:41:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:41:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:41:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.191s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:41:00 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:41:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:41:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:00 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:41:00 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Cannot resize image /opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:41:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:41:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Ensure instance console log exists: /opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:41:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:41:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:41:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:41:01 user nova-compute[73497]: DEBUG nova.network.neutron [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Successfully created port: 6f697dbb-ce2b-4cf2-a715-6bba7f18c40d {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG nova.network.neutron [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Successfully updated port: 6f697dbb-ce2b-4cf2-a715-6bba7f18c40d {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "refresh_cache-33fa5a5f-06a0-4afd-bf9c-661b0551c59c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquired lock "refresh_cache-33fa5a5f-06a0-4afd-bf9c-661b0551c59c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG nova.network.neutron [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG nova.compute.manager [req-9ca84f4f-2eda-49af-a221-74f198e184f3 req-43686146-5621-4776-ae75-c243ac575c57 service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Received event network-changed-6f697dbb-ce2b-4cf2-a715-6bba7f18c40d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG nova.compute.manager [req-9ca84f4f-2eda-49af-a221-74f198e184f3 req-43686146-5621-4776-ae75-c243ac575c57 service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Refreshing instance network info cache due to event network-changed-6f697dbb-ce2b-4cf2-a715-6bba7f18c40d. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9ca84f4f-2eda-49af-a221-74f198e184f3 req-43686146-5621-4776-ae75-c243ac575c57 service nova] Acquiring lock "refresh_cache-33fa5a5f-06a0-4afd-bf9c-661b0551c59c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG nova.network.neutron [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG nova.network.neutron [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Updating instance_info_cache with network_info: [{"id": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "address": "fa:16:3e:50:bb:5f", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f697dbb-ce", "ovs_interfaceid": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Releasing lock "refresh_cache-33fa5a5f-06a0-4afd-bf9c-661b0551c59c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG nova.compute.manager [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Instance network_info: |[{"id": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "address": "fa:16:3e:50:bb:5f", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f697dbb-ce", "ovs_interfaceid": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9ca84f4f-2eda-49af-a221-74f198e184f3 req-43686146-5621-4776-ae75-c243ac575c57 service nova] Acquired lock "refresh_cache-33fa5a5f-06a0-4afd-bf9c-661b0551c59c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG nova.network.neutron [req-9ca84f4f-2eda-49af-a221-74f198e184f3 req-43686146-5621-4776-ae75-c243ac575c57 service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Refreshing network info cache for port 6f697dbb-ce2b-4cf2-a715-6bba7f18c40d {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Start _get_guest_xml network_info=[{"id": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "address": "fa:16:3e:50:bb:5f", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f697dbb-ce", "ovs_interfaceid": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:41:02 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:41:02 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:41:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:40:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1939646178',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1939646178',id=44,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/BBmC7PDKWpCXjrShRsaIFAVunnfvGtjuzOuDUph33qOLL47qVxaFsEkVtoeF8Y4TTbODvEYKrhjYpq5iRTc5NXXaBftXrloDo6lLtWoE84QT/Cfq9nCWjVN7TwNvilw==',key_name='tempest-keypair-2063120950',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f777a90b660e48cdb1f5a453fbe2f806',ramdisk_id='',reservation_id='r-wex81mon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-389793905',owner_user_name='tempest-AttachVolumeShelveTestJSON-389793905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:41:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d0fa85485fe42fc8a3b884f71db5669',uuid=33fa5a5f-06a0-4afd-bf9c-661b0551c59c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "address": "fa:16:3e:50:bb:5f", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f697dbb-ce", "ovs_interfaceid": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Converting VIF {"id": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "address": "fa:16:3e:50:bb:5f", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f697dbb-ce", "ovs_interfaceid": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:bb:5f,bridge_name='br-int',has_traffic_filtering=True,id=6f697dbb-ce2b-4cf2-a715-6bba7f18c40d,network=Network(39b40d3c-dae0-4dcf-a0de-b77899879f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f697dbb-ce') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG nova.objects.instance [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lazy-loading 'pci_devices' on Instance uuid 33fa5a5f-06a0-4afd-bf9c-661b0551c59c {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:41:02 user nova-compute[73497]:   <uuid>33fa5a5f-06a0-4afd-bf9c-661b0551c59c</uuid>
Aug 26 23:41:02 user nova-compute[73497]:   <name>instance-0000002c</name>
Aug 26 23:41:02 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:41:02 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:41:02 user nova-compute[73497]:   <metadata>
Aug 26 23:41:02 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:41:02 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:41:02 user nova-compute[73497]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1939646178</nova:name>
Aug 26 23:41:02 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:41:02</nova:creationTime>
Aug 26 23:41:02 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:41:02 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:41:02 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:41:02 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:41:02 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:41:02 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:41:02 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:41:02 user nova-compute[73497]:       <nova:owner>
Aug 26 23:41:02 user nova-compute[73497]:         <nova:user uuid="7d0fa85485fe42fc8a3b884f71db5669">tempest-AttachVolumeShelveTestJSON-389793905-project-member</nova:user>
Aug 26 23:41:02 user nova-compute[73497]:         <nova:project uuid="f777a90b660e48cdb1f5a453fbe2f806">tempest-AttachVolumeShelveTestJSON-389793905</nova:project>
Aug 26 23:41:02 user nova-compute[73497]:       </nova:owner>
Aug 26 23:41:02 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:41:02 user nova-compute[73497]:       <nova:ports>
Aug 26 23:41:02 user nova-compute[73497]:         <nova:port uuid="6f697dbb-ce2b-4cf2-a715-6bba7f18c40d">
Aug 26 23:41:02 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 23:41:02 user nova-compute[73497]:         </nova:port>
Aug 26 23:41:02 user nova-compute[73497]:       </nova:ports>
Aug 26 23:41:02 user nova-compute[73497]:     </nova:instance>
Aug 26 23:41:02 user nova-compute[73497]:   </metadata>
Aug 26 23:41:02 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:41:02 user nova-compute[73497]:     <system>
Aug 26 23:41:02 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:41:02 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:41:02 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:41:02 user nova-compute[73497]:       <entry name="serial">33fa5a5f-06a0-4afd-bf9c-661b0551c59c</entry>
Aug 26 23:41:02 user nova-compute[73497]:       <entry name="uuid">33fa5a5f-06a0-4afd-bf9c-661b0551c59c</entry>
Aug 26 23:41:02 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:41:02 user nova-compute[73497]:     </system>
Aug 26 23:41:02 user nova-compute[73497]:   </sysinfo>
Aug 26 23:41:02 user nova-compute[73497]:   <os>
Aug 26 23:41:02 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:41:02 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:41:02 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:41:02 user nova-compute[73497]:   </os>
Aug 26 23:41:02 user nova-compute[73497]:   <features>
Aug 26 23:41:02 user nova-compute[73497]:     <acpi/>
Aug 26 23:41:02 user nova-compute[73497]:     <apic/>
Aug 26 23:41:02 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:41:02 user nova-compute[73497]:   </features>
Aug 26 23:41:02 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:41:02 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:41:02 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:41:02 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:41:02 user nova-compute[73497]:   </clock>
Aug 26 23:41:02 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:41:02 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:41:02 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:41:02 user nova-compute[73497]:   </cpu>
Aug 26 23:41:02 user nova-compute[73497]:   <devices>
Aug 26 23:41:02 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:41:02 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:41:02 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/disk"/>
Aug 26 23:41:02 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:41:02 user nova-compute[73497]:     </disk>
Aug 26 23:41:02 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:41:02 user nova-compute[73497]:       <mac address="fa:16:3e:50:bb:5f"/>
Aug 26 23:41:02 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:41:02 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:41:02 user nova-compute[73497]:       <target dev="tap6f697dbb-ce"/>
Aug 26 23:41:02 user nova-compute[73497]:     </interface>
Aug 26 23:41:02 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:41:02 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/console.log" append="off"/>
Aug 26 23:41:02 user nova-compute[73497]:     </serial>
Aug 26 23:41:02 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:41:02 user nova-compute[73497]:     <video>
Aug 26 23:41:02 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:41:02 user nova-compute[73497]:     </video>
Aug 26 23:41:02 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:41:02 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:41:02 user nova-compute[73497]:     </rng>
Aug 26 23:41:02 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:41:02 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:41:02 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:41:02 user nova-compute[73497]:     </memballoon>
Aug 26 23:41:02 user nova-compute[73497]:   </devices>
Aug 26 23:41:02 user nova-compute[73497]: </domain>
Aug 26 23:41:02 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:40:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1939646178',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1939646178',id=44,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/BBmC7PDKWpCXjrShRsaIFAVunnfvGtjuzOuDUph33qOLL47qVxaFsEkVtoeF8Y4TTbODvEYKrhjYpq5iRTc5NXXaBftXrloDo6lLtWoE84QT/Cfq9nCWjVN7TwNvilw==',key_name='tempest-keypair-2063120950',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f777a90b660e48cdb1f5a453fbe2f806',ramdisk_id='',reservation_id='r-wex81mon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-389793905',owner_user_name='tempest-AttachVolumeShelveTestJSON-389793905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:41:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d0fa85485fe42fc8a3b884f71db5669',uuid=33fa5a5f-06a0-4afd-bf9c-661b0551c59c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "address": "fa:16:3e:50:bb:5f", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f697dbb-ce", "ovs_interfaceid": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Converting VIF {"id": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "address": "fa:16:3e:50:bb:5f", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f697dbb-ce", "ovs_interfaceid": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:bb:5f,bridge_name='br-int',has_traffic_filtering=True,id=6f697dbb-ce2b-4cf2-a715-6bba7f18c40d,network=Network(39b40d3c-dae0-4dcf-a0de-b77899879f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f697dbb-ce') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG os_vif [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:bb:5f,bridge_name='br-int',has_traffic_filtering=True,id=6f697dbb-ce2b-4cf2-a715-6bba7f18c40d,network=Network(39b40d3c-dae0-4dcf-a0de-b77899879f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f697dbb-ce') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f697dbb-ce, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6f697dbb-ce, col_values=(('external_ids', {'iface-id': '6f697dbb-ce2b-4cf2-a715-6bba7f18c40d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:bb:5f', 'vm-uuid': '33fa5a5f-06a0-4afd-bf9c-661b0551c59c'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:02 user nova-compute[73497]: INFO os_vif [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:bb:5f,bridge_name='br-int',has_traffic_filtering=True,id=6f697dbb-ce2b-4cf2-a715-6bba7f18c40d,network=Network(39b40d3c-dae0-4dcf-a0de-b77899879f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f697dbb-ce')
Aug 26 23:41:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] No VIF found with MAC fa:16:3e:50:bb:5f, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG nova.network.neutron [req-9ca84f4f-2eda-49af-a221-74f198e184f3 req-43686146-5621-4776-ae75-c243ac575c57 service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Updated VIF entry in instance network info cache for port 6f697dbb-ce2b-4cf2-a715-6bba7f18c40d. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG nova.network.neutron [req-9ca84f4f-2eda-49af-a221-74f198e184f3 req-43686146-5621-4776-ae75-c243ac575c57 service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Updating instance_info_cache with network_info: [{"id": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "address": "fa:16:3e:50:bb:5f", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f697dbb-ce", "ovs_interfaceid": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:41:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9ca84f4f-2eda-49af-a221-74f198e184f3 req-43686146-5621-4776-ae75-c243ac575c57 service nova] Releasing lock "refresh_cache-33fa5a5f-06a0-4afd-bf9c-661b0551c59c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:41:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:04 user nova-compute[73497]: DEBUG nova.compute.manager [req-93d93dc3-fb4d-437e-9044-a1d2ef109764 req-f9a5ab78-dd5b-4ef0-a0ee-358516de8cf8 service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Received event network-vif-plugged-6f697dbb-ce2b-4cf2-a715-6bba7f18c40d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:41:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-93d93dc3-fb4d-437e-9044-a1d2ef109764 req-f9a5ab78-dd5b-4ef0-a0ee-358516de8cf8 service nova] Acquiring lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:41:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-93d93dc3-fb4d-437e-9044-a1d2ef109764 req-f9a5ab78-dd5b-4ef0-a0ee-358516de8cf8 service nova] Lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:41:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-93d93dc3-fb4d-437e-9044-a1d2ef109764 req-f9a5ab78-dd5b-4ef0-a0ee-358516de8cf8 service nova] Lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:41:04 user nova-compute[73497]: DEBUG nova.compute.manager [req-93d93dc3-fb4d-437e-9044-a1d2ef109764 req-f9a5ab78-dd5b-4ef0-a0ee-358516de8cf8 service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] No waiting events found dispatching network-vif-plugged-6f697dbb-ce2b-4cf2-a715-6bba7f18c40d {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:41:04 user nova-compute[73497]: WARNING nova.compute.manager [req-93d93dc3-fb4d-437e-9044-a1d2ef109764 req-f9a5ab78-dd5b-4ef0-a0ee-358516de8cf8 service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Received unexpected event network-vif-plugged-6f697dbb-ce2b-4cf2-a715-6bba7f18c40d for instance with vm_state building and task_state spawning.
Aug 26 23:41:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:06 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:41:06 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:41:06 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:41:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:41:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:41:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:41:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:41:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:41:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:41:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:41:06 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693093266.5022225, 33fa5a5f-06a0-4afd-bf9c-661b0551c59c => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:41:06 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] VM Resumed (Lifecycle Event)
Aug 26 23:41:06 user nova-compute[73497]: DEBUG nova.compute.manager [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:41:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:41:06 user nova-compute[73497]: DEBUG nova.compute.manager [req-1056bc7f-14ec-46ca-9b98-1f835045f817 req-15bf904f-831a-4128-9216-0f08e0bff25e service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Received event network-vif-plugged-6f697dbb-ce2b-4cf2-a715-6bba7f18c40d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:41:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1056bc7f-14ec-46ca-9b98-1f835045f817 req-15bf904f-831a-4128-9216-0f08e0bff25e service nova] Acquiring lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:41:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1056bc7f-14ec-46ca-9b98-1f835045f817 req-15bf904f-831a-4128-9216-0f08e0bff25e service nova] Lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:41:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1056bc7f-14ec-46ca-9b98-1f835045f817 req-15bf904f-831a-4128-9216-0f08e0bff25e service nova] Lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:41:06 user nova-compute[73497]: DEBUG nova.compute.manager [req-1056bc7f-14ec-46ca-9b98-1f835045f817 req-15bf904f-831a-4128-9216-0f08e0bff25e service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] No waiting events found dispatching network-vif-plugged-6f697dbb-ce2b-4cf2-a715-6bba7f18c40d {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:41:06 user nova-compute[73497]: WARNING nova.compute.manager [req-1056bc7f-14ec-46ca-9b98-1f835045f817 req-15bf904f-831a-4128-9216-0f08e0bff25e service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Received unexpected event network-vif-plugged-6f697dbb-ce2b-4cf2-a715-6bba7f18c40d for instance with vm_state building and task_state spawning.
Aug 26 23:41:06 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:41:06 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Instance spawned successfully.
Aug 26 23:41:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:41:06 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:41:06 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:41:06 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693093266.5034747, 33fa5a5f-06a0-4afd-bf9c-661b0551c59c => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:41:06 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] VM Started (Lifecycle Event)
Aug 26 23:41:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:41:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:41:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:41:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:41:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:41:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:41:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/disk --force-share --output=json" returned: 0 in 0.482s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:41:06 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:41:07 user nova-compute[73497]: INFO nova.compute.manager [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Took 7.45 seconds to spawn the instance on the hypervisor.
Aug 26 23:41:07 user nova-compute[73497]: DEBUG nova.compute.manager [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:41:07 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:41:07 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:41:07 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:41:07 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8670MB free_disk=25.17778778076172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:41:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:41:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:41:07 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:41:07 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 33fa5a5f-06a0-4afd-bf9c-661b0551c59c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:41:07 user nova-compute[73497]: INFO nova.compute.manager [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Took 8.33 seconds to build instance.
Aug 26 23:41:07 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 71518c06-a7d0-49fa-88de-ffb4af927f47 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 26 23:41:07 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:41:07 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:41:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-cc53639a-188e-497a-bfd4-f0060a794db3 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.430s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:41:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:07 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:41:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:07 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:41:07 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:41:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.252s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:41:10 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:10 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:41:12 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:41:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:16 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:41:17 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:41:17 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:41:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:41:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:41:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:41:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:41:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:41:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:19 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:41:20 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:41:20 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:41:20 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:41:20 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Rebuilding the list of instances to heal {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 23:41:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-33fa5a5f-06a0-4afd-bf9c-661b0551c59c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:41:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-33fa5a5f-06a0-4afd-bf9c-661b0551c59c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:41:20 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:41:20 user nova-compute[73497]: DEBUG nova.objects.instance [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lazy-loading 'info_cache' on Instance uuid 33fa5a5f-06a0-4afd-bf9c-661b0551c59c {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:41:20 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Updating instance_info_cache with network_info: [{"id": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "address": "fa:16:3e:50:bb:5f", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f697dbb-ce", "ovs_interfaceid": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:41:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-33fa5a5f-06a0-4afd-bf9c-661b0551c59c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:41:20 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:41:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:41:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:41:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:41:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:41:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:41:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:41:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:41:22 user nova-compute[73497]: DEBUG nova.objects.instance [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lazy-loading 'pci_requests' on Instance uuid 71518c06-a7d0-49fa-88de-ffb4af927f47 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:41:22 user nova-compute[73497]: DEBUG nova.objects.instance [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lazy-loading 'numa_topology' on Instance uuid 71518c06-a7d0-49fa-88de-ffb4af927f47 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:41:22 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:41:22 user nova-compute[73497]: INFO nova.compute.claims [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Claim successful on node user
Aug 26 23:41:23 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:41:23 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:41:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.279s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:41:23 user nova-compute[73497]: INFO nova.network.neutron [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Updating port 8ec486c2-3507-4e88-8c66-d3db44578a1b with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Acquiring lock "refresh_cache-71518c06-a7d0-49fa-88de-ffb4af927f47" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Acquired lock "refresh_cache-71518c06-a7d0-49fa-88de-ffb4af927f47" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG nova.network.neutron [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG nova.compute.manager [req-bd2b2861-5a76-4b9d-a79c-4496f6c3282c req-0a7f15cc-307b-410e-9756-bbf130d58f51 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Received event network-changed-8ec486c2-3507-4e88-8c66-d3db44578a1b {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG nova.compute.manager [req-bd2b2861-5a76-4b9d-a79c-4496f6c3282c req-0a7f15cc-307b-410e-9756-bbf130d58f51 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Refreshing instance network info cache due to event network-changed-8ec486c2-3507-4e88-8c66-d3db44578a1b. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-bd2b2861-5a76-4b9d-a79c-4496f6c3282c req-0a7f15cc-307b-410e-9756-bbf130d58f51 service nova] Acquiring lock "refresh_cache-71518c06-a7d0-49fa-88de-ffb4af927f47" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG nova.network.neutron [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Updating instance_info_cache with network_info: [{"id": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "address": "fa:16:3e:ad:51:e7", "network": {"id": "1b5f252b-ef13-47fa-a49c-53f70d79ae43", "bridge": "br-int", "label": "tempest-TestShelveInstance-125614022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "216a6e017cd94bbe96525e413d893e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ec486c2-35", "ovs_interfaceid": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Releasing lock "refresh_cache-71518c06-a7d0-49fa-88de-ffb4af927f47" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:41:24 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Creating image(s)
Aug 26 23:41:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Did not create local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Ensure instance console log exists: /opt/stack/data/nova/instances/71518c06-a7d0-49fa-88de-ffb4af927f47/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Start _get_guest_xml network_info=[{"id": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "address": "fa:16:3e:ad:51:e7", "network": {"id": "1b5f252b-ef13-47fa-a49c-53f70d79ae43", "bridge": "br-int", "label": "tempest-TestShelveInstance-125614022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "216a6e017cd94bbe96525e413d893e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ec486c2-35", "ovs_interfaceid": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8efb3f78-0060-4ebc-8f55-79c9259d8deb', 'guest_format': None, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnJQIZbW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '71518c06-a7d0-49fa-88de-ffb4af927f47', 'attached_at': '', 'detached_at': '', 'volume_id': 'ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7', 'serial': 'ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7'}, 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-bd2b2861-5a76-4b9d-a79c-4496f6c3282c req-0a7f15cc-307b-410e-9756-bbf130d58f51 service nova] Acquired lock "refresh_cache-71518c06-a7d0-49fa-88de-ffb4af927f47" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG nova.network.neutron [req-bd2b2861-5a76-4b9d-a79c-4496f6c3282c req-0a7f15cc-307b-410e-9756-bbf130d58f51 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Refreshing network info cache for port 8ec486c2-3507-4e88-8c66-d3db44578a1b {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:41:24 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:41:24 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:41:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG nova.objects.instance [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lazy-loading 'vcpu_model' on Instance uuid 71518c06-a7d0-49fa-88de-ffb4af927f47 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG nova.objects.base [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Object Instance<71518c06-a7d0-49fa-88de-ffb4af927f47> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnJQIZbW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:41:24 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:41:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:41:24 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:41:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:41:24 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:41:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1064a9f-c60a-403e-833a-d43249a047f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:41:24 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c4e220-7027-4794-872e-bc8b133e0f92]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7] added
Aug 26 23:41:24 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4679dd2c-fc6b-48ef-9482-e0f446112ce3]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7d4640-e344-445e-add8-8f989fd2591c]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MnJQIZbW {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MnJQIZbW" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2057cf9f-8c9b-48c9-b978-1f79993103de]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MnJQIZbW'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[51280036-c447-425a-965c-a02e98df7bc7]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:41:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:41:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:41:25 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[382fd77d-9eac-4301-8981-f08d8b2e23d3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:41:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 23:41:25 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:41:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 23:41:25 user nova-compute[73497]:  {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:41:25 user nova-compute[73497]: WARNING os_brick.initiator.connectors.iscsi [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 23:41:25 user nova-compute[73497]: 
Aug 26 23:41:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:41:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:41:25 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bc91b1-0182-4c59-bc8e-2c962c62bc09]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:41:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7, portal: 172.16.0.220,3260]
Aug 26 23:41:25 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7, portal: 172.16.0.220,3260] successful.
Aug 26 23:41:25 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:41:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:41:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:41:25 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ff34ea-9c8b-4a04-aca9-14aaf1c65765]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:41:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:41:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:41:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:41:25 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[53553c78-4caf-4dad-8c63-e50f53084b17]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:41:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)
Aug 26 23:41:25 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:41:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)
Aug 26 23:41:25 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:41:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:41:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:41:25 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:41:25 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:41:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:41:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:41:25 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[315e626e-f410-46df-9a43-2da4ec27f958]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:41:25 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:41:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnJQIZbW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:41:25 user nova-compute[73497]: DEBUG nova.network.neutron [req-bd2b2861-5a76-4b9d-a79c-4496f6c3282c req-0a7f15cc-307b-410e-9756-bbf130d58f51 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Updated VIF entry in instance network info cache for port 8ec486c2-3507-4e88-8c66-d3db44578a1b. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:41:25 user nova-compute[73497]: DEBUG nova.network.neutron [req-bd2b2861-5a76-4b9d-a79c-4496f6c3282c req-0a7f15cc-307b-410e-9756-bbf130d58f51 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Updating instance_info_cache with network_info: [{"id": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "address": "fa:16:3e:ad:51:e7", "network": {"id": "1b5f252b-ef13-47fa-a49c-53f70d79ae43", "bridge": "br-int", "label": "tempest-TestShelveInstance-125614022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "216a6e017cd94bbe96525e413d893e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ec486c2-35", "ovs_interfaceid": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:41:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-bd2b2861-5a76-4b9d-a79c-4496f6c3282c req-0a7f15cc-307b-410e-9756-bbf130d58f51 service nova] Releasing lock "refresh_cache-71518c06-a7d0-49fa-88de-ffb4af927f47" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:41:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:41:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23837373531653665', 'path': '/dev/sdb'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:41:26 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837373531653665', 'path': '/dev/sdb'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:41:26 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T23:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1647360321',display_name='tempest-TestShelveInstance-server-1647360321',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1647360321',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1023296182',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:37:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='216a6e017cd94bbe96525e413d893e6d',ramdisk_id='',reservation_id='r-a97hsfck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2032732603',owner_user_name='tempest-TestShelveInstance-2032732603-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:40:59Z,user_data=None,user_id='77ec603ab2da4a3584b0e4b0bcf2984b',uuid=71518c06-a7d0-49fa-88de-ffb4af927f47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "address": "fa:16:3e:ad:51:e7", "network": {"id": "1b5f252b-ef13-47fa-a49c-53f70d79ae43", "bridge": "br-int", "label": "tempest-TestShelveInstance-125614022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "216a6e017cd94bbe96525e413d893e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ec486c2-35", "ovs_interfaceid": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:41:26 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Converting VIF {"id": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "address": "fa:16:3e:ad:51:e7", "network": {"id": "1b5f252b-ef13-47fa-a49c-53f70d79ae43", "bridge": "br-int", "label": "tempest-TestShelveInstance-125614022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "216a6e017cd94bbe96525e413d893e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ec486c2-35", "ovs_interfaceid": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:41:26 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:51:e7,bridge_name='br-int',has_traffic_filtering=True,id=8ec486c2-3507-4e88-8c66-d3db44578a1b,network=Network(1b5f252b-ef13-47fa-a49c-53f70d79ae43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ec486c2-35') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:41:26 user nova-compute[73497]: DEBUG nova.objects.instance [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lazy-loading 'pci_devices' on Instance uuid 71518c06-a7d0-49fa-88de-ffb4af927f47 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:41:26 user nova-compute[73497]: DEBUG nova.objects.base [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Object Instance<71518c06-a7d0-49fa-88de-ffb4af927f47> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:41:26 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:41:26 user nova-compute[73497]:   <uuid>71518c06-a7d0-49fa-88de-ffb4af927f47</uuid>
Aug 26 23:41:26 user nova-compute[73497]:   <name>instance-0000002b</name>
Aug 26 23:41:26 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:41:26 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:41:26 user nova-compute[73497]:   <metadata>
Aug 26 23:41:26 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:41:26 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:41:26 user nova-compute[73497]:       <nova:name>tempest-TestShelveInstance-server-1647360321</nova:name>
Aug 26 23:41:26 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:41:24</nova:creationTime>
Aug 26 23:41:26 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:41:26 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:41:26 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:41:26 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:41:26 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:41:26 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:41:26 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:41:26 user nova-compute[73497]:       <nova:owner>
Aug 26 23:41:26 user nova-compute[73497]:         <nova:user uuid="77ec603ab2da4a3584b0e4b0bcf2984b">tempest-TestShelveInstance-2032732603-project-member</nova:user>
Aug 26 23:41:26 user nova-compute[73497]:         <nova:project uuid="216a6e017cd94bbe96525e413d893e6d">tempest-TestShelveInstance-2032732603</nova:project>
Aug 26 23:41:26 user nova-compute[73497]:       </nova:owner>
Aug 26 23:41:26 user nova-compute[73497]:       <nova:ports>
Aug 26 23:41:26 user nova-compute[73497]:         <nova:port uuid="8ec486c2-3507-4e88-8c66-d3db44578a1b">
Aug 26 23:41:26 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 23:41:26 user nova-compute[73497]:         </nova:port>
Aug 26 23:41:26 user nova-compute[73497]:       </nova:ports>
Aug 26 23:41:26 user nova-compute[73497]:     </nova:instance>
Aug 26 23:41:26 user nova-compute[73497]:   </metadata>
Aug 26 23:41:26 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:41:26 user nova-compute[73497]:     <system>
Aug 26 23:41:26 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:41:26 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:41:26 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:41:26 user nova-compute[73497]:       <entry name="serial">71518c06-a7d0-49fa-88de-ffb4af927f47</entry>
Aug 26 23:41:26 user nova-compute[73497]:       <entry name="uuid">71518c06-a7d0-49fa-88de-ffb4af927f47</entry>
Aug 26 23:41:26 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:41:26 user nova-compute[73497]:     </system>
Aug 26 23:41:26 user nova-compute[73497]:   </sysinfo>
Aug 26 23:41:26 user nova-compute[73497]:   <os>
Aug 26 23:41:26 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:41:26 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:41:26 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:41:26 user nova-compute[73497]:   </os>
Aug 26 23:41:26 user nova-compute[73497]:   <features>
Aug 26 23:41:26 user nova-compute[73497]:     <acpi/>
Aug 26 23:41:26 user nova-compute[73497]:     <apic/>
Aug 26 23:41:26 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:41:26 user nova-compute[73497]:   </features>
Aug 26 23:41:26 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:41:26 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:41:26 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:41:26 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:41:26 user nova-compute[73497]:   </clock>
Aug 26 23:41:26 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:41:26 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:41:26 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:41:26 user nova-compute[73497]:   </cpu>
Aug 26 23:41:26 user nova-compute[73497]:   <devices>
Aug 26 23:41:26 user nova-compute[73497]:     <disk type="block" device="disk">
Aug 26 23:41:26 user nova-compute[73497]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:41:26 user nova-compute[73497]:       <source dev="/dev/sdb"/>
Aug 26 23:41:26 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:41:26 user nova-compute[73497]:       <serial>ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7</serial>
Aug 26 23:41:26 user nova-compute[73497]:     </disk>
Aug 26 23:41:26 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:41:26 user nova-compute[73497]:       <mac address="fa:16:3e:ad:51:e7"/>
Aug 26 23:41:26 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:41:26 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:41:26 user nova-compute[73497]:       <target dev="tap8ec486c2-35"/>
Aug 26 23:41:26 user nova-compute[73497]:     </interface>
Aug 26 23:41:26 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:41:26 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/71518c06-a7d0-49fa-88de-ffb4af927f47/console.log" append="off"/>
Aug 26 23:41:26 user nova-compute[73497]:     </serial>
Aug 26 23:41:26 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:41:26 user nova-compute[73497]:     <video>
Aug 26 23:41:26 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:41:26 user nova-compute[73497]:     </video>
Aug 26 23:41:26 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:41:26 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:41:26 user nova-compute[73497]:     </rng>
Aug 26 23:41:26 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:41:26 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:41:26 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:41:26 user nova-compute[73497]:     </memballoon>
Aug 26 23:41:26 user nova-compute[73497]:   </devices>
Aug 26 23:41:26 user nova-compute[73497]: </domain>
Aug 26 23:41:26 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:41:26 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T23:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1647360321',display_name='tempest-TestShelveInstance-server-1647360321',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1647360321',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1023296182',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:37:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='216a6e017cd94bbe96525e413d893e6d',ramdisk_id='',reservation_id='r-a97hsfck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2032732603',owner_user_name='tempest-TestShelveInstance-2032732603-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:40:59Z,user_data=None,user_id='77ec603ab2da4a3584b0e4b0bcf2984b',uuid=71518c06-a7d0-49fa-88de-ffb4af927f47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "address": "fa:16:3e:ad:51:e7", "network": {"id": "1b5f252b-ef13-47fa-a49c-53f70d79ae43", "bridge": "br-int", "label": "tempest-TestShelveInstance-125614022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "216a6e017cd94bbe96525e413d893e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ec486c2-35", "ovs_interfaceid": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:41:26 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Converting VIF {"id": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "address": "fa:16:3e:ad:51:e7", "network": {"id": "1b5f252b-ef13-47fa-a49c-53f70d79ae43", "bridge": "br-int", "label": "tempest-TestShelveInstance-125614022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "216a6e017cd94bbe96525e413d893e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ec486c2-35", "ovs_interfaceid": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:41:26 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:51:e7,bridge_name='br-int',has_traffic_filtering=True,id=8ec486c2-3507-4e88-8c66-d3db44578a1b,network=Network(1b5f252b-ef13-47fa-a49c-53f70d79ae43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ec486c2-35') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:41:26 user nova-compute[73497]: DEBUG os_vif [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:51:e7,bridge_name='br-int',has_traffic_filtering=True,id=8ec486c2-3507-4e88-8c66-d3db44578a1b,network=Network(1b5f252b-ef13-47fa-a49c-53f70d79ae43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ec486c2-35') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:41:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:41:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:41:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ec486c2-35, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:41:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8ec486c2-35, col_values=(('external_ids', {'iface-id': '8ec486c2-3507-4e88-8c66-d3db44578a1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:51:e7', 'vm-uuid': '71518c06-a7d0-49fa-88de-ffb4af927f47'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:41:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:41:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:26 user nova-compute[73497]: INFO os_vif [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:51:e7,bridge_name='br-int',has_traffic_filtering=True,id=8ec486c2-3507-4e88-8c66-d3db44578a1b,network=Network(1b5f252b-ef13-47fa-a49c-53f70d79ae43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ec486c2-35')
Aug 26 23:41:26 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:41:26 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] No VIF found with MAC fa:16:3e:ad:51:e7, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:41:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:29 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693093289.8152843, 71518c06-a7d0-49fa-88de-ffb4af927f47 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:41:29 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] VM Resumed (Lifecycle Event)
Aug 26 23:41:29 user nova-compute[73497]: DEBUG nova.compute.manager [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:41:29 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:41:29 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Instance spawned successfully.
Aug 26 23:41:29 user nova-compute[73497]: DEBUG nova.compute.manager [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:41:29 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:41:29 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:41:29 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:41:29 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693093289.8182542, 71518c06-a7d0-49fa-88de-ffb4af927f47 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:41:29 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] VM Started (Lifecycle Event)
Aug 26 23:41:29 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:41:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-1a21b809-600f-48f7-ad02-971bf3347b34 tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lock "71518c06-a7d0-49fa-88de-ffb4af927f47" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 30.775s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:41:29 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:41:30 user nova-compute[73497]: DEBUG nova.compute.manager [req-8925ee7d-8c26-4cab-8bdb-67a2473ed6f8 req-cfa17bb4-27ca-4e27-b730-26b6cfaf7085 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Received event network-vif-plugged-8ec486c2-3507-4e88-8c66-d3db44578a1b {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:41:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8925ee7d-8c26-4cab-8bdb-67a2473ed6f8 req-cfa17bb4-27ca-4e27-b730-26b6cfaf7085 service nova] Acquiring lock "71518c06-a7d0-49fa-88de-ffb4af927f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:41:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8925ee7d-8c26-4cab-8bdb-67a2473ed6f8 req-cfa17bb4-27ca-4e27-b730-26b6cfaf7085 service nova] Lock "71518c06-a7d0-49fa-88de-ffb4af927f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:41:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8925ee7d-8c26-4cab-8bdb-67a2473ed6f8 req-cfa17bb4-27ca-4e27-b730-26b6cfaf7085 service nova] Lock "71518c06-a7d0-49fa-88de-ffb4af927f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:41:30 user nova-compute[73497]: DEBUG nova.compute.manager [req-8925ee7d-8c26-4cab-8bdb-67a2473ed6f8 req-cfa17bb4-27ca-4e27-b730-26b6cfaf7085 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] No waiting events found dispatching network-vif-plugged-8ec486c2-3507-4e88-8c66-d3db44578a1b {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:41:30 user nova-compute[73497]: WARNING nova.compute.manager [req-8925ee7d-8c26-4cab-8bdb-67a2473ed6f8 req-cfa17bb4-27ca-4e27-b730-26b6cfaf7085 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Received unexpected event network-vif-plugged-8ec486c2-3507-4e88-8c66-d3db44578a1b for instance with vm_state active and task_state None.
Aug 26 23:41:30 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:32 user nova-compute[73497]: DEBUG nova.compute.manager [req-bb3eff43-f5bb-4dcc-8eef-32f7378f1b00 req-1e895fcb-4f8a-4c91-bcda-b05b7eaba257 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Received event network-vif-plugged-8ec486c2-3507-4e88-8c66-d3db44578a1b {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:41:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-bb3eff43-f5bb-4dcc-8eef-32f7378f1b00 req-1e895fcb-4f8a-4c91-bcda-b05b7eaba257 service nova] Acquiring lock "71518c06-a7d0-49fa-88de-ffb4af927f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:41:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-bb3eff43-f5bb-4dcc-8eef-32f7378f1b00 req-1e895fcb-4f8a-4c91-bcda-b05b7eaba257 service nova] Lock "71518c06-a7d0-49fa-88de-ffb4af927f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:41:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-bb3eff43-f5bb-4dcc-8eef-32f7378f1b00 req-1e895fcb-4f8a-4c91-bcda-b05b7eaba257 service nova] Lock "71518c06-a7d0-49fa-88de-ffb4af927f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:41:32 user nova-compute[73497]: DEBUG nova.compute.manager [req-bb3eff43-f5bb-4dcc-8eef-32f7378f1b00 req-1e895fcb-4f8a-4c91-bcda-b05b7eaba257 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] No waiting events found dispatching network-vif-plugged-8ec486c2-3507-4e88-8c66-d3db44578a1b {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:41:32 user nova-compute[73497]: WARNING nova.compute.manager [req-bb3eff43-f5bb-4dcc-8eef-32f7378f1b00 req-1e895fcb-4f8a-4c91-bcda-b05b7eaba257 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Received unexpected event network-vif-plugged-8ec486c2-3507-4e88-8c66-d3db44578a1b for instance with vm_state active and task_state None.
Aug 26 23:41:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Acquiring lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:41:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:41:41 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:41:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:41:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:41:41 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:41:41 user nova-compute[73497]: INFO nova.compute.claims [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Claim successful on node user
Aug 26 23:41:41 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:41:41 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:41:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.298s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:41:41 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:41:42 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:41:42 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:41:42 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:41:42 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:41:42 user nova-compute[73497]: DEBUG nova.policy [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67c2acf13c6b491a8d8cfaf56733b431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292fdedf952f444f9782699bc608b1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:41:42 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:41:42 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:41:42 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Creating image(s)
Aug 26 23:41:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:41:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "/opt/stack/data/nova/instances/a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:41:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "/opt/stack/data/nova/instances/a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:41:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:41:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.181s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:41:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:41:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:41:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:41:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.176s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:41:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:41:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa/disk 1073741824" returned: 0 in 0.123s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:41:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.305s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:41:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:41:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.200s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:41:42 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:41:42 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:41:42 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Successfully created port: 6e419ab1-da77-4fb6-906e-6e36966ad332 {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:41:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:41:43 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Cannot resize image /opt/stack/data/nova/instances/a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:41:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:41:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Ensure instance console log exists: /opt/stack/data/nova/instances/a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:41:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:41:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:41:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:41:43 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Successfully updated port: 6e419ab1-da77-4fb6-906e-6e36966ad332 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:41:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Acquiring lock "refresh_cache-a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:41:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Acquired lock "refresh_cache-a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:41:43 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:41:43 user nova-compute[73497]: DEBUG nova.compute.manager [req-4b2a0082-566b-4966-89ea-5b68583593ed req-28e42bb5-9a57-4eed-a28c-d566be83bff6 service nova] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Received event network-changed-6e419ab1-da77-4fb6-906e-6e36966ad332 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:41:43 user nova-compute[73497]: DEBUG nova.compute.manager [req-4b2a0082-566b-4966-89ea-5b68583593ed req-28e42bb5-9a57-4eed-a28c-d566be83bff6 service nova] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Refreshing instance network info cache due to event network-changed-6e419ab1-da77-4fb6-906e-6e36966ad332. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:41:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4b2a0082-566b-4966-89ea-5b68583593ed req-28e42bb5-9a57-4eed-a28c-d566be83bff6 service nova] Acquiring lock "refresh_cache-a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:41:43 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Updating instance_info_cache with network_info: [{"id": "6e419ab1-da77-4fb6-906e-6e36966ad332", "address": "fa:16:3e:85:6f:ef", "network": {"id": "e663753f-6aa2-4bd1-8565-bd8d0e0d9f28", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-412895202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292fdedf952f444f9782699bc608b1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e419ab1-da", "ovs_interfaceid": "6e419ab1-da77-4fb6-906e-6e36966ad332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Releasing lock "refresh_cache-a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Instance network_info: |[{"id": "6e419ab1-da77-4fb6-906e-6e36966ad332", "address": "fa:16:3e:85:6f:ef", "network": {"id": "e663753f-6aa2-4bd1-8565-bd8d0e0d9f28", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-412895202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292fdedf952f444f9782699bc608b1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e419ab1-da", "ovs_interfaceid": "6e419ab1-da77-4fb6-906e-6e36966ad332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4b2a0082-566b-4966-89ea-5b68583593ed req-28e42bb5-9a57-4eed-a28c-d566be83bff6 service nova] Acquired lock "refresh_cache-a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG nova.network.neutron [req-4b2a0082-566b-4966-89ea-5b68583593ed req-28e42bb5-9a57-4eed-a28c-d566be83bff6 service nova] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Refreshing network info cache for port 6e419ab1-da77-4fb6-906e-6e36966ad332 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Start _get_guest_xml network_info=[{"id": "6e419ab1-da77-4fb6-906e-6e36966ad332", "address": "fa:16:3e:85:6f:ef", "network": {"id": "e663753f-6aa2-4bd1-8565-bd8d0e0d9f28", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-412895202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292fdedf952f444f9782699bc608b1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e419ab1-da", "ovs_interfaceid": "6e419ab1-da77-4fb6-906e-6e36966ad332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:41:44 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:41:44 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:41:44 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:41:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-772624928',display_name='tempest-TestServerVolumeAttachmentScenario-server-772624928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-772624928',id=45,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIe7ZNjibRz58OLPP0Fk/zfKlg6iONwPXluBJ0RN8tumoGQ4yC35GkSVI8xe2/ukWKDRP8WRD5K/VyI3BlADpE3rW6GJIYQBRnYksulk0xyLYLLSP1511Fj6/zrDma70CQ==',key_name='tempest-keypair-968560332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='292fdedf952f444f9782699bc608b1e9',ramdisk_id='',reservation_id='r-rg68fbsf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-888135645',owner_user_name='tempest-TestServerVolumeAttachmentScenario-888135645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:41:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67c2acf13c6b491a8d8cfaf56733b431',uuid=a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e419ab1-da77-4fb6-906e-6e36966ad332", "address": "fa:16:3e:85:6f:ef", "network": {"id": "e663753f-6aa2-4bd1-8565-bd8d0e0d9f28", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-412895202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292fdedf952f444f9782699bc608b1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e419ab1-da", "ovs_interfaceid": "6e419ab1-da77-4fb6-906e-6e36966ad332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Converting VIF {"id": "6e419ab1-da77-4fb6-906e-6e36966ad332", "address": "fa:16:3e:85:6f:ef", "network": {"id": "e663753f-6aa2-4bd1-8565-bd8d0e0d9f28", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-412895202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292fdedf952f444f9782699bc608b1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e419ab1-da", "ovs_interfaceid": "6e419ab1-da77-4fb6-906e-6e36966ad332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:6f:ef,bridge_name='br-int',has_traffic_filtering=True,id=6e419ab1-da77-4fb6-906e-6e36966ad332,network=Network(e663753f-6aa2-4bd1-8565-bd8d0e0d9f28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e419ab1-da') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG nova.objects.instance [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lazy-loading 'pci_devices' on Instance uuid a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:41:44 user nova-compute[73497]:   <uuid>a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa</uuid>
Aug 26 23:41:44 user nova-compute[73497]:   <name>instance-0000002d</name>
Aug 26 23:41:44 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:41:44 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:41:44 user nova-compute[73497]:   <metadata>
Aug 26 23:41:44 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:41:44 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:41:44 user nova-compute[73497]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-772624928</nova:name>
Aug 26 23:41:44 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:41:44</nova:creationTime>
Aug 26 23:41:44 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:41:44 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:41:44 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:41:44 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:41:44 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:41:44 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:41:44 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:41:44 user nova-compute[73497]:       <nova:owner>
Aug 26 23:41:44 user nova-compute[73497]:         <nova:user uuid="67c2acf13c6b491a8d8cfaf56733b431">tempest-TestServerVolumeAttachmentScenario-888135645-project-member</nova:user>
Aug 26 23:41:44 user nova-compute[73497]:         <nova:project uuid="292fdedf952f444f9782699bc608b1e9">tempest-TestServerVolumeAttachmentScenario-888135645</nova:project>
Aug 26 23:41:44 user nova-compute[73497]:       </nova:owner>
Aug 26 23:41:44 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:41:44 user nova-compute[73497]:       <nova:ports>
Aug 26 23:41:44 user nova-compute[73497]:         <nova:port uuid="6e419ab1-da77-4fb6-906e-6e36966ad332">
Aug 26 23:41:44 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 23:41:44 user nova-compute[73497]:         </nova:port>
Aug 26 23:41:44 user nova-compute[73497]:       </nova:ports>
Aug 26 23:41:44 user nova-compute[73497]:     </nova:instance>
Aug 26 23:41:44 user nova-compute[73497]:   </metadata>
Aug 26 23:41:44 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:41:44 user nova-compute[73497]:     <system>
Aug 26 23:41:44 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:41:44 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:41:44 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:41:44 user nova-compute[73497]:       <entry name="serial">a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa</entry>
Aug 26 23:41:44 user nova-compute[73497]:       <entry name="uuid">a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa</entry>
Aug 26 23:41:44 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:41:44 user nova-compute[73497]:     </system>
Aug 26 23:41:44 user nova-compute[73497]:   </sysinfo>
Aug 26 23:41:44 user nova-compute[73497]:   <os>
Aug 26 23:41:44 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:41:44 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:41:44 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:41:44 user nova-compute[73497]:   </os>
Aug 26 23:41:44 user nova-compute[73497]:   <features>
Aug 26 23:41:44 user nova-compute[73497]:     <acpi/>
Aug 26 23:41:44 user nova-compute[73497]:     <apic/>
Aug 26 23:41:44 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:41:44 user nova-compute[73497]:   </features>
Aug 26 23:41:44 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:41:44 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:41:44 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:41:44 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:41:44 user nova-compute[73497]:   </clock>
Aug 26 23:41:44 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:41:44 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:41:44 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:41:44 user nova-compute[73497]:   </cpu>
Aug 26 23:41:44 user nova-compute[73497]:   <devices>
Aug 26 23:41:44 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:41:44 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:41:44 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa/disk"/>
Aug 26 23:41:44 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:41:44 user nova-compute[73497]:     </disk>
Aug 26 23:41:44 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:41:44 user nova-compute[73497]:       <mac address="fa:16:3e:85:6f:ef"/>
Aug 26 23:41:44 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:41:44 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:41:44 user nova-compute[73497]:       <target dev="tap6e419ab1-da"/>
Aug 26 23:41:44 user nova-compute[73497]:     </interface>
Aug 26 23:41:44 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:41:44 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa/console.log" append="off"/>
Aug 26 23:41:44 user nova-compute[73497]:     </serial>
Aug 26 23:41:44 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:41:44 user nova-compute[73497]:     <video>
Aug 26 23:41:44 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:41:44 user nova-compute[73497]:     </video>
Aug 26 23:41:44 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:41:44 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:41:44 user nova-compute[73497]:     </rng>
Aug 26 23:41:44 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:41:44 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:41:44 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:41:44 user nova-compute[73497]:     </memballoon>
Aug 26 23:41:44 user nova-compute[73497]:   </devices>
Aug 26 23:41:44 user nova-compute[73497]: </domain>
Aug 26 23:41:44 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:41:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-772624928',display_name='tempest-TestServerVolumeAttachmentScenario-server-772624928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-772624928',id=45,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIe7ZNjibRz58OLPP0Fk/zfKlg6iONwPXluBJ0RN8tumoGQ4yC35GkSVI8xe2/ukWKDRP8WRD5K/VyI3BlADpE3rW6GJIYQBRnYksulk0xyLYLLSP1511Fj6/zrDma70CQ==',key_name='tempest-keypair-968560332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='292fdedf952f444f9782699bc608b1e9',ramdisk_id='',reservation_id='r-rg68fbsf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-888135645',owner_user_name='tempest-TestServerVolumeAttachmentScenario-888135645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:41:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67c2acf13c6b491a8d8cfaf56733b431',uuid=a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e419ab1-da77-4fb6-906e-6e36966ad332", "address": "fa:16:3e:85:6f:ef", "network": {"id": "e663753f-6aa2-4bd1-8565-bd8d0e0d9f28", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-412895202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292fdedf952f444f9782699bc608b1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e419ab1-da", "ovs_interfaceid": "6e419ab1-da77-4fb6-906e-6e36966ad332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Converting VIF {"id": "6e419ab1-da77-4fb6-906e-6e36966ad332", "address": "fa:16:3e:85:6f:ef", "network": {"id": "e663753f-6aa2-4bd1-8565-bd8d0e0d9f28", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-412895202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292fdedf952f444f9782699bc608b1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e419ab1-da", "ovs_interfaceid": "6e419ab1-da77-4fb6-906e-6e36966ad332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:6f:ef,bridge_name='br-int',has_traffic_filtering=True,id=6e419ab1-da77-4fb6-906e-6e36966ad332,network=Network(e663753f-6aa2-4bd1-8565-bd8d0e0d9f28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e419ab1-da') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG os_vif [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:6f:ef,bridge_name='br-int',has_traffic_filtering=True,id=6e419ab1-da77-4fb6-906e-6e36966ad332,network=Network(e663753f-6aa2-4bd1-8565-bd8d0e0d9f28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e419ab1-da') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e419ab1-da, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6e419ab1-da, col_values=(('external_ids', {'iface-id': '6e419ab1-da77-4fb6-906e-6e36966ad332', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:6f:ef', 'vm-uuid': 'a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:44 user nova-compute[73497]: INFO os_vif [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:6f:ef,bridge_name='br-int',has_traffic_filtering=True,id=6e419ab1-da77-4fb6-906e-6e36966ad332,network=Network(e663753f-6aa2-4bd1-8565-bd8d0e0d9f28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e419ab1-da')
Aug 26 23:41:44 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] No VIF found with MAC fa:16:3e:85:6f:ef, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG nova.network.neutron [req-4b2a0082-566b-4966-89ea-5b68583593ed req-28e42bb5-9a57-4eed-a28c-d566be83bff6 service nova] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Updated VIF entry in instance network info cache for port 6e419ab1-da77-4fb6-906e-6e36966ad332. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG nova.network.neutron [req-4b2a0082-566b-4966-89ea-5b68583593ed req-28e42bb5-9a57-4eed-a28c-d566be83bff6 service nova] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Updating instance_info_cache with network_info: [{"id": "6e419ab1-da77-4fb6-906e-6e36966ad332", "address": "fa:16:3e:85:6f:ef", "network": {"id": "e663753f-6aa2-4bd1-8565-bd8d0e0d9f28", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-412895202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292fdedf952f444f9782699bc608b1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e419ab1-da", "ovs_interfaceid": "6e419ab1-da77-4fb6-906e-6e36966ad332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:41:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4b2a0082-566b-4966-89ea-5b68583593ed req-28e42bb5-9a57-4eed-a28c-d566be83bff6 service nova] Releasing lock "refresh_cache-a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:41:45 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:45 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:45 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:46 user nova-compute[73497]: DEBUG nova.compute.manager [req-9d330fc5-1de3-44ae-b5e2-2b96aab5d1bd req-193a15e2-2bac-4eab-9118-0d2a11ecc032 service nova] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Received event network-vif-plugged-6e419ab1-da77-4fb6-906e-6e36966ad332 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:41:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9d330fc5-1de3-44ae-b5e2-2b96aab5d1bd req-193a15e2-2bac-4eab-9118-0d2a11ecc032 service nova] Acquiring lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:41:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9d330fc5-1de3-44ae-b5e2-2b96aab5d1bd req-193a15e2-2bac-4eab-9118-0d2a11ecc032 service nova] Lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:41:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9d330fc5-1de3-44ae-b5e2-2b96aab5d1bd req-193a15e2-2bac-4eab-9118-0d2a11ecc032 service nova] Lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:41:46 user nova-compute[73497]: DEBUG nova.compute.manager [req-9d330fc5-1de3-44ae-b5e2-2b96aab5d1bd req-193a15e2-2bac-4eab-9118-0d2a11ecc032 service nova] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] No waiting events found dispatching network-vif-plugged-6e419ab1-da77-4fb6-906e-6e36966ad332 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:41:46 user nova-compute[73497]: WARNING nova.compute.manager [req-9d330fc5-1de3-44ae-b5e2-2b96aab5d1bd req-193a15e2-2bac-4eab-9118-0d2a11ecc032 service nova] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Received unexpected event network-vif-plugged-6e419ab1-da77-4fb6-906e-6e36966ad332 for instance with vm_state building and task_state spawning.
Aug 26 23:41:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:48 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693093308.1462219, a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:41:48 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] VM Resumed (Lifecycle Event)
Aug 26 23:41:48 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:41:48 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:41:48 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Instance spawned successfully.
Aug 26 23:41:48 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:41:48 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:41:48 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:41:48 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:41:48 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:41:48 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:41:48 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:41:48 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:41:48 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:41:48 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:41:48 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693093308.1478322, a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:41:48 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] VM Started (Lifecycle Event)
Aug 26 23:41:48 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:41:48 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:41:48 user nova-compute[73497]: DEBUG nova.compute.manager [req-13a6fba5-40ab-4ac5-a12d-d22849647eb6 req-f53982cd-e9c5-4afc-a52c-2082bd550e66 service nova] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Received event network-vif-plugged-6e419ab1-da77-4fb6-906e-6e36966ad332 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:41:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-13a6fba5-40ab-4ac5-a12d-d22849647eb6 req-f53982cd-e9c5-4afc-a52c-2082bd550e66 service nova] Acquiring lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:41:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-13a6fba5-40ab-4ac5-a12d-d22849647eb6 req-f53982cd-e9c5-4afc-a52c-2082bd550e66 service nova] Lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:41:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-13a6fba5-40ab-4ac5-a12d-d22849647eb6 req-f53982cd-e9c5-4afc-a52c-2082bd550e66 service nova] Lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:41:48 user nova-compute[73497]: DEBUG nova.compute.manager [req-13a6fba5-40ab-4ac5-a12d-d22849647eb6 req-f53982cd-e9c5-4afc-a52c-2082bd550e66 service nova] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] No waiting events found dispatching network-vif-plugged-6e419ab1-da77-4fb6-906e-6e36966ad332 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:41:48 user nova-compute[73497]: WARNING nova.compute.manager [req-13a6fba5-40ab-4ac5-a12d-d22849647eb6 req-f53982cd-e9c5-4afc-a52c-2082bd550e66 service nova] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Received unexpected event network-vif-plugged-6e419ab1-da77-4fb6-906e-6e36966ad332 for instance with vm_state building and task_state spawning.
Aug 26 23:41:48 user nova-compute[73497]: INFO nova.compute.manager [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Took 6.04 seconds to spawn the instance on the hypervisor.
Aug 26 23:41:48 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:41:48 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:41:48 user nova-compute[73497]: INFO nova.compute.manager [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Took 6.74 seconds to build instance.
Aug 26 23:41:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e71b6430-bbcc-4971-ab22-e037f605faeb tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.947s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:41:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:41:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:42:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:42:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:42:06 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:42:06 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:42:06 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:42:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:42:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:42:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:42:06 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:42:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:42:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:42:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:42:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:42:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:42:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:42:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:42:06 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:42:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:42:07 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:42:07 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:42:07 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8238MB free_disk=25.110218048095703GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:42:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:42:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:42:07 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 33fa5a5f-06a0-4afd-bf9c-661b0551c59c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:42:07 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 71518c06-a7d0-49fa-88de-ffb4af927f47 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:42:07 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:42:07 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:42:07 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:42:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:42:07 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:42:07 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:42:07 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:42:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.292s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:42:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:42:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:42:12 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:42:13 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:42:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:42:16 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:42:17 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:42:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:42:19 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:42:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:42:21 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:42:22 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:42:22 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:42:22 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Rebuilding the list of instances to heal {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 23:42:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-71518c06-a7d0-49fa-88de-ffb4af927f47" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:42:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-71518c06-a7d0-49fa-88de-ffb4af927f47" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:42:22 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:42:22 user nova-compute[73497]: DEBUG nova.objects.instance [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lazy-loading 'info_cache' on Instance uuid 71518c06-a7d0-49fa-88de-ffb4af927f47 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:42:22 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Updating instance_info_cache with network_info: [{"id": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "address": "fa:16:3e:ad:51:e7", "network": {"id": "1b5f252b-ef13-47fa-a49c-53f70d79ae43", "bridge": "br-int", "label": "tempest-TestShelveInstance-125614022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "216a6e017cd94bbe96525e413d893e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ec486c2-35", "ovs_interfaceid": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:42:22 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-71518c06-a7d0-49fa-88de-ffb4af927f47" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:42:22 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:42:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:42:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:42:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:42:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:42:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:42:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:42:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:42:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:42:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:42:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:42:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:42:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:42:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:42:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:42:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:42:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:42:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:42:50 user nova-compute[73497]: DEBUG nova.compute.manager [req-c33a3968-5e51-41c8-9c1f-7b0982bcb695 req-adf92e28-921f-489d-832a-409fb74e1804 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Received event network-changed-8ec486c2-3507-4e88-8c66-d3db44578a1b {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:42:50 user nova-compute[73497]: DEBUG nova.compute.manager [req-c33a3968-5e51-41c8-9c1f-7b0982bcb695 req-adf92e28-921f-489d-832a-409fb74e1804 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Refreshing instance network info cache due to event network-changed-8ec486c2-3507-4e88-8c66-d3db44578a1b. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:42:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c33a3968-5e51-41c8-9c1f-7b0982bcb695 req-adf92e28-921f-489d-832a-409fb74e1804 service nova] Acquiring lock "refresh_cache-71518c06-a7d0-49fa-88de-ffb4af927f47" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:42:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c33a3968-5e51-41c8-9c1f-7b0982bcb695 req-adf92e28-921f-489d-832a-409fb74e1804 service nova] Acquired lock "refresh_cache-71518c06-a7d0-49fa-88de-ffb4af927f47" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:42:50 user nova-compute[73497]: DEBUG nova.network.neutron [req-c33a3968-5e51-41c8-9c1f-7b0982bcb695 req-adf92e28-921f-489d-832a-409fb74e1804 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Refreshing network info cache for port 8ec486c2-3507-4e88-8c66-d3db44578a1b {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:42:50 user nova-compute[73497]: DEBUG nova.compute.manager [req-d623aafe-223a-429a-a147-fb5d977e1117 req-8c086550-1e2c-494e-9be5-03c8ac0e1bfa service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Received event network-changed-6f697dbb-ce2b-4cf2-a715-6bba7f18c40d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:42:50 user nova-compute[73497]: DEBUG nova.compute.manager [req-d623aafe-223a-429a-a147-fb5d977e1117 req-8c086550-1e2c-494e-9be5-03c8ac0e1bfa service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Refreshing instance network info cache due to event network-changed-6f697dbb-ce2b-4cf2-a715-6bba7f18c40d. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:42:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d623aafe-223a-429a-a147-fb5d977e1117 req-8c086550-1e2c-494e-9be5-03c8ac0e1bfa service nova] Acquiring lock "refresh_cache-33fa5a5f-06a0-4afd-bf9c-661b0551c59c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:42:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d623aafe-223a-429a-a147-fb5d977e1117 req-8c086550-1e2c-494e-9be5-03c8ac0e1bfa service nova] Acquired lock "refresh_cache-33fa5a5f-06a0-4afd-bf9c-661b0551c59c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:42:50 user nova-compute[73497]: DEBUG nova.network.neutron [req-d623aafe-223a-429a-a147-fb5d977e1117 req-8c086550-1e2c-494e-9be5-03c8ac0e1bfa service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Refreshing network info cache for port 6f697dbb-ce2b-4cf2-a715-6bba7f18c40d {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:42:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Acquiring lock "71518c06-a7d0-49fa-88de-ffb4af927f47" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:42:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lock "71518c06-a7d0-49fa-88de-ffb4af927f47" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:42:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Acquiring lock "71518c06-a7d0-49fa-88de-ffb4af927f47-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:42:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lock "71518c06-a7d0-49fa-88de-ffb4af927f47-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:42:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lock "71518c06-a7d0-49fa-88de-ffb4af927f47-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:42:50 user nova-compute[73497]: INFO nova.compute.manager [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Terminating instance
Aug 26 23:42:50 user nova-compute[73497]: DEBUG nova.compute.manager [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:42:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:42:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:42:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:42:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:42:50 user nova-compute[73497]: DEBUG nova.network.neutron [req-d623aafe-223a-429a-a147-fb5d977e1117 req-8c086550-1e2c-494e-9be5-03c8ac0e1bfa service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Updated VIF entry in instance network info cache for port 6f697dbb-ce2b-4cf2-a715-6bba7f18c40d. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:42:50 user nova-compute[73497]: DEBUG nova.network.neutron [req-d623aafe-223a-429a-a147-fb5d977e1117 req-8c086550-1e2c-494e-9be5-03c8ac0e1bfa service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Updating instance_info_cache with network_info: [{"id": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "address": "fa:16:3e:50:bb:5f", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f697dbb-ce", "ovs_interfaceid": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:42:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d623aafe-223a-429a-a147-fb5d977e1117 req-8c086550-1e2c-494e-9be5-03c8ac0e1bfa service nova] Releasing lock "refresh_cache-33fa5a5f-06a0-4afd-bf9c-661b0551c59c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:42:50 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Instance destroyed successfully.
Aug 26 23:42:50 user nova-compute[73497]: DEBUG nova.objects.instance [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lazy-loading 'resources' on Instance uuid 71518c06-a7d0-49fa-88de-ffb4af927f47 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:42:50 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T23:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1647360321',display_name='tempest-TestShelveInstance-server-1647360321',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1647360321',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxVoZl80WnvJYJlh+Emiq/FYRseABF+tnMH8/Nu6Tqd4TApwZ93uyb7meNhcldg7PthrIWqUW5HCXIe2CsTMsK6rSEmc5nqb7FAhWyDW0d7V7k8W7nfvRp0gAfaO0CY5A==',key_name='tempest-TestShelveInstance-1023296182',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:41:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='216a6e017cd94bbe96525e413d893e6d',ramdisk_id='',reservation_id='r-a97hsfck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2032732603',owner_user_name='tempest-TestShelveInstance-2032732603-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:41:30Z,user_data=None,user_id='77ec603ab2da4a3584b0e4b0bcf2984b',uuid=71518c06-a7d0-49fa-88de-ffb4af927f47,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "address": "fa:16:3e:ad:51:e7", "network": {"id": "1b5f252b-ef13-47fa-a49c-53f70d79ae43", "bridge": "br-int", "label": "tempest-TestShelveInstance-125614022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "216a6e017cd94bbe96525e413d893e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ec486c2-35", "ovs_interfaceid": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:42:50 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Converting VIF {"id": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "address": "fa:16:3e:ad:51:e7", "network": {"id": "1b5f252b-ef13-47fa-a49c-53f70d79ae43", "bridge": "br-int", "label": "tempest-TestShelveInstance-125614022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "216a6e017cd94bbe96525e413d893e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ec486c2-35", "ovs_interfaceid": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:42:50 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:51:e7,bridge_name='br-int',has_traffic_filtering=True,id=8ec486c2-3507-4e88-8c66-d3db44578a1b,network=Network(1b5f252b-ef13-47fa-a49c-53f70d79ae43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ec486c2-35') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:42:50 user nova-compute[73497]: DEBUG os_vif [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:51:e7,bridge_name='br-int',has_traffic_filtering=True,id=8ec486c2-3507-4e88-8c66-d3db44578a1b,network=Network(1b5f252b-ef13-47fa-a49c-53f70d79ae43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ec486c2-35') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ec486c2-35, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:42:51 user nova-compute[73497]: INFO os_vif [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:51:e7,bridge_name='br-int',has_traffic_filtering=True,id=8ec486c2-3507-4e88-8c66-d3db44578a1b,network=Network(1b5f252b-ef13-47fa-a49c-53f70d79ae43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ec486c2-35')
Aug 26 23:42:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnJQIZbW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:42:51 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:42:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cacb1b70-2aca-433e-ae56-de2601ffb119]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad847db-d780-470d-9a43-9df7ef1aeb19]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)
Aug 26 23:42:51 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 (non-flash)
Aug 26 23:42:51 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281c35e0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7'): ({'sdb'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Removing single pathed devices sdb {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd540161-ee12-45f8-92e2-932e91b6c7a4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf62cbd8-e929-4554-9853-7d6a62463a5d]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Flushing IO for device /dev/sdb {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b33945-2d22-4456-866e-d304ce9cbe0a]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG nova.network.neutron [req-c33a3968-5e51-41c8-9c1f-7b0982bcb695 req-adf92e28-921f-489d-832a-409fb74e1804 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Updated VIF entry in instance network info cache for port 8ec486c2-3507-4e88-8c66-d3db44578a1b. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG nova.network.neutron [req-c33a3968-5e51-41c8-9c1f-7b0982bcb695 req-adf92e28-921f-489d-832a-409fb74e1804 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Updating instance_info_cache with network_info: [{"id": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "address": "fa:16:3e:ad:51:e7", "network": {"id": "1b5f252b-ef13-47fa-a49c-53f70d79ae43", "bridge": "br-int", "label": "tempest-TestShelveInstance-125614022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "216a6e017cd94bbe96525e413d893e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ec486c2-35", "ovs_interfaceid": "8ec486c2-3507-4e88-8c66-d3db44578a1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-c33a3968-5e51-41c8-9c1f-7b0982bcb695 req-adf92e28-921f-489d-832a-409fb74e1804 service nova] Releasing lock "refresh_cache-71518c06-a7d0-49fa-88de-ffb4af927f47" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.069s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2951a72-8f91-4e95-bdc5-e87ae6ab3a0e]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_275f8a82', '/dev/disk/by-id/scsi-1SCST_BIO275f8a82-87751e6e8cdca3e0', '/dev/disk/by-id/scsi-23837373531653665') {{(pid=84617) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a993f844-681f-4c08-9e38-40b92228ed06]: (4, None) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4b95cf-f9ae-450a-b590-c66ae016238a]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3652d3e8-1ce6-4645-85c6-4c4f7c1890d5]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7, portal: 172.16.0.220,3260]
Aug 26 23:42:51 user nova-compute[73497]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7, portal: 172.16.0.220,3260] successful.
Aug 26 23:42:51 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aeb3670-7053-4f74-b7bd-38f1abc91254]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] <== disconnect_volume: return (321ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:42:51 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Deleting instance files /opt/stack/data/nova/instances/71518c06-a7d0-49fa-88de-ffb4af927f47_del
Aug 26 23:42:51 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Deletion of /opt/stack/data/nova/instances/71518c06-a7d0-49fa-88de-ffb4af927f47_del complete
Aug 26 23:42:51 user nova-compute[73497]: INFO nova.compute.manager [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 26 23:42:51 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:42:51 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:42:51 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Took 0.52 seconds to deallocate network for instance.
Aug 26 23:42:52 user nova-compute[73497]: DEBUG nova.compute.manager [req-6d144066-dedb-485e-92f5-43b8ab3dd30f req-46ebf1f3-d72f-42a5-b43c-edc298774473 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Received event network-vif-unplugged-8ec486c2-3507-4e88-8c66-d3db44578a1b {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:42:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6d144066-dedb-485e-92f5-43b8ab3dd30f req-46ebf1f3-d72f-42a5-b43c-edc298774473 service nova] Acquiring lock "71518c06-a7d0-49fa-88de-ffb4af927f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:42:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6d144066-dedb-485e-92f5-43b8ab3dd30f req-46ebf1f3-d72f-42a5-b43c-edc298774473 service nova] Lock "71518c06-a7d0-49fa-88de-ffb4af927f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:42:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6d144066-dedb-485e-92f5-43b8ab3dd30f req-46ebf1f3-d72f-42a5-b43c-edc298774473 service nova] Lock "71518c06-a7d0-49fa-88de-ffb4af927f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:42:52 user nova-compute[73497]: DEBUG nova.compute.manager [req-6d144066-dedb-485e-92f5-43b8ab3dd30f req-46ebf1f3-d72f-42a5-b43c-edc298774473 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] No waiting events found dispatching network-vif-unplugged-8ec486c2-3507-4e88-8c66-d3db44578a1b {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:42:52 user nova-compute[73497]: DEBUG nova.compute.manager [req-6d144066-dedb-485e-92f5-43b8ab3dd30f req-46ebf1f3-d72f-42a5-b43c-edc298774473 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Received event network-vif-unplugged-8ec486c2-3507-4e88-8c66-d3db44578a1b for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:42:52 user nova-compute[73497]: DEBUG nova.compute.manager [req-6d144066-dedb-485e-92f5-43b8ab3dd30f req-46ebf1f3-d72f-42a5-b43c-edc298774473 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Received event network-vif-plugged-8ec486c2-3507-4e88-8c66-d3db44578a1b {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:42:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6d144066-dedb-485e-92f5-43b8ab3dd30f req-46ebf1f3-d72f-42a5-b43c-edc298774473 service nova] Acquiring lock "71518c06-a7d0-49fa-88de-ffb4af927f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:42:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6d144066-dedb-485e-92f5-43b8ab3dd30f req-46ebf1f3-d72f-42a5-b43c-edc298774473 service nova] Lock "71518c06-a7d0-49fa-88de-ffb4af927f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:42:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6d144066-dedb-485e-92f5-43b8ab3dd30f req-46ebf1f3-d72f-42a5-b43c-edc298774473 service nova] Lock "71518c06-a7d0-49fa-88de-ffb4af927f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:42:52 user nova-compute[73497]: DEBUG nova.compute.manager [req-6d144066-dedb-485e-92f5-43b8ab3dd30f req-46ebf1f3-d72f-42a5-b43c-edc298774473 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] No waiting events found dispatching network-vif-plugged-8ec486c2-3507-4e88-8c66-d3db44578a1b {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:42:52 user nova-compute[73497]: WARNING nova.compute.manager [req-6d144066-dedb-485e-92f5-43b8ab3dd30f req-46ebf1f3-d72f-42a5-b43c-edc298774473 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Received unexpected event network-vif-plugged-8ec486c2-3507-4e88-8c66-d3db44578a1b for instance with vm_state active and task_state deleting.
Aug 26 23:42:52 user nova-compute[73497]: DEBUG nova.compute.manager [req-6d144066-dedb-485e-92f5-43b8ab3dd30f req-46ebf1f3-d72f-42a5-b43c-edc298774473 service nova] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Received event network-vif-deleted-8ec486c2-3507-4e88-8c66-d3db44578a1b {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:42:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:42:52 user nova-compute[73497]: INFO nova.compute.manager [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Took 0.79 seconds to detach 1 volumes for instance.
Aug 26 23:42:52 user nova-compute[73497]: DEBUG nova.compute.manager [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Deleting volume: ce5a9d29-f8c4-4612-b9a8-20cc8dc36ee7 {{(pid=73497) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 23:42:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:42:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:42:52 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:42:52 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:42:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.170s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:42:53 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Deleted allocations for instance 71518c06-a7d0-49fa-88de-ffb4af927f47
Aug 26 23:42:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-20caa344-a5f8-4518-a116-e703ce2cdccf tempest-TestShelveInstance-2032732603 tempest-TestShelveInstance-2032732603-project-member] Lock "71518c06-a7d0-49fa-88de-ffb4af927f47" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.924s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:42:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:42:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e700cb0b-3bf2-4c6a-8443-41f6d700288c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:42:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e700cb0b-3bf2-4c6a-8443-41f6d700288c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:42:56 user nova-compute[73497]: INFO nova.compute.manager [None req-e700cb0b-3bf2-4c6a-8443-41f6d700288c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Shelving
Aug 26 23:42:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:42:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:42:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:42:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:42:56 user nova-compute[73497]: DEBUG nova.compute.manager [req-f9db7607-d559-4ba0-b2e8-17cdd05c4a93 req-6545144f-5e67-4f70-9424-20b561f7102e service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Received event network-vif-unplugged-6f697dbb-ce2b-4cf2-a715-6bba7f18c40d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:42:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f9db7607-d559-4ba0-b2e8-17cdd05c4a93 req-6545144f-5e67-4f70-9424-20b561f7102e service nova] Acquiring lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:42:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f9db7607-d559-4ba0-b2e8-17cdd05c4a93 req-6545144f-5e67-4f70-9424-20b561f7102e service nova] Lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:42:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f9db7607-d559-4ba0-b2e8-17cdd05c4a93 req-6545144f-5e67-4f70-9424-20b561f7102e service nova] Lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:42:56 user nova-compute[73497]: DEBUG nova.compute.manager [req-f9db7607-d559-4ba0-b2e8-17cdd05c4a93 req-6545144f-5e67-4f70-9424-20b561f7102e service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] No waiting events found dispatching network-vif-unplugged-6f697dbb-ce2b-4cf2-a715-6bba7f18c40d {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:42:56 user nova-compute[73497]: WARNING nova.compute.manager [req-f9db7607-d559-4ba0-b2e8-17cdd05c4a93 req-6545144f-5e67-4f70-9424-20b561f7102e service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Received unexpected event network-vif-unplugged-6f697dbb-ce2b-4cf2-a715-6bba7f18c40d for instance with vm_state active and task_state shelving.
Aug 26 23:42:56 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Instance destroyed successfully.
Aug 26 23:42:57 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-e700cb0b-3bf2-4c6a-8443-41f6d700288c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Beginning cold snapshot process
Aug 26 23:42:57 user nova-compute[73497]: DEBUG nova.privsep.utils [None req-e700cb0b-3bf2-4c6a-8443-41f6d700288c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73497) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 23:42:57 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e700cb0b-3bf2-4c6a-8443-41f6d700288c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/disk /opt/stack/data/nova/instances/snapshots/tmp0x1su630/fd974dddcfa34e08a867b2e262bb3e17 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:42:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:42:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-e700cb0b-3bf2-4c6a-8443-41f6d700288c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/disk /opt/stack/data/nova/instances/snapshots/tmp0x1su630/fd974dddcfa34e08a867b2e262bb3e17" returned: 0 in 0.791s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:42:58 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-e700cb0b-3bf2-4c6a-8443-41f6d700288c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Snapshot extracted, beginning image upload
Aug 26 23:42:58 user nova-compute[73497]: DEBUG nova.compute.manager [req-97fb9181-1a61-4730-b547-493285d07991 req-89554e1c-5192-41dc-8a90-553c0116b3f0 service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Received event network-vif-plugged-6f697dbb-ce2b-4cf2-a715-6bba7f18c40d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:42:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-97fb9181-1a61-4730-b547-493285d07991 req-89554e1c-5192-41dc-8a90-553c0116b3f0 service nova] Acquiring lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:42:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-97fb9181-1a61-4730-b547-493285d07991 req-89554e1c-5192-41dc-8a90-553c0116b3f0 service nova] Lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:42:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-97fb9181-1a61-4730-b547-493285d07991 req-89554e1c-5192-41dc-8a90-553c0116b3f0 service nova] Lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:42:58 user nova-compute[73497]: DEBUG nova.compute.manager [req-97fb9181-1a61-4730-b547-493285d07991 req-89554e1c-5192-41dc-8a90-553c0116b3f0 service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] No waiting events found dispatching network-vif-plugged-6f697dbb-ce2b-4cf2-a715-6bba7f18c40d {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:42:58 user nova-compute[73497]: WARNING nova.compute.manager [req-97fb9181-1a61-4730-b547-493285d07991 req-89554e1c-5192-41dc-8a90-553c0116b3f0 service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Received unexpected event network-vif-plugged-6f697dbb-ce2b-4cf2-a715-6bba7f18c40d for instance with vm_state active and task_state shelving_image_uploading.
Aug 26 23:42:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:00 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-e700cb0b-3bf2-4c6a-8443-41f6d700288c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Snapshot image upload complete
Aug 26 23:43:00 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e700cb0b-3bf2-4c6a-8443-41f6d700288c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:43:00 user nova-compute[73497]: INFO nova.compute.manager [None req-e700cb0b-3bf2-4c6a-8443-41f6d700288c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Shelve offloading
Aug 26 23:43:00 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Instance destroyed successfully.
Aug 26 23:43:00 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e700cb0b-3bf2-4c6a-8443-41f6d700288c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:43:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e700cb0b-3bf2-4c6a-8443-41f6d700288c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "refresh_cache-33fa5a5f-06a0-4afd-bf9c-661b0551c59c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:43:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e700cb0b-3bf2-4c6a-8443-41f6d700288c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquired lock "refresh_cache-33fa5a5f-06a0-4afd-bf9c-661b0551c59c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:43:00 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e700cb0b-3bf2-4c6a-8443-41f6d700288c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:43:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:01 user nova-compute[73497]: DEBUG nova.network.neutron [None req-e700cb0b-3bf2-4c6a-8443-41f6d700288c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Updating instance_info_cache with network_info: [{"id": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "address": "fa:16:3e:50:bb:5f", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f697dbb-ce", "ovs_interfaceid": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:43:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e700cb0b-3bf2-4c6a-8443-41f6d700288c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Releasing lock "refresh_cache-33fa5a5f-06a0-4afd-bf9c-661b0551c59c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:43:02 user nova-compute[73497]: DEBUG nova.compute.manager [req-2a03f114-059b-4c63-b731-87dd4cbc678a req-68e8cb6b-362a-4ac4-9e60-6dc306962087 service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Received event network-changed-6f697dbb-ce2b-4cf2-a715-6bba7f18c40d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:43:02 user nova-compute[73497]: DEBUG nova.compute.manager [req-2a03f114-059b-4c63-b731-87dd4cbc678a req-68e8cb6b-362a-4ac4-9e60-6dc306962087 service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Refreshing instance network info cache due to event network-changed-6f697dbb-ce2b-4cf2-a715-6bba7f18c40d. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:43:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2a03f114-059b-4c63-b731-87dd4cbc678a req-68e8cb6b-362a-4ac4-9e60-6dc306962087 service nova] Acquiring lock "refresh_cache-33fa5a5f-06a0-4afd-bf9c-661b0551c59c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:43:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2a03f114-059b-4c63-b731-87dd4cbc678a req-68e8cb6b-362a-4ac4-9e60-6dc306962087 service nova] Acquired lock "refresh_cache-33fa5a5f-06a0-4afd-bf9c-661b0551c59c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:43:02 user nova-compute[73497]: DEBUG nova.network.neutron [req-2a03f114-059b-4c63-b731-87dd4cbc678a req-68e8cb6b-362a-4ac4-9e60-6dc306962087 service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Refreshing network info cache for port 6f697dbb-ce2b-4cf2-a715-6bba7f18c40d {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:43:02 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Instance destroyed successfully.
Aug 26 23:43:02 user nova-compute[73497]: DEBUG nova.objects.instance [None req-e700cb0b-3bf2-4c6a-8443-41f6d700288c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lazy-loading 'resources' on Instance uuid 33fa5a5f-06a0-4afd-bf9c-661b0551c59c {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:43:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-e700cb0b-3bf2-4c6a-8443-41f6d700288c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:40:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1939646178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1939646178',id=44,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/BBmC7PDKWpCXjrShRsaIFAVunnfvGtjuzOuDUph33qOLL47qVxaFsEkVtoeF8Y4TTbODvEYKrhjYpq5iRTc5NXXaBftXrloDo6lLtWoE84QT/Cfq9nCWjVN7TwNvilw==',key_name='tempest-keypair-2063120950',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:41:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f777a90b660e48cdb1f5a453fbe2f806',ramdisk_id='',reservation_id='r-wex81mon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-389793905',owner_user_name='tempest-AttachVolumeShelveTestJSON-389793905-project-member',shelved_at='2023-08-26T23:43:00.562866',shelved_host='user',shelved_image_id='7511f7b3-a8a5-4888-acb8-93eadd5126f3'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:42:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d0fa85485fe42fc8a3b884f71db5669',uuid=33fa5a5f-06a0-4afd-bf9c-661b0551c59c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "address": "fa:16:3e:50:bb:5f", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f697dbb-ce", "ovs_interfaceid": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:43:02 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e700cb0b-3bf2-4c6a-8443-41f6d700288c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Converting VIF {"id": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "address": "fa:16:3e:50:bb:5f", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f697dbb-ce", "ovs_interfaceid": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:43:02 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e700cb0b-3bf2-4c6a-8443-41f6d700288c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:bb:5f,bridge_name='br-int',has_traffic_filtering=True,id=6f697dbb-ce2b-4cf2-a715-6bba7f18c40d,network=Network(39b40d3c-dae0-4dcf-a0de-b77899879f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f697dbb-ce') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:43:02 user nova-compute[73497]: DEBUG os_vif [None req-e700cb0b-3bf2-4c6a-8443-41f6d700288c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:bb:5f,bridge_name='br-int',has_traffic_filtering=True,id=6f697dbb-ce2b-4cf2-a715-6bba7f18c40d,network=Network(39b40d3c-dae0-4dcf-a0de-b77899879f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f697dbb-ce') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:43:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f697dbb-ce, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:43:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:43:02 user nova-compute[73497]: INFO os_vif [None req-e700cb0b-3bf2-4c6a-8443-41f6d700288c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:bb:5f,bridge_name='br-int',has_traffic_filtering=True,id=6f697dbb-ce2b-4cf2-a715-6bba7f18c40d,network=Network(39b40d3c-dae0-4dcf-a0de-b77899879f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f697dbb-ce')
Aug 26 23:43:02 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-e700cb0b-3bf2-4c6a-8443-41f6d700288c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Deleting instance files /opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c_del
Aug 26 23:43:02 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-e700cb0b-3bf2-4c6a-8443-41f6d700288c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Deletion of /opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c_del complete
Aug 26 23:43:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:02 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-e700cb0b-3bf2-4c6a-8443-41f6d700288c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Deleted allocations for instance 33fa5a5f-06a0-4afd-bf9c-661b0551c59c
Aug 26 23:43:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e700cb0b-3bf2-4c6a-8443-41f6d700288c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:43:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e700cb0b-3bf2-4c6a-8443-41f6d700288c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:43:02 user nova-compute[73497]: DEBUG nova.objects.instance [None req-e700cb0b-3bf2-4c6a-8443-41f6d700288c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lazy-loading 'numa_topology' on Instance uuid 33fa5a5f-06a0-4afd-bf9c-661b0551c59c {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:43:02 user nova-compute[73497]: DEBUG nova.objects.base [None req-e700cb0b-3bf2-4c6a-8443-41f6d700288c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Object Instance<33fa5a5f-06a0-4afd-bf9c-661b0551c59c> lazy-loaded attributes: resources,numa_topology {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:43:02 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-e700cb0b-3bf2-4c6a-8443-41f6d700288c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:43:02 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-e700cb0b-3bf2-4c6a-8443-41f6d700288c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:43:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e700cb0b-3bf2-4c6a-8443-41f6d700288c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.126s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:43:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e700cb0b-3bf2-4c6a-8443-41f6d700288c tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.748s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:43:02 user nova-compute[73497]: DEBUG nova.network.neutron [req-2a03f114-059b-4c63-b731-87dd4cbc678a req-68e8cb6b-362a-4ac4-9e60-6dc306962087 service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Updated VIF entry in instance network info cache for port 6f697dbb-ce2b-4cf2-a715-6bba7f18c40d. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:43:02 user nova-compute[73497]: DEBUG nova.network.neutron [req-2a03f114-059b-4c63-b731-87dd4cbc678a req-68e8cb6b-362a-4ac4-9e60-6dc306962087 service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Updating instance_info_cache with network_info: [{"id": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "address": "fa:16:3e:50:bb:5f", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap6f697dbb-ce", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:43:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2a03f114-059b-4c63-b731-87dd4cbc678a req-68e8cb6b-362a-4ac4-9e60-6dc306962087 service nova] Releasing lock "refresh_cache-33fa5a5f-06a0-4afd-bf9c-661b0551c59c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:43:05 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693093370.9751966, 71518c06-a7d0-49fa-88de-ffb4af927f47 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:43:05 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] VM Stopped (Lifecycle Event)
Aug 26 23:43:05 user nova-compute[73497]: DEBUG nova.compute.manager [None req-287d7edc-2202-4b67-ab6c-2fef88c8f354 None None] [instance: 71518c06-a7d0-49fa-88de-ffb4af927f47] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:43:07 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:43:07 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:43:07 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:43:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:43:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:43:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:43:07 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:43:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:43:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:43:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:43:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:43:08 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:43:08 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:43:08 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8604MB free_disk=25.085147857666016GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:43:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:43:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:43:08 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:43:08 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:43:08 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:43:08 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:43:08 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:43:08 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:43:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:43:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:11 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693093376.9840074, 33fa5a5f-06a0-4afd-bf9c-661b0551c59c => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:43:11 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] VM Stopped (Lifecycle Event)
Aug 26 23:43:12 user nova-compute[73497]: DEBUG nova.compute.manager [None req-acbdfbcf-d493-43d3-9ca8-82ca9e000f7e None None] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:43:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:13 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:43:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Acquiring lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:43:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:43:13 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:43:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:43:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:43:13 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:43:13 user nova-compute[73497]: INFO nova.compute.claims [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Claim successful on node user
Aug 26 23:43:13 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:43:13 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:43:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.211s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:43:13 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:43:13 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:43:13 user nova-compute[73497]: DEBUG nova.network.neutron [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:43:13 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:43:13 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:43:13 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:43:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:43:13 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Creating image(s)
Aug 26 23:43:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Acquiring lock "/opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:43:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "/opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:43:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "/opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:43:13 user nova-compute[73497]: DEBUG nova.policy [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad03475a8f5948fcbc8f1c56ca7a0bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b4e25a5f524b9a9a68b736ac63c374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:43:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:43:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.172s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:43:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:43:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:43:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:43:14 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:43:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.172s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:43:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:43:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk 1073741824" returned: 0 in 0.054s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:43:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:43:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:43:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.176s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:43:14 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 23:43:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:43:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:43:14 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Cannot resize image /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 23:43:14 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:43:14 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Ensure instance console log exists: /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:43:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:43:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:43:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:43:14 user nova-compute[73497]: DEBUG nova.network.neutron [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Successfully created port: be3535c5-b3b6-4ba8-b65f-52aab2b14bd7 {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG nova.network.neutron [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Successfully updated port: be3535c5-b3b6-4ba8-b65f-52aab2b14bd7 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Acquiring lock "refresh_cache-b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Acquired lock "refresh_cache-b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG nova.network.neutron [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG nova.compute.manager [req-bef2f9eb-f5da-4e2a-84b6-ad919099b2ca req-13b0fb32-cca9-4add-8ca1-c95d89d271da service nova] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Received event network-changed-be3535c5-b3b6-4ba8-b65f-52aab2b14bd7 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG nova.compute.manager [req-bef2f9eb-f5da-4e2a-84b6-ad919099b2ca req-13b0fb32-cca9-4add-8ca1-c95d89d271da service nova] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Refreshing instance network info cache due to event network-changed-be3535c5-b3b6-4ba8-b65f-52aab2b14bd7. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-bef2f9eb-f5da-4e2a-84b6-ad919099b2ca req-13b0fb32-cca9-4add-8ca1-c95d89d271da service nova] Acquiring lock "refresh_cache-b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG nova.network.neutron [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG nova.network.neutron [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Updating instance_info_cache with network_info: [{"id": "be3535c5-b3b6-4ba8-b65f-52aab2b14bd7", "address": "fa:16:3e:9e:da:e1", "network": {"id": "0e605a84-41cf-4b4e-9c26-c97bc4635df8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-20815531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84b4e25a5f524b9a9a68b736ac63c374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3535c5-b3", "ovs_interfaceid": "be3535c5-b3b6-4ba8-b65f-52aab2b14bd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Releasing lock "refresh_cache-b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Instance network_info: |[{"id": "be3535c5-b3b6-4ba8-b65f-52aab2b14bd7", "address": "fa:16:3e:9e:da:e1", "network": {"id": "0e605a84-41cf-4b4e-9c26-c97bc4635df8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-20815531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84b4e25a5f524b9a9a68b736ac63c374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3535c5-b3", "ovs_interfaceid": "be3535c5-b3b6-4ba8-b65f-52aab2b14bd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-bef2f9eb-f5da-4e2a-84b6-ad919099b2ca req-13b0fb32-cca9-4add-8ca1-c95d89d271da service nova] Acquired lock "refresh_cache-b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG nova.network.neutron [req-bef2f9eb-f5da-4e2a-84b6-ad919099b2ca req-13b0fb32-cca9-4add-8ca1-c95d89d271da service nova] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Refreshing network info cache for port be3535c5-b3b6-4ba8-b65f-52aab2b14bd7 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Start _get_guest_xml network_info=[{"id": "be3535c5-b3b6-4ba8-b65f-52aab2b14bd7", "address": "fa:16:3e:9e:da:e1", "network": {"id": "0e605a84-41cf-4b4e-9c26-c97bc4635df8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-20815531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84b4e25a5f524b9a9a68b736ac63c374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3535c5-b3", "ovs_interfaceid": "be3535c5-b3b6-4ba8-b65f-52aab2b14bd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:43:15 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:43:15 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:43:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:43:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1372230139',display_name='tempest-SnapshotDataIntegrityTests-server-1372230139',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1372230139',id=46,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrDeQSWLaQk2aT4W//nQDr35jKm356Eei4uFN/RFJ8nOvpJZXruXwqVc6ZsnfkGZetRjoZyWlwNxZEqy0no4k9oSSK+uSHD8to4wRbYBvud2RMLsSjiyGAHuew3fhpi+Q==',key_name='tempest-keypair-1650802611',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84b4e25a5f524b9a9a68b736ac63c374',ramdisk_id='',reservation_id='r-0t9010l2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1593163983',owner_user_name='tempest-SnapshotDataIntegrityTests-1593163983-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:43:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad03475a8f5948fcbc8f1c56ca7a0bb7',uuid=b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be3535c5-b3b6-4ba8-b65f-52aab2b14bd7", "address": "fa:16:3e:9e:da:e1", "network": {"id": "0e605a84-41cf-4b4e-9c26-c97bc4635df8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-20815531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84b4e25a5f524b9a9a68b736ac63c374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3535c5-b3", "ovs_interfaceid": "be3535c5-b3b6-4ba8-b65f-52aab2b14bd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Converting VIF {"id": "be3535c5-b3b6-4ba8-b65f-52aab2b14bd7", "address": "fa:16:3e:9e:da:e1", "network": {"id": "0e605a84-41cf-4b4e-9c26-c97bc4635df8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-20815531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84b4e25a5f524b9a9a68b736ac63c374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3535c5-b3", "ovs_interfaceid": "be3535c5-b3b6-4ba8-b65f-52aab2b14bd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:da:e1,bridge_name='br-int',has_traffic_filtering=True,id=be3535c5-b3b6-4ba8-b65f-52aab2b14bd7,network=Network(0e605a84-41cf-4b4e-9c26-c97bc4635df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe3535c5-b3') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG nova.objects.instance [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lazy-loading 'pci_devices' on Instance uuid b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:43:15 user nova-compute[73497]:   <uuid>b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02</uuid>
Aug 26 23:43:15 user nova-compute[73497]:   <name>instance-0000002e</name>
Aug 26 23:43:15 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:43:15 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:43:15 user nova-compute[73497]:   <metadata>
Aug 26 23:43:15 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:43:15 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:43:15 user nova-compute[73497]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1372230139</nova:name>
Aug 26 23:43:15 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:43:15</nova:creationTime>
Aug 26 23:43:15 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:43:15 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:43:15 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:43:15 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:43:15 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:43:15 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:43:15 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:43:15 user nova-compute[73497]:       <nova:owner>
Aug 26 23:43:15 user nova-compute[73497]:         <nova:user uuid="ad03475a8f5948fcbc8f1c56ca7a0bb7">tempest-SnapshotDataIntegrityTests-1593163983-project-member</nova:user>
Aug 26 23:43:15 user nova-compute[73497]:         <nova:project uuid="84b4e25a5f524b9a9a68b736ac63c374">tempest-SnapshotDataIntegrityTests-1593163983</nova:project>
Aug 26 23:43:15 user nova-compute[73497]:       </nova:owner>
Aug 26 23:43:15 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 26 23:43:15 user nova-compute[73497]:       <nova:ports>
Aug 26 23:43:15 user nova-compute[73497]:         <nova:port uuid="be3535c5-b3b6-4ba8-b65f-52aab2b14bd7">
Aug 26 23:43:15 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 23:43:15 user nova-compute[73497]:         </nova:port>
Aug 26 23:43:15 user nova-compute[73497]:       </nova:ports>
Aug 26 23:43:15 user nova-compute[73497]:     </nova:instance>
Aug 26 23:43:15 user nova-compute[73497]:   </metadata>
Aug 26 23:43:15 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:43:15 user nova-compute[73497]:     <system>
Aug 26 23:43:15 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:43:15 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:43:15 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:43:15 user nova-compute[73497]:       <entry name="serial">b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02</entry>
Aug 26 23:43:15 user nova-compute[73497]:       <entry name="uuid">b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02</entry>
Aug 26 23:43:15 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:43:15 user nova-compute[73497]:     </system>
Aug 26 23:43:15 user nova-compute[73497]:   </sysinfo>
Aug 26 23:43:15 user nova-compute[73497]:   <os>
Aug 26 23:43:15 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:43:15 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:43:15 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:43:15 user nova-compute[73497]:   </os>
Aug 26 23:43:15 user nova-compute[73497]:   <features>
Aug 26 23:43:15 user nova-compute[73497]:     <acpi/>
Aug 26 23:43:15 user nova-compute[73497]:     <apic/>
Aug 26 23:43:15 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:43:15 user nova-compute[73497]:   </features>
Aug 26 23:43:15 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:43:15 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:43:15 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:43:15 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:43:15 user nova-compute[73497]:   </clock>
Aug 26 23:43:15 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:43:15 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:43:15 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:43:15 user nova-compute[73497]:   </cpu>
Aug 26 23:43:15 user nova-compute[73497]:   <devices>
Aug 26 23:43:15 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:43:15 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:43:15 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk"/>
Aug 26 23:43:15 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:43:15 user nova-compute[73497]:     </disk>
Aug 26 23:43:15 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:43:15 user nova-compute[73497]:       <mac address="fa:16:3e:9e:da:e1"/>
Aug 26 23:43:15 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:43:15 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:43:15 user nova-compute[73497]:       <target dev="tapbe3535c5-b3"/>
Aug 26 23:43:15 user nova-compute[73497]:     </interface>
Aug 26 23:43:15 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:43:15 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/console.log" append="off"/>
Aug 26 23:43:15 user nova-compute[73497]:     </serial>
Aug 26 23:43:15 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:43:15 user nova-compute[73497]:     <video>
Aug 26 23:43:15 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:43:15 user nova-compute[73497]:     </video>
Aug 26 23:43:15 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:43:15 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:43:15 user nova-compute[73497]:     </rng>
Aug 26 23:43:15 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:43:15 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:43:15 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:43:15 user nova-compute[73497]:     </memballoon>
Aug 26 23:43:15 user nova-compute[73497]:   </devices>
Aug 26 23:43:15 user nova-compute[73497]: </domain>
Aug 26 23:43:15 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:43:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1372230139',display_name='tempest-SnapshotDataIntegrityTests-server-1372230139',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1372230139',id=46,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrDeQSWLaQk2aT4W//nQDr35jKm356Eei4uFN/RFJ8nOvpJZXruXwqVc6ZsnfkGZetRjoZyWlwNxZEqy0no4k9oSSK+uSHD8to4wRbYBvud2RMLsSjiyGAHuew3fhpi+Q==',key_name='tempest-keypair-1650802611',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84b4e25a5f524b9a9a68b736ac63c374',ramdisk_id='',reservation_id='r-0t9010l2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1593163983',owner_user_name='tempest-SnapshotDataIntegrityTests-1593163983-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:43:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad03475a8f5948fcbc8f1c56ca7a0bb7',uuid=b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be3535c5-b3b6-4ba8-b65f-52aab2b14bd7", "address": "fa:16:3e:9e:da:e1", "network": {"id": "0e605a84-41cf-4b4e-9c26-c97bc4635df8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-20815531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84b4e25a5f524b9a9a68b736ac63c374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3535c5-b3", "ovs_interfaceid": "be3535c5-b3b6-4ba8-b65f-52aab2b14bd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Converting VIF {"id": "be3535c5-b3b6-4ba8-b65f-52aab2b14bd7", "address": "fa:16:3e:9e:da:e1", "network": {"id": "0e605a84-41cf-4b4e-9c26-c97bc4635df8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-20815531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84b4e25a5f524b9a9a68b736ac63c374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3535c5-b3", "ovs_interfaceid": "be3535c5-b3b6-4ba8-b65f-52aab2b14bd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:da:e1,bridge_name='br-int',has_traffic_filtering=True,id=be3535c5-b3b6-4ba8-b65f-52aab2b14bd7,network=Network(0e605a84-41cf-4b4e-9c26-c97bc4635df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe3535c5-b3') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG os_vif [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:da:e1,bridge_name='br-int',has_traffic_filtering=True,id=be3535c5-b3b6-4ba8-b65f-52aab2b14bd7,network=Network(0e605a84-41cf-4b4e-9c26-c97bc4635df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe3535c5-b3') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe3535c5-b3, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbe3535c5-b3, col_values=(('external_ids', {'iface-id': 'be3535c5-b3b6-4ba8-b65f-52aab2b14bd7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:da:e1', 'vm-uuid': 'b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:43:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:15 user nova-compute[73497]: INFO os_vif [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:da:e1,bridge_name='br-int',has_traffic_filtering=True,id=be3535c5-b3b6-4ba8-b65f-52aab2b14bd7,network=Network(0e605a84-41cf-4b4e-9c26-c97bc4635df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe3535c5-b3')
Aug 26 23:43:16 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:43:16 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] No VIF found with MAC fa:16:3e:9e:da:e1, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:43:16 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:43:16 user nova-compute[73497]: DEBUG nova.network.neutron [req-bef2f9eb-f5da-4e2a-84b6-ad919099b2ca req-13b0fb32-cca9-4add-8ca1-c95d89d271da service nova] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Updated VIF entry in instance network info cache for port be3535c5-b3b6-4ba8-b65f-52aab2b14bd7. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:43:16 user nova-compute[73497]: DEBUG nova.network.neutron [req-bef2f9eb-f5da-4e2a-84b6-ad919099b2ca req-13b0fb32-cca9-4add-8ca1-c95d89d271da service nova] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Updating instance_info_cache with network_info: [{"id": "be3535c5-b3b6-4ba8-b65f-52aab2b14bd7", "address": "fa:16:3e:9e:da:e1", "network": {"id": "0e605a84-41cf-4b4e-9c26-c97bc4635df8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-20815531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84b4e25a5f524b9a9a68b736ac63c374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3535c5-b3", "ovs_interfaceid": "be3535c5-b3b6-4ba8-b65f-52aab2b14bd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:43:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-bef2f9eb-f5da-4e2a-84b6-ad919099b2ca req-13b0fb32-cca9-4add-8ca1-c95d89d271da service nova] Releasing lock "refresh_cache-b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:43:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:17 user nova-compute[73497]: DEBUG nova.compute.manager [req-f190d0ec-bbe4-4618-bfcd-15ff4d611de8 req-a4ca9c16-7a35-4058-a3e8-d30401aa5b7d service nova] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Received event network-vif-plugged-be3535c5-b3b6-4ba8-b65f-52aab2b14bd7 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:43:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f190d0ec-bbe4-4618-bfcd-15ff4d611de8 req-a4ca9c16-7a35-4058-a3e8-d30401aa5b7d service nova] Acquiring lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:43:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f190d0ec-bbe4-4618-bfcd-15ff4d611de8 req-a4ca9c16-7a35-4058-a3e8-d30401aa5b7d service nova] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:43:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f190d0ec-bbe4-4618-bfcd-15ff4d611de8 req-a4ca9c16-7a35-4058-a3e8-d30401aa5b7d service nova] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:43:17 user nova-compute[73497]: DEBUG nova.compute.manager [req-f190d0ec-bbe4-4618-bfcd-15ff4d611de8 req-a4ca9c16-7a35-4058-a3e8-d30401aa5b7d service nova] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] No waiting events found dispatching network-vif-plugged-be3535c5-b3b6-4ba8-b65f-52aab2b14bd7 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:43:17 user nova-compute[73497]: WARNING nova.compute.manager [req-f190d0ec-bbe4-4618-bfcd-15ff4d611de8 req-a4ca9c16-7a35-4058-a3e8-d30401aa5b7d service nova] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Received unexpected event network-vif-plugged-be3535c5-b3b6-4ba8-b65f-52aab2b14bd7 for instance with vm_state building and task_state spawning.
Aug 26 23:43:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:19 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:43:19 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:43:19 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693093399.3548632, b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:43:19 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] VM Resumed (Lifecycle Event)
Aug 26 23:43:19 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:43:19 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:43:19 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Instance spawned successfully.
Aug 26 23:43:19 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:43:19 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:43:19 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:43:19 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:43:19 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:43:19 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:43:19 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:43:19 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:43:19 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:43:19 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:43:19 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693093399.3569074, b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:43:19 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] VM Started (Lifecycle Event)
Aug 26 23:43:19 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:43:19 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:43:19 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:43:19 user nova-compute[73497]: INFO nova.compute.manager [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Took 5.55 seconds to spawn the instance on the hypervisor.
Aug 26 23:43:19 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:43:19 user nova-compute[73497]: DEBUG nova.compute.manager [req-03054780-833d-4c25-905e-5b7ae06ecf8c req-79dfbdd9-1dcd-4754-9cbb-b752447c8897 service nova] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Received event network-vif-plugged-be3535c5-b3b6-4ba8-b65f-52aab2b14bd7 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:43:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-03054780-833d-4c25-905e-5b7ae06ecf8c req-79dfbdd9-1dcd-4754-9cbb-b752447c8897 service nova] Acquiring lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:43:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-03054780-833d-4c25-905e-5b7ae06ecf8c req-79dfbdd9-1dcd-4754-9cbb-b752447c8897 service nova] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:43:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-03054780-833d-4c25-905e-5b7ae06ecf8c req-79dfbdd9-1dcd-4754-9cbb-b752447c8897 service nova] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:43:19 user nova-compute[73497]: DEBUG nova.compute.manager [req-03054780-833d-4c25-905e-5b7ae06ecf8c req-79dfbdd9-1dcd-4754-9cbb-b752447c8897 service nova] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] No waiting events found dispatching network-vif-plugged-be3535c5-b3b6-4ba8-b65f-52aab2b14bd7 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:43:19 user nova-compute[73497]: WARNING nova.compute.manager [req-03054780-833d-4c25-905e-5b7ae06ecf8c req-79dfbdd9-1dcd-4754-9cbb-b752447c8897 service nova] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Received unexpected event network-vif-plugged-be3535c5-b3b6-4ba8-b65f-52aab2b14bd7 for instance with vm_state building and task_state spawning.
Aug 26 23:43:19 user nova-compute[73497]: INFO nova.compute.manager [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Took 6.07 seconds to build instance.
Aug 26 23:43:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9ea595e5-a9ee-4c64-beb9-aa3580884a48 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.182s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:43:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:22 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:43:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:23 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:43:23 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:43:23 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Skipping network cache update for instance because it has been migrated to another host. {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9886}}
Aug 26 23:43:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:43:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:43:23 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:43:23 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Updating instance_info_cache with network_info: [{"id": "6e419ab1-da77-4fb6-906e-6e36966ad332", "address": "fa:16:3e:85:6f:ef", "network": {"id": "e663753f-6aa2-4bd1-8565-bd8d0e0d9f28", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-412895202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292fdedf952f444f9782699bc608b1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e419ab1-da", "ovs_interfaceid": "6e419ab1-da77-4fb6-906e-6e36966ad332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:43:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:43:23 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:43:25 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:43:25 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:30 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:32 user nova-compute[73497]: DEBUG nova.compute.manager [req-310a1bdb-ae6b-4be2-8df7-83f7df176cf3 req-18f164a2-a114-4481-ac3b-4fdb25dfae34 service nova] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Received event network-changed-6e419ab1-da77-4fb6-906e-6e36966ad332 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:43:32 user nova-compute[73497]: DEBUG nova.compute.manager [req-310a1bdb-ae6b-4be2-8df7-83f7df176cf3 req-18f164a2-a114-4481-ac3b-4fdb25dfae34 service nova] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Refreshing instance network info cache due to event network-changed-6e419ab1-da77-4fb6-906e-6e36966ad332. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:43:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-310a1bdb-ae6b-4be2-8df7-83f7df176cf3 req-18f164a2-a114-4481-ac3b-4fdb25dfae34 service nova] Acquiring lock "refresh_cache-a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:43:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-310a1bdb-ae6b-4be2-8df7-83f7df176cf3 req-18f164a2-a114-4481-ac3b-4fdb25dfae34 service nova] Acquired lock "refresh_cache-a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:43:32 user nova-compute[73497]: DEBUG nova.network.neutron [req-310a1bdb-ae6b-4be2-8df7-83f7df176cf3 req-18f164a2-a114-4481-ac3b-4fdb25dfae34 service nova] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Refreshing network info cache for port 6e419ab1-da77-4fb6-906e-6e36966ad332 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:43:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:33 user nova-compute[73497]: DEBUG nova.network.neutron [req-310a1bdb-ae6b-4be2-8df7-83f7df176cf3 req-18f164a2-a114-4481-ac3b-4fdb25dfae34 service nova] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Updated VIF entry in instance network info cache for port 6e419ab1-da77-4fb6-906e-6e36966ad332. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:43:33 user nova-compute[73497]: DEBUG nova.network.neutron [req-310a1bdb-ae6b-4be2-8df7-83f7df176cf3 req-18f164a2-a114-4481-ac3b-4fdb25dfae34 service nova] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Updating instance_info_cache with network_info: [{"id": "6e419ab1-da77-4fb6-906e-6e36966ad332", "address": "fa:16:3e:85:6f:ef", "network": {"id": "e663753f-6aa2-4bd1-8565-bd8d0e0d9f28", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-412895202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292fdedf952f444f9782699bc608b1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e419ab1-da", "ovs_interfaceid": "6e419ab1-da77-4fb6-906e-6e36966ad332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:43:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-310a1bdb-ae6b-4be2-8df7-83f7df176cf3 req-18f164a2-a114-4481-ac3b-4fdb25dfae34 service nova] Releasing lock "refresh_cache-a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:43:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Acquiring lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:43:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:43:33 user nova-compute[73497]: DEBUG nova.objects.instance [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lazy-loading 'flavor' on Instance uuid a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:43:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:43:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Acquiring lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:43:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:43:33 user nova-compute[73497]: INFO nova.compute.manager [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Attaching volume 845e7e9d-4dd6-45f0-8741-a7c696ce0a61 to /dev/vdb
Aug 26 23:43:33 user nova-compute[73497]: DEBUG os_brick.utils [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:43:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:43:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:43:33 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[337be4fb-267a-44cb-ba4c-81a4192478ae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:43:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:43:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:43:33 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[114bf9d1-d049-46ed-8c1f-0f35ef45f22f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:43:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:43:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:43:33 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae5f59a-8dee-40a8-b1cc-61ab961efa6b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:43:33 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9b797f-7908-4960-8618-e182d4b25e30]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:43:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:43:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:43:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:43:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:43:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:43:33 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:43:33 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b57ddc-9b07-4c65-82cf-dee561d9c4fe]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:43:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:43:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:43:33 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:43:33 user nova-compute[73497]: DEBUG os_brick.utils [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:43:33 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Updating existing volume attachment record: 5e5f433b-8626-432a-a862-d315bf116f66 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:43:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:40 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:45 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:43:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LHZmyqvI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:43:51 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:43:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:43:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:43:51 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:43:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:43:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:43:51 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:43:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:43:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:43:51 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf2acb9-1a68-4372-b707-c9dec74178a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:43:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:43:51 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:43:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:43:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:43:51 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f924e5-32b7-483e-a36c-7aa126c19076]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:43:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61] added
Aug 26 23:43:51 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:43:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:43:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:43:51 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[24efdf08-05a7-496e-bfe4-8833385ff553]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:43:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:43:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:43:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:43:51 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec099763-c02c-406f-87ae-2eee6bf981aa]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:43:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:43:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LHZmyqvI {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:43:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LHZmyqvI" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:43:51 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2041b84c-cc66-49cf-a86b-04ba3f71bea2]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:43:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LHZmyqvI'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:43:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:43:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:43:51 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6156f697-7b37-4e89-8a55-c4da98b7969e]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:43:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:43:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:43:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:43:51 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae3ed96-1222-4557-b0a4-860f9166564b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:43:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 23:43:51 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:43:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 23:43:51 user nova-compute[73497]:  {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:43:51 user nova-compute[73497]: WARNING os_brick.initiator.connectors.iscsi [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 23:43:51 user nova-compute[73497]: 
Aug 26 23:43:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:43:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:43:51 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3967dc75-1739-4ec1-9e7d-575f82b551ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:43:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61, portal: 172.16.0.220,3260]
Aug 26 23:43:51 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61, portal: 172.16.0.220,3260] successful.
Aug 26 23:43:51 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:43:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:43:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:43:52 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2986eea-99dc-4709-af25-638fc90db40e]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:43:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:43:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:43:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:43:52 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[823b614d-28f8-4d6d-a718-5f69989302e4]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:43:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61 (non-flash)
Aug 26 23:43:52 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:43:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61 (non-flash)
Aug 26 23:43:52 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:43:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:43:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:43:52 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:43:52 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:43:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:43:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:43:52 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6281d4a-14ac-4608-aaf2-527a90d07e5a]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:43:52 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:43:53 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:43:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LHZmyqvI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:43:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:43:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26565626232356262', 'path': '/dev/sdb'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:43:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565626232356262', 'path': '/dev/sdb'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:43:53 user nova-compute[73497]: DEBUG nova.objects.instance [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lazy-loading 'flavor' on Instance uuid a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:43:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 23:43:53 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:43:53 user nova-compute[73497]:   <source dev="/dev/sdb"/>
Aug 26 23:43:53 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:43:53 user nova-compute[73497]:   <serial>845e7e9d-4dd6-45f0-8741-a7c696ce0a61</serial>
Aug 26 23:43:53 user nova-compute[73497]: </disk>
Aug 26 23:43:53 user nova-compute[73497]:  {{(pid=73497) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 23:43:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:43:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:43:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] No VIF found with MAC fa:16:3e:85:6f:ef, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:43:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-32d68033-cd4f-4e8d-8705-a62afa6380a0 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.089s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:43:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:43:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Acquiring lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:43:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:43:56 user nova-compute[73497]: DEBUG nova.objects.instance [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lazy-loading 'flavor' on Instance uuid a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:43:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:43:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Acquiring lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:43:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:43:56 user nova-compute[73497]: INFO nova.compute.manager [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Attaching volume d7eaf615-31e2-4eea-a892-923bf0f15c48 to /dev/vdc
Aug 26 23:43:56 user nova-compute[73497]: DEBUG os_brick.utils [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:43:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:43:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:43:56 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b6d67f-e870-482c-abf4-5e5aa58f22de]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:43:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:43:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:43:56 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b508cace-b0e4-4c8a-a721-5a04b2efa0c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:43:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:43:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:43:56 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d671fd-0e87-43dc-959c-ad0f870464ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:43:56 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a510b9-762e-48af-aca5-e5996665bf1b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:43:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:43:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:43:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:43:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:43:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:43:56 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:43:56 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a79e250-7dca-4908-a5c5-49a2c29d8cd2]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:43:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:43:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:43:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:43:56 user nova-compute[73497]: DEBUG os_brick.utils [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:43:56 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Updating existing volume attachment record: 5e94bb2b-be5f-4ec6-bad9-25487a7bb928 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:44:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:44:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:44:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:44:07 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:44:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PXGaHUfF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:44:07 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:44:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:44:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:44:07 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:44:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:44:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:44:07 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:44:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:44:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:44:07 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d9c065-6f97-4e0d-9efc-4d65427601c1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:44:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:44:07 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:44:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:44:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:44:07 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7e2ec5-8e0d-495d-aad9-e8036227870f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:44:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48] added
Aug 26 23:44:07 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:44:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:44:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:44:07 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eade271-82d6-47b1-ba67-de2c5f93afbe]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:44:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:44:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:44:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:44:07 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78cab1b-a9c6-4016-a7be-0b9a78bb5dcb]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:44:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:44:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PXGaHUfF {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:44:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PXGaHUfF" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:44:07 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b81708-aedc-49e2-98e3-e21fdd14404d]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:44:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PXGaHUfF'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:44:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:44:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:44:07 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[10723aa9-ba95-4b98-8980-955be03384fb]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:44:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:44:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:44:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:44:07 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd9ef5a-9bc1-426b-8a8a-d721aa466368]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:44:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61 (non-flash)
Aug 26 23:44:07 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:44:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61 (non-flash)
Aug 26 23:44:07 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:44:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:44:08 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:44:08 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5f496b-4c4d-4d4b-830c-88f98870ec57]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:44:08 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48, portal: 172.16.0.220,3260]
Aug 26 23:44:08 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48, portal: 172.16.0.220,3260] successful.
Aug 26 23:44:08 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:44:08 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:44:08 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:44:08 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c83d32-0602-4a82-b720-3781cdcd9823]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:44:08 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:44:08 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:44:08 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:44:08 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[328b5478-de1f-4143-9a26-abfbe70a6df5]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:44:08 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61 (non-flash)
Aug 26 23:44:08 user nova-compute[73497]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48 (non-flash)
Aug 26 23:44:08 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:44:08 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61 (non-flash)
Aug 26 23:44:08 user nova-compute[73497]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48 (non-flash)
Aug 26 23:44:08 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:44:08 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:44:08 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:44:08 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:44:08 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:44:08 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:44:08 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:44:08 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5306c3fa-32e6-405f-af32-e146749d63f2]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:44:08 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: None {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:44:08 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:44:08 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:44:09 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:44:09 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PXGaHUfF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:44:09 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:44:09 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23332643534633265', 'path': '/dev/sdc'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:44:09 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332643534633265', 'path': '/dev/sdc'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:44:09 user nova-compute[73497]: DEBUG nova.objects.instance [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lazy-loading 'flavor' on Instance uuid a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:44:09 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 23:44:09 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:44:09 user nova-compute[73497]:   <source dev="/dev/sdc"/>
Aug 26 23:44:09 user nova-compute[73497]:   <target dev="vdc" bus="virtio"/>
Aug 26 23:44:09 user nova-compute[73497]:   <serial>d7eaf615-31e2-4eea-a892-923bf0f15c48</serial>
Aug 26 23:44:09 user nova-compute[73497]: </disk>
Aug 26 23:44:09 user nova-compute[73497]:  {{(pid=73497) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 23:44:09 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:44:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:44:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:44:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:44:09 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:44:09 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:44:09 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:44:09 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:44:09 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] No VIF found with MAC fa:16:3e:85:6f:ef, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:44:09 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:44:09 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:44:09 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:44:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-aa8b6c78-102a-4292-b2f3-9214b8a8b62c tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.103s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:44:09 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:44:09 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:44:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:44:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:44:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:44:10 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:44:10 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:44:10 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:44:10 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:44:10 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8542MB free_disk=25.046009063720703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:44:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:44:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:44:10 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:44:10 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:44:10 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:44:10 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5d243a99-a125-4e65-91c4-25dbbc137e30 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Acquiring lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5d243a99-a125-4e65-91c4-25dbbc137e30 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:44:11 user nova-compute[73497]: INFO nova.compute.manager [None req-5d243a99-a125-4e65-91c4-25dbbc137e30 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Detaching volume d7eaf615-31e2-4eea-a892-923bf0f15c48
Aug 26 23:44:11 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.351s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:44:11 user nova-compute[73497]: INFO nova.virt.block_device [None req-5d243a99-a125-4e65-91c4-25dbbc137e30 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Attempting to driver detach volume d7eaf615-31e2-4eea-a892-923bf0f15c48 from mountpoint /dev/vdc
Aug 26 23:44:11 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-5d243a99-a125-4e65-91c4-25dbbc137e30 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Attempting to detach device vdc from instance a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa from the persistent domain config. {{(pid=73497) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-5d243a99-a125-4e65-91c4-25dbbc137e30 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:44:11 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:44:11 user nova-compute[73497]:   <source dev="/dev/sdc"/>
Aug 26 23:44:11 user nova-compute[73497]:   <target dev="vdc" bus="virtio"/>
Aug 26 23:44:11 user nova-compute[73497]:   <serial>d7eaf615-31e2-4eea-a892-923bf0f15c48</serial>
Aug 26 23:44:11 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 23:44:11 user nova-compute[73497]: </disk>
Aug 26 23:44:11 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:44:11 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-5d243a99-a125-4e65-91c4-25dbbc137e30 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Successfully detached device vdc from instance a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa from the persistent domain config.
Aug 26 23:44:11 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-5d243a99-a125-4e65-91c4-25dbbc137e30 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa from the live domain config. {{(pid=73497) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-5d243a99-a125-4e65-91c4-25dbbc137e30 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:44:11 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:44:11 user nova-compute[73497]:   <source dev="/dev/sdc"/>
Aug 26 23:44:11 user nova-compute[73497]:   <target dev="vdc" bus="virtio"/>
Aug 26 23:44:11 user nova-compute[73497]:   <serial>d7eaf615-31e2-4eea-a892-923bf0f15c48</serial>
Aug 26 23:44:11 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 23:44:11 user nova-compute[73497]: </disk>
Aug 26 23:44:11 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Received event <DeviceRemovedEvent: 1693093451.5869997, a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73497) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-5d243a99-a125-4e65-91c4-25dbbc137e30 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa {{(pid=73497) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 23:44:11 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-5d243a99-a125-4e65-91c4-25dbbc137e30 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Successfully detached device vdc from instance a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa from the live domain config.
Aug 26 23:44:11 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d243a99-a125-4e65-91c4-25dbbc137e30 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d243a99-a125-4e65-91c4-25dbbc137e30 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PXGaHUfF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:44:11 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-5d243a99-a125-4e65-91c4-25dbbc137e30 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:44:11 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-5d243a99-a125-4e65-91c4-25dbbc137e30 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-5d243a99-a125-4e65-91c4-25dbbc137e30 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d243a99-a125-4e65-91c4-25dbbc137e30 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[86340ea0-ce5c-46b6-9c19-0339fb85c2bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d1efda-00d7-4e71-801a-bb699ba9ece2]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d243a99-a125-4e65-91c4-25dbbc137e30 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61 (non-flash)
Aug 26 23:44:11 user nova-compute[73497]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48 (non-flash)
Aug 26 23:44:11 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d243a99-a125-4e65-91c4-25dbbc137e30 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61 (non-flash)
Aug 26 23:44:11 user nova-compute[73497]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48 (non-flash)
Aug 26 23:44:11 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d243a99-a125-4e65-91c4-25dbbc137e30 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282c53c430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48'): ({'sdc'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-5d243a99-a125-4e65-91c4-25dbbc137e30 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Removing single pathed devices sdc {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a967e565-9126-43dc-b775-4a8a7df5ca28]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aaab8f3-ae04-4a84-b8a6-bd0ad614cff6]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-5d243a99-a125-4e65-91c4-25dbbc137e30 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Flushing IO for device /dev/sdc {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51c7f7c-22a3-4b8a-ab9c-b051b3757502]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-5d243a99-a125-4e65-91c4-25dbbc137e30 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[666fe428-5d36-4819-908b-edee932aafc6]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-5d243a99-a125-4e65-91c4-25dbbc137e30 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-5d243a99-a125-4e65-91c4-25dbbc137e30 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] SCSI volumes sdc have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d243a99-a125-4e65-91c4-25dbbc137e30 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad2a5ad-4300-4318-abf2-6d6033208e48]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d243a99-a125-4e65-91c4-25dbbc137e30 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed46cc8-b4ba-4189-ab4d-f700b1c9fff2]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d243a99-a125-4e65-91c4-25dbbc137e30 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48, portal: 172.16.0.220,3260]
Aug 26 23:44:11 user nova-compute[73497]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48, portal: 172.16.0.220,3260] successful.
Aug 26 23:44:11 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7eaf615-31e2-4eea-a892-923bf0f15c48 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52e35ea-c3a9-49d1-9f1b-cbc1b225cbab]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d243a99-a125-4e65-91c4-25dbbc137e30 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-5d243a99-a125-4e65-91c4-25dbbc137e30 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d243a99-a125-4e65-91c4-25dbbc137e30 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] <== disconnect_volume: return (289ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:44:11 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d243a99-a125-4e65-91c4-25dbbc137e30 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:44:12 user nova-compute[73497]: DEBUG nova.objects.instance [None req-5d243a99-a125-4e65-91c4-25dbbc137e30 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lazy-loading 'flavor' on Instance uuid a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:44:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5d243a99-a125-4e65-91c4-25dbbc137e30 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.628s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:44:15 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:44:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:44:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:44:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:44:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:44:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:44:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:44:16 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:44:18 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:44:19 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:44:19 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:44:20 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:44:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:44:23 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:44:23 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Cleaning up deleted instances {{(pid=73497) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 23:44:23 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] There are 0 instances to clean {{(pid=73497) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 23:44:24 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:44:25 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:44:25 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:44:25 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Rebuilding the list of instances to heal {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 23:44:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:44:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:44:25 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:44:25 user nova-compute[73497]: DEBUG nova.objects.instance [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lazy-loading 'info_cache' on Instance uuid a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:44:25 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Updating instance_info_cache with network_info: [{"id": "6e419ab1-da77-4fb6-906e-6e36966ad332", "address": "fa:16:3e:85:6f:ef", "network": {"id": "e663753f-6aa2-4bd1-8565-bd8d0e0d9f28", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-412895202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292fdedf952f444f9782699bc608b1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e419ab1-da", "ovs_interfaceid": "6e419ab1-da77-4fb6-906e-6e36966ad332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:44:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:44:25 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:44:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:44:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:44:31 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:44:31 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Cleaning up deleted instances with incomplete migration  {{(pid=73497) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 23:44:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:44:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:44:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:44:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:44:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:44:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:44:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:44:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:44:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:44:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:44:48 user nova-compute[73497]: INFO nova.compute.manager [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Unshelving
Aug 26 23:44:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:44:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:44:48 user nova-compute[73497]: DEBUG nova.objects.instance [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lazy-loading 'pci_requests' on Instance uuid 33fa5a5f-06a0-4afd-bf9c-661b0551c59c {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:44:48 user nova-compute[73497]: DEBUG nova.objects.instance [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lazy-loading 'numa_topology' on Instance uuid 33fa5a5f-06a0-4afd-bf9c-661b0551c59c {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:44:48 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:44:48 user nova-compute[73497]: INFO nova.compute.claims [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Claim successful on node user
Aug 26 23:44:48 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:44:48 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:44:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.271s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:44:49 user nova-compute[73497]: INFO nova.network.neutron [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Updating port 6f697dbb-ce2b-4cf2-a715-6bba7f18c40d with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 26 23:44:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:44:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "refresh_cache-33fa5a5f-06a0-4afd-bf9c-661b0551c59c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:44:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquired lock "refresh_cache-33fa5a5f-06a0-4afd-bf9c-661b0551c59c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:44:49 user nova-compute[73497]: DEBUG nova.network.neutron [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:44:49 user nova-compute[73497]: DEBUG nova.compute.manager [req-4bb4ad58-7402-4ea1-b50c-dc807bb9301a req-a26b3a43-bc5d-475e-a0b9-dc79d23bac72 service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Received event network-changed-6f697dbb-ce2b-4cf2-a715-6bba7f18c40d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:44:49 user nova-compute[73497]: DEBUG nova.compute.manager [req-4bb4ad58-7402-4ea1-b50c-dc807bb9301a req-a26b3a43-bc5d-475e-a0b9-dc79d23bac72 service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Refreshing instance network info cache due to event network-changed-6f697dbb-ce2b-4cf2-a715-6bba7f18c40d. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:44:49 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4bb4ad58-7402-4ea1-b50c-dc807bb9301a req-a26b3a43-bc5d-475e-a0b9-dc79d23bac72 service nova] Acquiring lock "refresh_cache-33fa5a5f-06a0-4afd-bf9c-661b0551c59c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:44:50 user nova-compute[73497]: DEBUG nova.network.neutron [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Updating instance_info_cache with network_info: [{"id": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "address": "fa:16:3e:50:bb:5f", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f697dbb-ce", "ovs_interfaceid": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:44:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Releasing lock "refresh_cache-33fa5a5f-06a0-4afd-bf9c-661b0551c59c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:44:50 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:44:50 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Creating image(s)
Aug 26 23:44:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "/opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:44:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "/opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:44:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "/opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:44:50 user nova-compute[73497]: DEBUG nova.objects.instance [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lazy-loading 'trusted_certs' on Instance uuid 33fa5a5f-06a0-4afd-bf9c-661b0551c59c {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:44:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4bb4ad58-7402-4ea1-b50c-dc807bb9301a req-a26b3a43-bc5d-475e-a0b9-dc79d23bac72 service nova] Acquired lock "refresh_cache-33fa5a5f-06a0-4afd-bf9c-661b0551c59c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:44:50 user nova-compute[73497]: DEBUG nova.network.neutron [req-4bb4ad58-7402-4ea1-b50c-dc807bb9301a req-a26b3a43-bc5d-475e-a0b9-dc79d23bac72 service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Refreshing network info cache for port 6f697dbb-ce2b-4cf2-a715-6bba7f18c40d {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:44:50 user nova-compute[73497]: DEBUG nova.objects.base [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Object Instance<33fa5a5f-06a0-4afd-bf9c-661b0551c59c> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:44:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "0c2e0ea5333f3f17caca52f28c36f71d3fad0b6a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:44:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "0c2e0ea5333f3f17caca52f28c36f71d3fad0b6a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:44:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c2e0ea5333f3f17caca52f28c36f71d3fad0b6a.part --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:44:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:44:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c2e0ea5333f3f17caca52f28c36f71d3fad0b6a.part --force-share --output=json" returned: 0 in 0.182s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:44:51 user nova-compute[73497]: DEBUG nova.virt.images [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] 7511f7b3-a8a5-4888-acb8-93eadd5126f3 was qcow2, converting to raw {{(pid=73497) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 23:44:51 user nova-compute[73497]: DEBUG nova.privsep.utils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73497) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 23:44:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0c2e0ea5333f3f17caca52f28c36f71d3fad0b6a.part /opt/stack/data/nova/instances/_base/0c2e0ea5333f3f17caca52f28c36f71d3fad0b6a.converted {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:44:52 user nova-compute[73497]: DEBUG nova.network.neutron [req-4bb4ad58-7402-4ea1-b50c-dc807bb9301a req-a26b3a43-bc5d-475e-a0b9-dc79d23bac72 service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Updated VIF entry in instance network info cache for port 6f697dbb-ce2b-4cf2-a715-6bba7f18c40d. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:44:52 user nova-compute[73497]: DEBUG nova.network.neutron [req-4bb4ad58-7402-4ea1-b50c-dc807bb9301a req-a26b3a43-bc5d-475e-a0b9-dc79d23bac72 service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Updating instance_info_cache with network_info: [{"id": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "address": "fa:16:3e:50:bb:5f", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f697dbb-ce", "ovs_interfaceid": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:44:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4bb4ad58-7402-4ea1-b50c-dc807bb9301a req-a26b3a43-bc5d-475e-a0b9-dc79d23bac72 service nova] Releasing lock "refresh_cache-33fa5a5f-06a0-4afd-bf9c-661b0551c59c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:44:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0c2e0ea5333f3f17caca52f28c36f71d3fad0b6a.part /opt/stack/data/nova/instances/_base/0c2e0ea5333f3f17caca52f28c36f71d3fad0b6a.converted" returned: 0 in 0.647s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:44:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c2e0ea5333f3f17caca52f28c36f71d3fad0b6a.converted --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:44:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c2e0ea5333f3f17caca52f28c36f71d3fad0b6a.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:44:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "0c2e0ea5333f3f17caca52f28c36f71d3fad0b6a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.176s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:44:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c2e0ea5333f3f17caca52f28c36f71d3fad0b6a --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:44:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c2e0ea5333f3f17caca52f28c36f71d3fad0b6a --force-share --output=json" returned: 0 in 0.168s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:44:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "0c2e0ea5333f3f17caca52f28c36f71d3fad0b6a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:44:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "0c2e0ea5333f3f17caca52f28c36f71d3fad0b6a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:44:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c2e0ea5333f3f17caca52f28c36f71d3fad0b6a --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:44:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c2e0ea5333f3f17caca52f28c36f71d3fad0b6a --force-share --output=json" returned: 0 in 0.167s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:44:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0c2e0ea5333f3f17caca52f28c36f71d3fad0b6a,backing_fmt=raw /opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:44:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0c2e0ea5333f3f17caca52f28c36f71d3fad0b6a,backing_fmt=raw /opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/disk 1073741824" returned: 0 in 0.048s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:44:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "0c2e0ea5333f3f17caca52f28c36f71d3fad0b6a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:44:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c2e0ea5333f3f17caca52f28c36f71d3fad0b6a --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:44:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c2e0ea5333f3f17caca52f28c36f71d3fad0b6a --force-share --output=json" returned: 0 in 0.181s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:44:53 user nova-compute[73497]: DEBUG nova.objects.instance [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lazy-loading 'migration_context' on Instance uuid 33fa5a5f-06a0-4afd-bf9c-661b0551c59c {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:44:53 user nova-compute[73497]: DEBUG nova.objects.base [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Object Instance<33fa5a5f-06a0-4afd-bf9c-661b0551c59c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:44:53 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Rebasing disk image.
Aug 26 23:44:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:44:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.180s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:44:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 -F raw /opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/disk {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 -F raw /opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/disk" returned: 0 in 2.075s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Ensure instance console log exists: /opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Start _get_guest_xml network_info=[{"id": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "address": "fa:16:3e:50:bb:5f", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f697dbb-ce", "ovs_interfaceid": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='7dda818221cd6948e333dd0e89c16d6d',container_format='bare',created_at=2023-08-26T23:42:56Z,direct_url=<?>,disk_format='qcow2',id=7511f7b3-a8a5-4888-acb8-93eadd5126f3,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1939646178-shelved',owner='f777a90b660e48cdb1f5a453fbe2f806',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T23:43:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:44:55 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:44:55 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:44:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='7dda818221cd6948e333dd0e89c16d6d',container_format='bare',created_at=2023-08-26T23:42:56Z,direct_url=<?>,disk_format='qcow2',id=7511f7b3-a8a5-4888-acb8-93eadd5126f3,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1939646178-shelved',owner='f777a90b660e48cdb1f5a453fbe2f806',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T23:43:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG nova.objects.instance [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lazy-loading 'vcpu_model' on Instance uuid 33fa5a5f-06a0-4afd-bf9c-661b0551c59c {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG nova.objects.base [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Object Instance<33fa5a5f-06a0-4afd-bf9c-661b0551c59c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T23:40:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1939646178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1939646178',id=44,image_ref='7511f7b3-a8a5-4888-acb8-93eadd5126f3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2063120950',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:41:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f777a90b660e48cdb1f5a453fbe2f806',ramdisk_id='',reservation_id='r-wex81mon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-389793905',owner_user_name='tempest-AttachVolumeShelveTestJSON-389793905-project-member',shelved_at='2023-08-26T23:43:00.562866',shelved_host='user',shelved_image_id='7511f7b3-a8a5-4888-acb8-93eadd5126f3'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d0fa85485fe42fc8a3b884f71db5669',uuid=33fa5a5f-06a0-4afd-bf9c-661b0551c59c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "address": "fa:16:3e:50:bb:5f", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f697dbb-ce", "ovs_interfaceid": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Converting VIF {"id": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "address": "fa:16:3e:50:bb:5f", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f697dbb-ce", "ovs_interfaceid": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:bb:5f,bridge_name='br-int',has_traffic_filtering=True,id=6f697dbb-ce2b-4cf2-a715-6bba7f18c40d,network=Network(39b40d3c-dae0-4dcf-a0de-b77899879f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f697dbb-ce') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG nova.objects.instance [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lazy-loading 'pci_devices' on Instance uuid 33fa5a5f-06a0-4afd-bf9c-661b0551c59c {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG nova.objects.base [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Object Instance<33fa5a5f-06a0-4afd-bf9c-661b0551c59c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=73497) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:44:55 user nova-compute[73497]:   <uuid>33fa5a5f-06a0-4afd-bf9c-661b0551c59c</uuid>
Aug 26 23:44:55 user nova-compute[73497]:   <name>instance-0000002c</name>
Aug 26 23:44:55 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:44:55 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:44:55 user nova-compute[73497]:   <metadata>
Aug 26 23:44:55 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:44:55 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:44:55 user nova-compute[73497]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1939646178</nova:name>
Aug 26 23:44:55 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:44:55</nova:creationTime>
Aug 26 23:44:55 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:44:55 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:44:55 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:44:55 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:44:55 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:44:55 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:44:55 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:44:55 user nova-compute[73497]:       <nova:owner>
Aug 26 23:44:55 user nova-compute[73497]:         <nova:user uuid="7d0fa85485fe42fc8a3b884f71db5669">tempest-AttachVolumeShelveTestJSON-389793905-project-member</nova:user>
Aug 26 23:44:55 user nova-compute[73497]:         <nova:project uuid="f777a90b660e48cdb1f5a453fbe2f806">tempest-AttachVolumeShelveTestJSON-389793905</nova:project>
Aug 26 23:44:55 user nova-compute[73497]:       </nova:owner>
Aug 26 23:44:55 user nova-compute[73497]:       <nova:root type="image" uuid="7511f7b3-a8a5-4888-acb8-93eadd5126f3"/>
Aug 26 23:44:55 user nova-compute[73497]:       <nova:ports>
Aug 26 23:44:55 user nova-compute[73497]:         <nova:port uuid="6f697dbb-ce2b-4cf2-a715-6bba7f18c40d">
Aug 26 23:44:55 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 23:44:55 user nova-compute[73497]:         </nova:port>
Aug 26 23:44:55 user nova-compute[73497]:       </nova:ports>
Aug 26 23:44:55 user nova-compute[73497]:     </nova:instance>
Aug 26 23:44:55 user nova-compute[73497]:   </metadata>
Aug 26 23:44:55 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:44:55 user nova-compute[73497]:     <system>
Aug 26 23:44:55 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:44:55 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:44:55 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:44:55 user nova-compute[73497]:       <entry name="serial">33fa5a5f-06a0-4afd-bf9c-661b0551c59c</entry>
Aug 26 23:44:55 user nova-compute[73497]:       <entry name="uuid">33fa5a5f-06a0-4afd-bf9c-661b0551c59c</entry>
Aug 26 23:44:55 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:44:55 user nova-compute[73497]:     </system>
Aug 26 23:44:55 user nova-compute[73497]:   </sysinfo>
Aug 26 23:44:55 user nova-compute[73497]:   <os>
Aug 26 23:44:55 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:44:55 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:44:55 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:44:55 user nova-compute[73497]:   </os>
Aug 26 23:44:55 user nova-compute[73497]:   <features>
Aug 26 23:44:55 user nova-compute[73497]:     <acpi/>
Aug 26 23:44:55 user nova-compute[73497]:     <apic/>
Aug 26 23:44:55 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:44:55 user nova-compute[73497]:   </features>
Aug 26 23:44:55 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:44:55 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:44:55 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:44:55 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:44:55 user nova-compute[73497]:   </clock>
Aug 26 23:44:55 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:44:55 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:44:55 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:44:55 user nova-compute[73497]:   </cpu>
Aug 26 23:44:55 user nova-compute[73497]:   <devices>
Aug 26 23:44:55 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 26 23:44:55 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 23:44:55 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/disk"/>
Aug 26 23:44:55 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:44:55 user nova-compute[73497]:     </disk>
Aug 26 23:44:55 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:44:55 user nova-compute[73497]:       <mac address="fa:16:3e:50:bb:5f"/>
Aug 26 23:44:55 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:44:55 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:44:55 user nova-compute[73497]:       <target dev="tap6f697dbb-ce"/>
Aug 26 23:44:55 user nova-compute[73497]:     </interface>
Aug 26 23:44:55 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:44:55 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/console.log" append="off"/>
Aug 26 23:44:55 user nova-compute[73497]:     </serial>
Aug 26 23:44:55 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:44:55 user nova-compute[73497]:     <video>
Aug 26 23:44:55 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:44:55 user nova-compute[73497]:     </video>
Aug 26 23:44:55 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:44:55 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:44:55 user nova-compute[73497]:     </rng>
Aug 26 23:44:55 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:44:55 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:44:55 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:44:55 user nova-compute[73497]:     </memballoon>
Aug 26 23:44:55 user nova-compute[73497]:   </devices>
Aug 26 23:44:55 user nova-compute[73497]: </domain>
Aug 26 23:44:55 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T23:40:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1939646178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1939646178',id=44,image_ref='7511f7b3-a8a5-4888-acb8-93eadd5126f3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2063120950',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:41:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f777a90b660e48cdb1f5a453fbe2f806',ramdisk_id='',reservation_id='r-wex81mon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-389793905',owner_user_name='tempest-AttachVolumeShelveTestJSON-389793905-project-member',shelved_at='2023-08-26T23:43:00.562866',shelved_host='user',shelved_image_id='7511f7b3-a8a5-4888-acb8-93eadd5126f3'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d0fa85485fe42fc8a3b884f71db5669',uuid=33fa5a5f-06a0-4afd-bf9c-661b0551c59c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "address": "fa:16:3e:50:bb:5f", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f697dbb-ce", "ovs_interfaceid": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Converting VIF {"id": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "address": "fa:16:3e:50:bb:5f", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f697dbb-ce", "ovs_interfaceid": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:bb:5f,bridge_name='br-int',has_traffic_filtering=True,id=6f697dbb-ce2b-4cf2-a715-6bba7f18c40d,network=Network(39b40d3c-dae0-4dcf-a0de-b77899879f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f697dbb-ce') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG os_vif [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:bb:5f,bridge_name='br-int',has_traffic_filtering=True,id=6f697dbb-ce2b-4cf2-a715-6bba7f18c40d,network=Network(39b40d3c-dae0-4dcf-a0de-b77899879f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f697dbb-ce') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f697dbb-ce, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6f697dbb-ce, col_values=(('external_ids', {'iface-id': '6f697dbb-ce2b-4cf2-a715-6bba7f18c40d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:bb:5f', 'vm-uuid': '33fa5a5f-06a0-4afd-bf9c-661b0551c59c'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:44:55 user nova-compute[73497]: INFO os_vif [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:bb:5f,bridge_name='br-int',has_traffic_filtering=True,id=6f697dbb-ce2b-4cf2-a715-6bba7f18c40d,network=Network(39b40d3c-dae0-4dcf-a0de-b77899879f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f697dbb-ce')
Aug 26 23:44:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:44:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] No VIF found with MAC fa:16:3e:50:bb:5f, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:44:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:44:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:44:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:44:57 user nova-compute[73497]: DEBUG nova.compute.manager [req-facc0370-a49e-411d-89d8-29d73c9ba03e req-ee674660-9c7e-4614-bef3-caeeed9d84a9 service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Received event network-vif-plugged-6f697dbb-ce2b-4cf2-a715-6bba7f18c40d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:44:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-facc0370-a49e-411d-89d8-29d73c9ba03e req-ee674660-9c7e-4614-bef3-caeeed9d84a9 service nova] Acquiring lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:44:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-facc0370-a49e-411d-89d8-29d73c9ba03e req-ee674660-9c7e-4614-bef3-caeeed9d84a9 service nova] Lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:44:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-facc0370-a49e-411d-89d8-29d73c9ba03e req-ee674660-9c7e-4614-bef3-caeeed9d84a9 service nova] Lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:44:57 user nova-compute[73497]: DEBUG nova.compute.manager [req-facc0370-a49e-411d-89d8-29d73c9ba03e req-ee674660-9c7e-4614-bef3-caeeed9d84a9 service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] No waiting events found dispatching network-vif-plugged-6f697dbb-ce2b-4cf2-a715-6bba7f18c40d {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:44:57 user nova-compute[73497]: WARNING nova.compute.manager [req-facc0370-a49e-411d-89d8-29d73c9ba03e req-ee674660-9c7e-4614-bef3-caeeed9d84a9 service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Received unexpected event network-vif-plugged-6f697dbb-ce2b-4cf2-a715-6bba7f18c40d for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 23:44:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:44:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:44:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:44:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:44:59 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693093499.129157, 33fa5a5f-06a0-4afd-bf9c-661b0551c59c => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:44:59 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] VM Resumed (Lifecycle Event)
Aug 26 23:44:59 user nova-compute[73497]: DEBUG nova.compute.manager [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:44:59 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:44:59 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Instance spawned successfully.
Aug 26 23:44:59 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:44:59 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:44:59 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:44:59 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693093499.1300457, 33fa5a5f-06a0-4afd-bf9c-661b0551c59c => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:44:59 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] VM Started (Lifecycle Event)
Aug 26 23:44:59 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:44:59 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:44:59 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:44:59 user nova-compute[73497]: DEBUG nova.compute.manager [req-5add8f22-16da-4ecb-aefd-1cd34fcb183f req-1f997cf7-ae51-4eeb-9f26-b3fec80a1804 service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Received event network-vif-plugged-6f697dbb-ce2b-4cf2-a715-6bba7f18c40d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:44:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-5add8f22-16da-4ecb-aefd-1cd34fcb183f req-1f997cf7-ae51-4eeb-9f26-b3fec80a1804 service nova] Acquiring lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:44:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-5add8f22-16da-4ecb-aefd-1cd34fcb183f req-1f997cf7-ae51-4eeb-9f26-b3fec80a1804 service nova] Lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:44:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-5add8f22-16da-4ecb-aefd-1cd34fcb183f req-1f997cf7-ae51-4eeb-9f26-b3fec80a1804 service nova] Lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:44:59 user nova-compute[73497]: DEBUG nova.compute.manager [req-5add8f22-16da-4ecb-aefd-1cd34fcb183f req-1f997cf7-ae51-4eeb-9f26-b3fec80a1804 service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] No waiting events found dispatching network-vif-plugged-6f697dbb-ce2b-4cf2-a715-6bba7f18c40d {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:44:59 user nova-compute[73497]: WARNING nova.compute.manager [req-5add8f22-16da-4ecb-aefd-1cd34fcb183f req-1f997cf7-ae51-4eeb-9f26-b3fec80a1804 service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Received unexpected event network-vif-plugged-6f697dbb-ce2b-4cf2-a715-6bba7f18c40d for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 23:44:59 user nova-compute[73497]: DEBUG nova.compute.manager [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:44:59 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-5842ef06-50c6-480e-9c1c-d7b9feb305a0 tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.837s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:45:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:45:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ccc0ba19-b0f5-440b-9740-e382f32a99cf tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Acquiring lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:45:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ccc0ba19-b0f5-440b-9740-e382f32a99cf tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:45:01 user nova-compute[73497]: INFO nova.compute.manager [None req-ccc0ba19-b0f5-440b-9740-e382f32a99cf tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Detaching volume 845e7e9d-4dd6-45f0-8741-a7c696ce0a61
Aug 26 23:45:01 user nova-compute[73497]: INFO nova.virt.block_device [None req-ccc0ba19-b0f5-440b-9740-e382f32a99cf tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Attempting to driver detach volume 845e7e9d-4dd6-45f0-8741-a7c696ce0a61 from mountpoint /dev/vdb
Aug 26 23:45:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ccc0ba19-b0f5-440b-9740-e382f32a99cf tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Attempting to detach device vdb from instance a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa from the persistent domain config. {{(pid=73497) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 23:45:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-ccc0ba19-b0f5-440b-9740-e382f32a99cf tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:45:01 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:45:01 user nova-compute[73497]:   <source dev="/dev/sdb"/>
Aug 26 23:45:01 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:45:01 user nova-compute[73497]:   <serial>845e7e9d-4dd6-45f0-8741-a7c696ce0a61</serial>
Aug 26 23:45:01 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:45:01 user nova-compute[73497]: </disk>
Aug 26 23:45:01 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:45:01 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-ccc0ba19-b0f5-440b-9740-e382f32a99cf tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Successfully detached device vdb from instance a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa from the persistent domain config.
Aug 26 23:45:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ccc0ba19-b0f5-440b-9740-e382f32a99cf tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa from the live domain config. {{(pid=73497) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 23:45:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-ccc0ba19-b0f5-440b-9740-e382f32a99cf tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:45:01 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:45:01 user nova-compute[73497]:   <source dev="/dev/sdb"/>
Aug 26 23:45:01 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:45:01 user nova-compute[73497]:   <serial>845e7e9d-4dd6-45f0-8741-a7c696ce0a61</serial>
Aug 26 23:45:01 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:45:01 user nova-compute[73497]: </disk>
Aug 26 23:45:01 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Received event <DeviceRemovedEvent: 1693093502.3107967, a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73497) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-ccc0ba19-b0f5-440b-9740-e382f32a99cf tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa {{(pid=73497) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 23:45:02 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-ccc0ba19-b0f5-440b-9740-e382f32a99cf tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Successfully detached device vdb from instance a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa from the live domain config.
Aug 26 23:45:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccc0ba19-b0f5-440b-9740-e382f32a99cf tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc0ba19-b0f5-440b-9740-e382f32a99cf tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LHZmyqvI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:45:02 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-ccc0ba19-b0f5-440b-9740-e382f32a99cf tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:45:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-ccc0ba19-b0f5-440b-9740-e382f32a99cf tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-ccc0ba19-b0f5-440b-9740-e382f32a99cf tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc0ba19-b0f5-440b-9740-e382f32a99cf tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2239f5e-fac8-43de-9bfe-ce800037876d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d61dc3b-bf4b-4cfd-bf19-711158e8e9ea]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc0ba19-b0f5-440b-9740-e382f32a99cf tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61 (non-flash)
Aug 26 23:45:02 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc0ba19-b0f5-440b-9740-e382f32a99cf tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61 (non-flash)
Aug 26 23:45:02 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc0ba19-b0f5-440b-9740-e382f32a99cf tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281c56e200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61'): ({'sdb'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-ccc0ba19-b0f5-440b-9740-e382f32a99cf tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Removing single pathed devices sdb {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e8f8a0-e669-47e6-8818-987133eed0b7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b241ac52-719d-49cf-a58e-0490e04268e3]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-ccc0ba19-b0f5-440b-9740-e382f32a99cf tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Flushing IO for device /dev/sdb {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d738bfb-cd72-4503-a8c7-c48714eacf33]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-ccc0ba19-b0f5-440b-9740-e382f32a99cf tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c772b71-2832-418d-82d2-7bc1251d5053]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-ccc0ba19-b0f5-440b-9740-e382f32a99cf tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-ccc0ba19-b0f5-440b-9740-e382f32a99cf tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc0ba19-b0f5-440b-9740-e382f32a99cf tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a846897-041f-4f26-af00-ff7f08559fbd]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc0ba19-b0f5-440b-9740-e382f32a99cf tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5934ad6-2281-4221-b4bb-e27027ba7dfd]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc0ba19-b0f5-440b-9740-e382f32a99cf tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61, portal: 172.16.0.220,3260]
Aug 26 23:45:02 user nova-compute[73497]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61, portal: 172.16.0.220,3260] successful.
Aug 26 23:45:02 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:845e7e9d-4dd6-45f0-8741-a7c696ce0a61 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[51255ef1-14ed-4461-8352-db716a8c44c2]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc0ba19-b0f5-440b-9740-e382f32a99cf tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-ccc0ba19-b0f5-440b-9740-e382f32a99cf tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc0ba19-b0f5-440b-9740-e382f32a99cf tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] <== disconnect_volume: return (276ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccc0ba19-b0f5-440b-9740-e382f32a99cf tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:45:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:45:03 user nova-compute[73497]: DEBUG nova.objects.instance [None req-ccc0ba19-b0f5-440b-9740-e382f32a99cf tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lazy-loading 'flavor' on Instance uuid a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:45:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-ccc0ba19-b0f5-440b-9740-e382f32a99cf tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.866s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:45:04 user nova-compute[73497]: DEBUG nova.compute.manager [req-ec4d4318-549c-4ca2-8d3a-8252aa7caa48 req-cbd7fd79-710a-450e-8c1b-dd1c167e06cf service nova] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Received event network-changed-be3535c5-b3b6-4ba8-b65f-52aab2b14bd7 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:45:04 user nova-compute[73497]: DEBUG nova.compute.manager [req-ec4d4318-549c-4ca2-8d3a-8252aa7caa48 req-cbd7fd79-710a-450e-8c1b-dd1c167e06cf service nova] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Refreshing instance network info cache due to event network-changed-be3535c5-b3b6-4ba8-b65f-52aab2b14bd7. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:45:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ec4d4318-549c-4ca2-8d3a-8252aa7caa48 req-cbd7fd79-710a-450e-8c1b-dd1c167e06cf service nova] Acquiring lock "refresh_cache-b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:45:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ec4d4318-549c-4ca2-8d3a-8252aa7caa48 req-cbd7fd79-710a-450e-8c1b-dd1c167e06cf service nova] Acquired lock "refresh_cache-b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:45:04 user nova-compute[73497]: DEBUG nova.network.neutron [req-ec4d4318-549c-4ca2-8d3a-8252aa7caa48 req-cbd7fd79-710a-450e-8c1b-dd1c167e06cf service nova] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Refreshing network info cache for port be3535c5-b3b6-4ba8-b65f-52aab2b14bd7 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:45:05 user nova-compute[73497]: DEBUG nova.network.neutron [req-ec4d4318-549c-4ca2-8d3a-8252aa7caa48 req-cbd7fd79-710a-450e-8c1b-dd1c167e06cf service nova] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Updated VIF entry in instance network info cache for port be3535c5-b3b6-4ba8-b65f-52aab2b14bd7. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:45:05 user nova-compute[73497]: DEBUG nova.network.neutron [req-ec4d4318-549c-4ca2-8d3a-8252aa7caa48 req-cbd7fd79-710a-450e-8c1b-dd1c167e06cf service nova] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Updating instance_info_cache with network_info: [{"id": "be3535c5-b3b6-4ba8-b65f-52aab2b14bd7", "address": "fa:16:3e:9e:da:e1", "network": {"id": "0e605a84-41cf-4b4e-9c26-c97bc4635df8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-20815531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84b4e25a5f524b9a9a68b736ac63c374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3535c5-b3", "ovs_interfaceid": "be3535c5-b3b6-4ba8-b65f-52aab2b14bd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:45:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ec4d4318-549c-4ca2-8d3a-8252aa7caa48 req-cbd7fd79-710a-450e-8c1b-dd1c167e06cf service nova] Releasing lock "refresh_cache-b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:45:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:45:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:45:09 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:45:09 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:45:09 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:45:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:45:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:45:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:45:09 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:45:09 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:09 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:09 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:09 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:09 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:09 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:09 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:10 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:45:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Acquiring lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:45:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:45:10 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:45:10 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:45:10 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8399MB free_disk=25.019474029541016GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:45:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:45:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:45:10 user nova-compute[73497]: DEBUG nova.objects.instance [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lazy-loading 'flavor' on Instance uuid b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:45:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:45:10 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:45:10 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:45:10 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 33fa5a5f-06a0-4afd-bf9c-661b0551c59c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:45:10 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:45:10 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:45:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Acquiring lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:45:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:45:11 user nova-compute[73497]: INFO nova.compute.manager [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Attaching volume d8d221f2-8bf3-44db-9f4c-fd4b67e4e529 to /dev/vdb
Aug 26 23:45:11 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:45:11 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:45:11 user nova-compute[73497]: DEBUG os_brick.utils [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:45:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:11 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3229aa9-5a8d-411d-8dfd-2546e2f2a2d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:45:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:11 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31b78b2-9a7b-4c9e-aaf0-b0d3aeee76e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:45:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:11 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:45:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:45:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:11 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9723999a-dcb5-4a1b-a733-3330ebba8136]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:45:11 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae43dc14-ef0f-49cd-98f7-f098995805df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:45:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:45:11 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:45:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:45:11 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:45:11 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2049cda-59b6-45ef-bd44-068941f6795c]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:45:11 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:45:11 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:45:11 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:45:11 user nova-compute[73497]: DEBUG os_brick.utils [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:45:11 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Updating existing volume attachment record: 228852c3-2e0f-475f-9541-e680e48038c0 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:45:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:45:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:45:17 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:45:17 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:45:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:45:18 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:45:20 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:45:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:45:21 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:45:21 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:45:21 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JRXmslgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:45:21 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:45:21 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:45:21 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:45:21 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:45:21 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:45:21 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:45:21 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:45:21 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:21 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:21 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebf8691-68cf-4bdb-a2d1-5c38def98cc9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:45:21 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:45:21 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:45:21 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:21 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:21 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb64a4b-2117-4390-9830-5bc679602a09]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:45:21 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529] added
Aug 26 23:45:21 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:45:21 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:21 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:21 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d99a10b-c380-485a-a478-b64c499233b8]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:45:21 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:45:21 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:21 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:21 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[410c7e14-54ed-4617-bce5-2809fd8261f5]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:45:21 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:45:21 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JRXmslgp {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:21 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JRXmslgp" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:21 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[de111299-5364-4ad1-8f69-796178ebf557]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:45:21 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JRXmslgp'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:45:21 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:21 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:21 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d529a08-9f9d-4b5a-b4fa-a6263a509846]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:45:21 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:45:21 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:21 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:21 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2727f26-5884-4f39-b8ff-7b87d00fc451]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:45:21 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 23:45:21 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:45:21 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 23:45:21 user nova-compute[73497]:  {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:45:21 user nova-compute[73497]: WARNING os_brick.initiator.connectors.iscsi [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 23:45:21 user nova-compute[73497]: 
Aug 26 23:45:21 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:22 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:22 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[521552e7-2e4b-49c9-96c2-20b0b7021f8c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:45:22 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529, portal: 172.16.0.220,3260]
Aug 26 23:45:22 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529, portal: 172.16.0.220,3260] successful.
Aug 26 23:45:22 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:45:22 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:22 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:22 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba19d45a-059c-47ee-a49a-d0dbcd52a2da]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:45:22 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:45:22 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:22 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:22 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea32b7e-ba89-479c-8f1f-d28437ca7aa2]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:45:22 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529 (non-flash)
Aug 26 23:45:22 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:45:22 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529 (non-flash)
Aug 26 23:45:22 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:45:22 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:45:22 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:45:22 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:45:22 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:45:22 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:22 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:22 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6219b103-a1ab-4f7b-aa31-53e515afe4c8]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:45:22 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:45:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:45:23 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:45:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JRXmslgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:45:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.268s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:45:23 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] <== connect_volume: return (1270ms) {'type': 'block', 'scsi_wwn': '26536613361663638', 'path': '/dev/sdb'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:45:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536613361663638', 'path': '/dev/sdb'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:45:23 user nova-compute[73497]: DEBUG nova.objects.instance [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lazy-loading 'flavor' on Instance uuid b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:45:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 23:45:23 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:45:23 user nova-compute[73497]:   <source dev="/dev/sdb"/>
Aug 26 23:45:23 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:45:23 user nova-compute[73497]:   <serial>d8d221f2-8bf3-44db-9f4c-fd4b67e4e529</serial>
Aug 26 23:45:23 user nova-compute[73497]: </disk>
Aug 26 23:45:23 user nova-compute[73497]:  {{(pid=73497) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 23:45:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:45:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:45:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] No VIF found with MAC fa:16:3e:9e:da:e1, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:45:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b35891de-7d29-4cc3-8c15-d4bc1aec5550 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.662s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:45:25 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:45:26 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:45:26 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:45:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:45:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:45:26 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:45:26 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Updating instance_info_cache with network_info: [{"id": "be3535c5-b3b6-4ba8-b65f-52aab2b14bd7", "address": "fa:16:3e:9e:da:e1", "network": {"id": "0e605a84-41cf-4b4e-9c26-c97bc4635df8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-20815531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84b4e25a5f524b9a9a68b736ac63c374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3535c5-b3", "ovs_interfaceid": "be3535c5-b3b6-4ba8-b65f-52aab2b14bd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:45:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:45:26 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:45:26 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:45:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:45:27 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:45:30 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:45:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:45:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:45:40 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:45:45 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:45:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:45:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:45:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-583ee651-ca54-4e02-9051-3b891d55a5e5 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Acquiring lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:45:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-583ee651-ca54-4e02-9051-3b891d55a5e5 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:45:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-583ee651-ca54-4e02-9051-3b891d55a5e5 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Acquiring lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:45:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-583ee651-ca54-4e02-9051-3b891d55a5e5 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:45:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-583ee651-ca54-4e02-9051-3b891d55a5e5 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:45:51 user nova-compute[73497]: INFO nova.compute.manager [None req-583ee651-ca54-4e02-9051-3b891d55a5e5 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Terminating instance
Aug 26 23:45:51 user nova-compute[73497]: DEBUG nova.compute.manager [None req-583ee651-ca54-4e02-9051-3b891d55a5e5 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:45:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:45:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:45:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:45:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:45:52 user nova-compute[73497]: DEBUG nova.compute.manager [req-264fbece-9e55-4299-b4dd-0fe1399a4412 req-e6b44f2d-6f34-436e-a6c3-91d0aa858e06 service nova] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Received event network-vif-unplugged-6e419ab1-da77-4fb6-906e-6e36966ad332 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:45:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-264fbece-9e55-4299-b4dd-0fe1399a4412 req-e6b44f2d-6f34-436e-a6c3-91d0aa858e06 service nova] Acquiring lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:45:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-264fbece-9e55-4299-b4dd-0fe1399a4412 req-e6b44f2d-6f34-436e-a6c3-91d0aa858e06 service nova] Lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:45:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-264fbece-9e55-4299-b4dd-0fe1399a4412 req-e6b44f2d-6f34-436e-a6c3-91d0aa858e06 service nova] Lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:45:52 user nova-compute[73497]: DEBUG nova.compute.manager [req-264fbece-9e55-4299-b4dd-0fe1399a4412 req-e6b44f2d-6f34-436e-a6c3-91d0aa858e06 service nova] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] No waiting events found dispatching network-vif-unplugged-6e419ab1-da77-4fb6-906e-6e36966ad332 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:45:52 user nova-compute[73497]: DEBUG nova.compute.manager [req-264fbece-9e55-4299-b4dd-0fe1399a4412 req-e6b44f2d-6f34-436e-a6c3-91d0aa858e06 service nova] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Received event network-vif-unplugged-6e419ab1-da77-4fb6-906e-6e36966ad332 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:45:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:45:52 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Instance destroyed successfully.
Aug 26 23:45:52 user nova-compute[73497]: DEBUG nova.objects.instance [None req-583ee651-ca54-4e02-9051-3b891d55a5e5 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lazy-loading 'resources' on Instance uuid a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:45:52 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-583ee651-ca54-4e02-9051-3b891d55a5e5 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:41:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-772624928',display_name='tempest-TestServerVolumeAttachmentScenario-server-772624928',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-772624928',id=45,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIe7ZNjibRz58OLPP0Fk/zfKlg6iONwPXluBJ0RN8tumoGQ4yC35GkSVI8xe2/ukWKDRP8WRD5K/VyI3BlADpE3rW6GJIYQBRnYksulk0xyLYLLSP1511Fj6/zrDma70CQ==',key_name='tempest-keypair-968560332',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:41:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='292fdedf952f444f9782699bc608b1e9',ramdisk_id='',reservation_id='r-rg68fbsf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-888135645',owner_user_name='tempest-TestServerVolumeAttachmentScenario-888135645-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:41:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67c2acf13c6b491a8d8cfaf56733b431',uuid=a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e419ab1-da77-4fb6-906e-6e36966ad332", "address": "fa:16:3e:85:6f:ef", "network": {"id": "e663753f-6aa2-4bd1-8565-bd8d0e0d9f28", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-412895202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292fdedf952f444f9782699bc608b1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e419ab1-da", "ovs_interfaceid": "6e419ab1-da77-4fb6-906e-6e36966ad332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:45:52 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-583ee651-ca54-4e02-9051-3b891d55a5e5 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Converting VIF {"id": "6e419ab1-da77-4fb6-906e-6e36966ad332", "address": "fa:16:3e:85:6f:ef", "network": {"id": "e663753f-6aa2-4bd1-8565-bd8d0e0d9f28", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-412895202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292fdedf952f444f9782699bc608b1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e419ab1-da", "ovs_interfaceid": "6e419ab1-da77-4fb6-906e-6e36966ad332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:45:52 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-583ee651-ca54-4e02-9051-3b891d55a5e5 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:6f:ef,bridge_name='br-int',has_traffic_filtering=True,id=6e419ab1-da77-4fb6-906e-6e36966ad332,network=Network(e663753f-6aa2-4bd1-8565-bd8d0e0d9f28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e419ab1-da') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:45:52 user nova-compute[73497]: DEBUG os_vif [None req-583ee651-ca54-4e02-9051-3b891d55a5e5 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:6f:ef,bridge_name='br-int',has_traffic_filtering=True,id=6e419ab1-da77-4fb6-906e-6e36966ad332,network=Network(e663753f-6aa2-4bd1-8565-bd8d0e0d9f28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e419ab1-da') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:45:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:45:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e419ab1-da, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:45:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:45:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:45:52 user nova-compute[73497]: INFO os_vif [None req-583ee651-ca54-4e02-9051-3b891d55a5e5 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:6f:ef,bridge_name='br-int',has_traffic_filtering=True,id=6e419ab1-da77-4fb6-906e-6e36966ad332,network=Network(e663753f-6aa2-4bd1-8565-bd8d0e0d9f28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e419ab1-da')
Aug 26 23:45:52 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-583ee651-ca54-4e02-9051-3b891d55a5e5 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Deleting instance files /opt/stack/data/nova/instances/a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa_del
Aug 26 23:45:52 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-583ee651-ca54-4e02-9051-3b891d55a5e5 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Deletion of /opt/stack/data/nova/instances/a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa_del complete
Aug 26 23:45:52 user nova-compute[73497]: INFO nova.compute.manager [None req-583ee651-ca54-4e02-9051-3b891d55a5e5 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 26 23:45:52 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-583ee651-ca54-4e02-9051-3b891d55a5e5 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:45:52 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:45:52 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:45:53 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:45:53 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Took 1.01 seconds to deallocate network for instance.
Aug 26 23:45:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-583ee651-ca54-4e02-9051-3b891d55a5e5 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:45:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-583ee651-ca54-4e02-9051-3b891d55a5e5 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:45:53 user nova-compute[73497]: DEBUG nova.compute.manager [req-dd9952fc-fa03-447d-be6b-34b6048bcfa2 req-c19336a9-8685-4a69-8a27-aa0df776c800 service nova] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Received event network-vif-deleted-6e419ab1-da77-4fb6-906e-6e36966ad332 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:45:54 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-583ee651-ca54-4e02-9051-3b891d55a5e5 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:45:54 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-583ee651-ca54-4e02-9051-3b891d55a5e5 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:45:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-583ee651-ca54-4e02-9051-3b891d55a5e5 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.205s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:45:54 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-583ee651-ca54-4e02-9051-3b891d55a5e5 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Deleted allocations for instance a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa
Aug 26 23:45:54 user nova-compute[73497]: DEBUG nova.compute.manager [req-6fae52c0-6c1f-4641-a85e-14d5f30a286d req-c726c6a3-8a1b-49ec-8aca-0195f4bca7e8 service nova] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Received event network-vif-plugged-6e419ab1-da77-4fb6-906e-6e36966ad332 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:45:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6fae52c0-6c1f-4641-a85e-14d5f30a286d req-c726c6a3-8a1b-49ec-8aca-0195f4bca7e8 service nova] Acquiring lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:45:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6fae52c0-6c1f-4641-a85e-14d5f30a286d req-c726c6a3-8a1b-49ec-8aca-0195f4bca7e8 service nova] Lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:45:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6fae52c0-6c1f-4641-a85e-14d5f30a286d req-c726c6a3-8a1b-49ec-8aca-0195f4bca7e8 service nova] Lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:45:54 user nova-compute[73497]: DEBUG nova.compute.manager [req-6fae52c0-6c1f-4641-a85e-14d5f30a286d req-c726c6a3-8a1b-49ec-8aca-0195f4bca7e8 service nova] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] No waiting events found dispatching network-vif-plugged-6e419ab1-da77-4fb6-906e-6e36966ad332 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:45:54 user nova-compute[73497]: WARNING nova.compute.manager [req-6fae52c0-6c1f-4641-a85e-14d5f30a286d req-c726c6a3-8a1b-49ec-8aca-0195f4bca7e8 service nova] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Received unexpected event network-vif-plugged-6e419ab1-da77-4fb6-906e-6e36966ad332 for instance with vm_state deleted and task_state None.
Aug 26 23:45:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-583ee651-ca54-4e02-9051-3b891d55a5e5 tempest-TestServerVolumeAttachmentScenario-888135645 tempest-TestServerVolumeAttachmentScenario-888135645-project-member] Lock "a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.399s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:45:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-fff727af-e7b0-4273-8b49-bbb1ee1cb910 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Acquiring lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:45:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-fff727af-e7b0-4273-8b49-bbb1ee1cb910 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:45:55 user nova-compute[73497]: INFO nova.compute.manager [None req-fff727af-e7b0-4273-8b49-bbb1ee1cb910 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Detaching volume d8d221f2-8bf3-44db-9f4c-fd4b67e4e529
Aug 26 23:45:55 user nova-compute[73497]: INFO nova.virt.block_device [None req-fff727af-e7b0-4273-8b49-bbb1ee1cb910 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Attempting to driver detach volume d8d221f2-8bf3-44db-9f4c-fd4b67e4e529 from mountpoint /dev/vdb
Aug 26 23:45:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-fff727af-e7b0-4273-8b49-bbb1ee1cb910 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Attempting to detach device vdb from instance b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 from the persistent domain config. {{(pid=73497) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 23:45:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-fff727af-e7b0-4273-8b49-bbb1ee1cb910 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:45:55 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:45:55 user nova-compute[73497]:   <source dev="/dev/sdb"/>
Aug 26 23:45:55 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:45:55 user nova-compute[73497]:   <serial>d8d221f2-8bf3-44db-9f4c-fd4b67e4e529</serial>
Aug 26 23:45:55 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:45:55 user nova-compute[73497]: </disk>
Aug 26 23:45:55 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:45:55 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-fff727af-e7b0-4273-8b49-bbb1ee1cb910 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Successfully detached device vdb from instance b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 from the persistent domain config.
Aug 26 23:45:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-fff727af-e7b0-4273-8b49-bbb1ee1cb910 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 from the live domain config. {{(pid=73497) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 23:45:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-fff727af-e7b0-4273-8b49-bbb1ee1cb910 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:45:55 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:45:55 user nova-compute[73497]:   <source dev="/dev/sdb"/>
Aug 26 23:45:55 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:45:55 user nova-compute[73497]:   <serial>d8d221f2-8bf3-44db-9f4c-fd4b67e4e529</serial>
Aug 26 23:45:55 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:45:55 user nova-compute[73497]: </disk>
Aug 26 23:45:55 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Received event <DeviceRemovedEvent: 1693093556.1304588, b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73497) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-fff727af-e7b0-4273-8b49-bbb1ee1cb910 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 {{(pid=73497) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 23:45:56 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-fff727af-e7b0-4273-8b49-bbb1ee1cb910 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Successfully detached device vdb from instance b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 from the live domain config.
Aug 26 23:45:56 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fff727af-e7b0-4273-8b49-bbb1ee1cb910 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff727af-e7b0-4273-8b49-bbb1ee1cb910 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JRXmslgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:45:56 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-fff727af-e7b0-4273-8b49-bbb1ee1cb910 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:45:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-fff727af-e7b0-4273-8b49-bbb1ee1cb910 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-fff727af-e7b0-4273-8b49-bbb1ee1cb910 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff727af-e7b0-4273-8b49-bbb1ee1cb910 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cb8a93-1440-49a2-b12a-4683daa71504]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0182b151-0054-48e4-98e9-fb8967215f04]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff727af-e7b0-4273-8b49-bbb1ee1cb910 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529 (non-flash)
Aug 26 23:45:56 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff727af-e7b0-4273-8b49-bbb1ee1cb910 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529 (non-flash)
Aug 26 23:45:56 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff727af-e7b0-4273-8b49-bbb1ee1cb910 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282c53eef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529'): ({'sdb'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-fff727af-e7b0-4273-8b49-bbb1ee1cb910 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Removing single pathed devices sdb {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c0114a-a3f4-40b1-b9b6-3c1a2118f9a4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40b376e-93d4-46a8-a381-6ba76d32a71f]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-fff727af-e7b0-4273-8b49-bbb1ee1cb910 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Flushing IO for device /dev/sdb {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5941c6-4674-47f1-ac5e-24abc217e4f3]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-fff727af-e7b0-4273-8b49-bbb1ee1cb910 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[081dcbf0-559d-43d4-997e-c43a7fb09b4e]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-fff727af-e7b0-4273-8b49-bbb1ee1cb910 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-fff727af-e7b0-4273-8b49-bbb1ee1cb910 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff727af-e7b0-4273-8b49-bbb1ee1cb910 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0f6685-296e-4182-9ea6-7fa7bef84885]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff727af-e7b0-4273-8b49-bbb1ee1cb910 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ca6d89-8ea2-455a-b558-1f957df8cbb1]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff727af-e7b0-4273-8b49-bbb1ee1cb910 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529, portal: 172.16.0.220,3260]
Aug 26 23:45:56 user nova-compute[73497]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529, portal: 172.16.0.220,3260] successful.
Aug 26 23:45:56 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8d221f2-8bf3-44db-9f4c-fd4b67e4e529 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda1a36b-2674-438d-8bc7-00806a1ca9cc]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff727af-e7b0-4273-8b49-bbb1ee1cb910 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-fff727af-e7b0-4273-8b49-bbb1ee1cb910 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.244s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff727af-e7b0-4273-8b49-bbb1ee1cb910 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] <== disconnect_volume: return (245ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:45:56 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fff727af-e7b0-4273-8b49-bbb1ee1cb910 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:45:57 user nova-compute[73497]: DEBUG nova.objects.instance [None req-fff727af-e7b0-4273-8b49-bbb1ee1cb910 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lazy-loading 'flavor' on Instance uuid b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:45:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-fff727af-e7b0-4273-8b49-bbb1ee1cb910 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.592s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:45:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:46:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:46:07 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693093552.741902, a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:46:07 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] VM Stopped (Lifecycle Event)
Aug 26 23:46:07 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c7927194-5a6c-4fd2-b699-f7b6f13f5832 None None] [instance: a8650d4c-b5bc-4e5d-b214-a1c8be4ba0fa] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:46:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:46:10 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:46:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:46:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:46:10 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:46:10 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:46:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:46:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:46:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:46:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:46:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:46:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:46:10 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:46:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:46:11 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:46:11 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:46:11 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8550MB free_disk=25.03786849975586GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:46:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:46:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:46:11 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:46:11 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 33fa5a5f-06a0-4afd-bf9c-661b0551c59c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:46:11 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:46:11 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:46:11 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Refreshing inventories for resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 23:46:11 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Updating ProviderTree inventory for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 23:46:11 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Updating inventory in ProviderTree for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 23:46:11 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Refreshing aggregate associations for resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1, aggregates: None {{(pid=73497) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 23:46:11 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Refreshing trait associations for resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING {{(pid=73497) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 23:46:11 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:46:11 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:46:11 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:46:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.412s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:46:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:46:12 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:46:12 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:46:15 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:46:17 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:46:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:46:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:46:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:46:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:46:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:46:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:46:19 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:46:20 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:46:22 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:46:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:46:26 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:46:26 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:46:26 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Rebuilding the list of instances to heal {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 23:46:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-33fa5a5f-06a0-4afd-bf9c-661b0551c59c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:46:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-33fa5a5f-06a0-4afd-bf9c-661b0551c59c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:46:26 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:46:26 user nova-compute[73497]: DEBUG nova.objects.instance [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lazy-loading 'info_cache' on Instance uuid 33fa5a5f-06a0-4afd-bf9c-661b0551c59c {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:46:26 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Updating instance_info_cache with network_info: [{"id": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "address": "fa:16:3e:50:bb:5f", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f697dbb-ce", "ovs_interfaceid": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:46:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-33fa5a5f-06a0-4afd-bf9c-661b0551c59c" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:46:26 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:46:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:46:28 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:46:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:46:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:46:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e62f5dfe-a856-445b-8ebb-546b54f2461d tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:46:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e62f5dfe-a856-445b-8ebb-546b54f2461d tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:46:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e62f5dfe-a856-445b-8ebb-546b54f2461d tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:46:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e62f5dfe-a856-445b-8ebb-546b54f2461d tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:46:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e62f5dfe-a856-445b-8ebb-546b54f2461d tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:46:38 user nova-compute[73497]: INFO nova.compute.manager [None req-e62f5dfe-a856-445b-8ebb-546b54f2461d tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Terminating instance
Aug 26 23:46:38 user nova-compute[73497]: DEBUG nova.compute.manager [None req-e62f5dfe-a856-445b-8ebb-546b54f2461d tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:46:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:46:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:46:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:46:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:46:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:46:39 user nova-compute[73497]: DEBUG nova.compute.manager [req-827c8174-128d-47d8-bb52-b81649f1f558 req-e0528101-b306-4343-8d1e-329b344c19e9 service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Received event network-vif-unplugged-6f697dbb-ce2b-4cf2-a715-6bba7f18c40d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:46:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-827c8174-128d-47d8-bb52-b81649f1f558 req-e0528101-b306-4343-8d1e-329b344c19e9 service nova] Acquiring lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:46:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-827c8174-128d-47d8-bb52-b81649f1f558 req-e0528101-b306-4343-8d1e-329b344c19e9 service nova] Lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:46:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-827c8174-128d-47d8-bb52-b81649f1f558 req-e0528101-b306-4343-8d1e-329b344c19e9 service nova] Lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:46:39 user nova-compute[73497]: DEBUG nova.compute.manager [req-827c8174-128d-47d8-bb52-b81649f1f558 req-e0528101-b306-4343-8d1e-329b344c19e9 service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] No waiting events found dispatching network-vif-unplugged-6f697dbb-ce2b-4cf2-a715-6bba7f18c40d {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:46:39 user nova-compute[73497]: DEBUG nova.compute.manager [req-827c8174-128d-47d8-bb52-b81649f1f558 req-e0528101-b306-4343-8d1e-329b344c19e9 service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Received event network-vif-unplugged-6f697dbb-ce2b-4cf2-a715-6bba7f18c40d for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:46:39 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Instance destroyed successfully.
Aug 26 23:46:39 user nova-compute[73497]: DEBUG nova.objects.instance [None req-e62f5dfe-a856-445b-8ebb-546b54f2461d tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lazy-loading 'resources' on Instance uuid 33fa5a5f-06a0-4afd-bf9c-661b0551c59c {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:46:39 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-e62f5dfe-a856-445b-8ebb-546b54f2461d tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T23:40:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1939646178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1939646178',id=44,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/BBmC7PDKWpCXjrShRsaIFAVunnfvGtjuzOuDUph33qOLL47qVxaFsEkVtoeF8Y4TTbODvEYKrhjYpq5iRTc5NXXaBftXrloDo6lLtWoE84QT/Cfq9nCWjVN7TwNvilw==',key_name='tempest-keypair-2063120950',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:44:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f777a90b660e48cdb1f5a453fbe2f806',ramdisk_id='',reservation_id='r-wex81mon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-389793905',owner_user_name='tempest-AttachVolumeShelveTestJSON-389793905-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:44:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d0fa85485fe42fc8a3b884f71db5669',uuid=33fa5a5f-06a0-4afd-bf9c-661b0551c59c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "address": "fa:16:3e:50:bb:5f", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f697dbb-ce", "ovs_interfaceid": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:46:39 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e62f5dfe-a856-445b-8ebb-546b54f2461d tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Converting VIF {"id": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "address": "fa:16:3e:50:bb:5f", "network": {"id": "39b40d3c-dae0-4dcf-a0de-b77899879f8f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-339647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f777a90b660e48cdb1f5a453fbe2f806", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f697dbb-ce", "ovs_interfaceid": "6f697dbb-ce2b-4cf2-a715-6bba7f18c40d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:46:39 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-e62f5dfe-a856-445b-8ebb-546b54f2461d tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:bb:5f,bridge_name='br-int',has_traffic_filtering=True,id=6f697dbb-ce2b-4cf2-a715-6bba7f18c40d,network=Network(39b40d3c-dae0-4dcf-a0de-b77899879f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f697dbb-ce') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:46:39 user nova-compute[73497]: DEBUG os_vif [None req-e62f5dfe-a856-445b-8ebb-546b54f2461d tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:bb:5f,bridge_name='br-int',has_traffic_filtering=True,id=6f697dbb-ce2b-4cf2-a715-6bba7f18c40d,network=Network(39b40d3c-dae0-4dcf-a0de-b77899879f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f697dbb-ce') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:46:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:46:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f697dbb-ce, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:46:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:46:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:46:39 user nova-compute[73497]: INFO os_vif [None req-e62f5dfe-a856-445b-8ebb-546b54f2461d tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:bb:5f,bridge_name='br-int',has_traffic_filtering=True,id=6f697dbb-ce2b-4cf2-a715-6bba7f18c40d,network=Network(39b40d3c-dae0-4dcf-a0de-b77899879f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f697dbb-ce')
Aug 26 23:46:39 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-e62f5dfe-a856-445b-8ebb-546b54f2461d tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Deleting instance files /opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c_del
Aug 26 23:46:39 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-e62f5dfe-a856-445b-8ebb-546b54f2461d tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Deletion of /opt/stack/data/nova/instances/33fa5a5f-06a0-4afd-bf9c-661b0551c59c_del complete
Aug 26 23:46:39 user nova-compute[73497]: INFO nova.compute.manager [None req-e62f5dfe-a856-445b-8ebb-546b54f2461d tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 26 23:46:39 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-e62f5dfe-a856-445b-8ebb-546b54f2461d tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:46:39 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:46:39 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:46:40 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:46:40 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Took 0.77 seconds to deallocate network for instance.
Aug 26 23:46:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e62f5dfe-a856-445b-8ebb-546b54f2461d tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:46:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e62f5dfe-a856-445b-8ebb-546b54f2461d tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:46:40 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-e62f5dfe-a856-445b-8ebb-546b54f2461d tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:46:40 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-e62f5dfe-a856-445b-8ebb-546b54f2461d tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:46:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e62f5dfe-a856-445b-8ebb-546b54f2461d tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:46:40 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-e62f5dfe-a856-445b-8ebb-546b54f2461d tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Deleted allocations for instance 33fa5a5f-06a0-4afd-bf9c-661b0551c59c
Aug 26 23:46:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e62f5dfe-a856-445b-8ebb-546b54f2461d tempest-AttachVolumeShelveTestJSON-389793905 tempest-AttachVolumeShelveTestJSON-389793905-project-member] Lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.957s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:46:41 user nova-compute[73497]: DEBUG nova.compute.manager [req-e3bf835d-dcd6-4486-afd7-8b762d8c94fb req-aeadd909-0bbe-4b08-a412-ce9678002cbc service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Received event network-vif-plugged-6f697dbb-ce2b-4cf2-a715-6bba7f18c40d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:46:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-e3bf835d-dcd6-4486-afd7-8b762d8c94fb req-aeadd909-0bbe-4b08-a412-ce9678002cbc service nova] Acquiring lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:46:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-e3bf835d-dcd6-4486-afd7-8b762d8c94fb req-aeadd909-0bbe-4b08-a412-ce9678002cbc service nova] Lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:46:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-e3bf835d-dcd6-4486-afd7-8b762d8c94fb req-aeadd909-0bbe-4b08-a412-ce9678002cbc service nova] Lock "33fa5a5f-06a0-4afd-bf9c-661b0551c59c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:46:41 user nova-compute[73497]: DEBUG nova.compute.manager [req-e3bf835d-dcd6-4486-afd7-8b762d8c94fb req-aeadd909-0bbe-4b08-a412-ce9678002cbc service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] No waiting events found dispatching network-vif-plugged-6f697dbb-ce2b-4cf2-a715-6bba7f18c40d {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:46:41 user nova-compute[73497]: WARNING nova.compute.manager [req-e3bf835d-dcd6-4486-afd7-8b762d8c94fb req-aeadd909-0bbe-4b08-a412-ce9678002cbc service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Received unexpected event network-vif-plugged-6f697dbb-ce2b-4cf2-a715-6bba7f18c40d for instance with vm_state deleted and task_state None.
Aug 26 23:46:41 user nova-compute[73497]: DEBUG nova.compute.manager [req-e3bf835d-dcd6-4486-afd7-8b762d8c94fb req-aeadd909-0bbe-4b08-a412-ce9678002cbc service nova] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Received event network-vif-deleted-6f697dbb-ce2b-4cf2-a715-6bba7f18c40d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:46:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:46:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:46:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:46:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Acquiring lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:46:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:46:50 user nova-compute[73497]: DEBUG nova.objects.instance [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lazy-loading 'flavor' on Instance uuid b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:46:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:46:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Acquiring lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:46:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:46:50 user nova-compute[73497]: INFO nova.compute.manager [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Attaching volume e11b4490-3e90-41a3-bb0e-960c1ce7ddc5 to /dev/vdb
Aug 26 23:46:50 user nova-compute[73497]: DEBUG os_brick.utils [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:46:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:46:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:46:50 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fb83ba-d682-4073-8089-da361bd9b89f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:46:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:46:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:46:50 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db8b0b7-9a61-4652-9daf-5eeb3cc2b065]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:46:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:46:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:46:51 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab98ca3-a130-4b3f-a45a-a7b81a496d19]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:46:51 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b5723c-b399-4c8e-8e5c-a294463aed23]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:46:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:46:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:46:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:46:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:46:51 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:46:51 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:46:51 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf181436-14dd-4c95-a7e1-e41d62a2ef77]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:46:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:46:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:46:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:46:51 user nova-compute[73497]: DEBUG os_brick.utils [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:46:51 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Updating existing volume attachment record: eba58214-d99f-4de5-9dac-9cc3afaf2ac3 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:46:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:46:54 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693093599.7301736, 33fa5a5f-06a0-4afd-bf9c-661b0551c59c => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:46:54 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] VM Stopped (Lifecycle Event)
Aug 26 23:46:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:46:54 user nova-compute[73497]: DEBUG nova.compute.manager [None req-169e0286-06ea-4208-91da-33bccaa787b7 None None] [instance: 33fa5a5f-06a0-4afd-bf9c-661b0551c59c] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:46:58 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:46:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:47:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GmVypgLr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:47:02 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:47:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:47:02 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:47:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:47:02 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:47:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b41716-a8b7-487d-b6a6-53150d422e24]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:47:02 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[37af6faf-e48e-4fb2-bf93-397bbfd4fb77]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5] added
Aug 26 23:47:02 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2889116f-3742-4a7f-a23d-bebb9ed10276]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[031c7ae4-e78b-45f2-81ee-825615689330]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GmVypgLr {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GmVypgLr" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[011ab4ce-db9c-4bdd-939b-96a6cfcf0c48]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GmVypgLr'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[68eeb545-1a58-4a1a-a645-040dc83d41e7]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59260aa-844c-4613-9e90-e2b68cecebe2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 23:47:02 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 23:47:02 user nova-compute[73497]:  {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:47:02 user nova-compute[73497]: WARNING os_brick.initiator.connectors.iscsi [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 23:47:02 user nova-compute[73497]: 
Aug 26 23:47:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceddba44-9be5-4833-bbec-62757c445fdb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5, portal: 172.16.0.220,3260]
Aug 26 23:47:02 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5, portal: 172.16.0.220,3260] successful.
Aug 26 23:47:02 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e67b6bd-c04b-4e8c-a9da-eeea5bdcb3de]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c336dde1-e594-44f8-ab3f-342e5dfa8c06]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5 (non-flash)
Aug 26 23:47:02 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5 (non-flash)
Aug 26 23:47:02 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[673c2162-78cf-4bd3-8075-538cc8b415ec]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:47:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GmVypgLr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:47:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:47:03 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23232633937323032', 'path': '/dev/sdb'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:47:03 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232633937323032', 'path': '/dev/sdb'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:47:03 user nova-compute[73497]: DEBUG nova.objects.instance [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lazy-loading 'flavor' on Instance uuid b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:47:03 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 23:47:03 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:47:03 user nova-compute[73497]:   <source dev="/dev/sdb"/>
Aug 26 23:47:03 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:47:03 user nova-compute[73497]:   <serial>e11b4490-3e90-41a3-bb0e-960c1ce7ddc5</serial>
Aug 26 23:47:03 user nova-compute[73497]: </disk>
Aug 26 23:47:03 user nova-compute[73497]:  {{(pid=73497) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 23:47:03 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:47:03 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:47:03 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] No VIF found with MAC fa:16:3e:9e:da:e1, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:47:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4a39a637-08ce-4d34-aae6-2f114ce506a9 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.242s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:47:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:47:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:47:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f0e136a7-f75e-4074-84a5-b4a91c910844 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Acquiring lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:47:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f0e136a7-f75e-4074-84a5-b4a91c910844 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:47:06 user nova-compute[73497]: INFO nova.compute.manager [None req-f0e136a7-f75e-4074-84a5-b4a91c910844 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Detaching volume e11b4490-3e90-41a3-bb0e-960c1ce7ddc5
Aug 26 23:47:06 user nova-compute[73497]: INFO nova.virt.block_device [None req-f0e136a7-f75e-4074-84a5-b4a91c910844 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Attempting to driver detach volume e11b4490-3e90-41a3-bb0e-960c1ce7ddc5 from mountpoint /dev/vdb
Aug 26 23:47:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-f0e136a7-f75e-4074-84a5-b4a91c910844 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Attempting to detach device vdb from instance b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 from the persistent domain config. {{(pid=73497) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 23:47:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-f0e136a7-f75e-4074-84a5-b4a91c910844 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:47:06 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:47:06 user nova-compute[73497]:   <source dev="/dev/sdb"/>
Aug 26 23:47:06 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:47:06 user nova-compute[73497]:   <serial>e11b4490-3e90-41a3-bb0e-960c1ce7ddc5</serial>
Aug 26 23:47:06 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:47:06 user nova-compute[73497]: </disk>
Aug 26 23:47:06 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:47:06 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-f0e136a7-f75e-4074-84a5-b4a91c910844 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Successfully detached device vdb from instance b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 from the persistent domain config.
Aug 26 23:47:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-f0e136a7-f75e-4074-84a5-b4a91c910844 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 from the live domain config. {{(pid=73497) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 23:47:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-f0e136a7-f75e-4074-84a5-b4a91c910844 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:47:06 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:47:06 user nova-compute[73497]:   <source dev="/dev/sdb"/>
Aug 26 23:47:06 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:47:06 user nova-compute[73497]:   <serial>e11b4490-3e90-41a3-bb0e-960c1ce7ddc5</serial>
Aug 26 23:47:06 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:47:06 user nova-compute[73497]: </disk>
Aug 26 23:47:06 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Received event <DeviceRemovedEvent: 1693093627.214676, b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73497) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-f0e136a7-f75e-4074-84a5-b4a91c910844 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 {{(pid=73497) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 23:47:07 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-f0e136a7-f75e-4074-84a5-b4a91c910844 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Successfully detached device vdb from instance b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 from the live domain config.
Aug 26 23:47:07 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0e136a7-f75e-4074-84a5-b4a91c910844 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e136a7-f75e-4074-84a5-b4a91c910844 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GmVypgLr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:47:07 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-f0e136a7-f75e-4074-84a5-b4a91c910844 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:47:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-f0e136a7-f75e-4074-84a5-b4a91c910844 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-f0e136a7-f75e-4074-84a5-b4a91c910844 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e136a7-f75e-4074-84a5-b4a91c910844 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f904f63d-8180-4021-959e-580a4f087e79]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e03c2c2-a98b-4cf8-9cd7-e39950175002]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e136a7-f75e-4074-84a5-b4a91c910844 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5 (non-flash)
Aug 26 23:47:07 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e136a7-f75e-4074-84a5-b4a91c910844 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5 (non-flash)
Aug 26 23:47:07 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e136a7-f75e-4074-84a5-b4a91c910844 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282c459630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5'): ({'sdb'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-f0e136a7-f75e-4074-84a5-b4a91c910844 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Removing single pathed devices sdb {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fc2844-8a83-4240-b231-a359c5aaf1ae]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5db886-931c-48e0-88bd-4a4af9f5d2e6]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-f0e136a7-f75e-4074-84a5-b4a91c910844 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Flushing IO for device /dev/sdb {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd22e88d-a4a4-4547-901b-cb2dd240f110]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-f0e136a7-f75e-4074-84a5-b4a91c910844 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7358940-c732-4c15-99f8-24aa1cf1da1a]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-f0e136a7-f75e-4074-84a5-b4a91c910844 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-f0e136a7-f75e-4074-84a5-b4a91c910844 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e136a7-f75e-4074-84a5-b4a91c910844 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[502187ae-4229-4d4d-b909-c38156a50676]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e136a7-f75e-4074-84a5-b4a91c910844 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[91125567-7737-4315-853a-72e551202725]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e136a7-f75e-4074-84a5-b4a91c910844 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5, portal: 172.16.0.220,3260]
Aug 26 23:47:07 user nova-compute[73497]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5, portal: 172.16.0.220,3260] successful.
Aug 26 23:47:07 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e11b4490-3e90-41a3-bb0e-960c1ce7ddc5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec0f805-29e7-4c05-9655-f7c1a7b292b5]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e136a7-f75e-4074-84a5-b4a91c910844 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-f0e136a7-f75e-4074-84a5-b4a91c910844 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e136a7-f75e-4074-84a5-b4a91c910844 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] <== disconnect_volume: return (304ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0e136a7-f75e-4074-84a5-b4a91c910844 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:47:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:47:08 user nova-compute[73497]: DEBUG nova.objects.instance [None req-f0e136a7-f75e-4074-84a5-b4a91c910844 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lazy-loading 'flavor' on Instance uuid b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:47:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f0e136a7-f75e-4074-84a5-b4a91c910844 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.859s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:47:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:47:11 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:47:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:47:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:47:11 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:47:11 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:47:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:47:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:47:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:11 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:47:12 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:47:12 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:47:12 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8637MB free_disk=25.063800811767578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:47:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:47:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:47:12 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:47:12 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:47:12 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:47:12 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:47:12 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:47:12 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:47:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:47:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:47:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:47:14 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:47:14 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:47:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:47:15 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:47:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:47:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:47:18 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:47:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:47:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:47:20 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:47:20 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:47:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:47:24 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:47:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:47:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:47:28 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:47:28 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:47:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:47:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:47:28 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:47:28 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Updating instance_info_cache with network_info: [{"id": "be3535c5-b3b6-4ba8-b65f-52aab2b14bd7", "address": "fa:16:3e:9e:da:e1", "network": {"id": "0e605a84-41cf-4b4e-9c26-c97bc4635df8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-20815531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84b4e25a5f524b9a9a68b736ac63c374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3535c5-b3", "ovs_interfaceid": "be3535c5-b3b6-4ba8-b65f-52aab2b14bd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:47:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:47:28 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:47:29 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:47:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:47:32 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:47:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:47:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:47:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:47:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "09e66daf-783e-4f8f-8188-13fdcf679eb0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:47:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "09e66daf-783e-4f8f-8188-13fdcf679eb0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:47:41 user nova-compute[73497]: DEBUG nova.compute.manager [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:47:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:47:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:47:41 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:47:41 user nova-compute[73497]: INFO nova.compute.claims [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Claim successful on node user
Aug 26 23:47:41 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:47:41 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:47:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.236s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:47:41 user nova-compute[73497]: DEBUG nova.compute.manager [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:47:41 user nova-compute[73497]: DEBUG nova.compute.manager [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:47:41 user nova-compute[73497]: DEBUG nova.network.neutron [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:47:41 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:47:41 user nova-compute[73497]: DEBUG nova.compute.manager [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:47:41 user nova-compute[73497]: INFO nova.virt.block_device [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Booting with volume snapshot ff9a33ca-ba7c-4cf5-95e3-ad0e5e83e309 at /dev/vda
Aug 26 23:47:41 user nova-compute[73497]: DEBUG nova.policy [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dbd048b30716490880ff4b28758536a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3491abf5cc4e77aed2997a5ac8aeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:47:42 user nova-compute[73497]: DEBUG nova.network.neutron [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Successfully created port: 86c31049-161d-4c6f-a233-d4c3c529ea4b {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:47:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:47:43 user nova-compute[73497]: DEBUG nova.network.neutron [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Successfully updated port: 86c31049-161d-4c6f-a233-d4c3c529ea4b {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:47:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "refresh_cache-09e66daf-783e-4f8f-8188-13fdcf679eb0" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:47:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquired lock "refresh_cache-09e66daf-783e-4f8f-8188-13fdcf679eb0" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:47:43 user nova-compute[73497]: DEBUG nova.network.neutron [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:47:43 user nova-compute[73497]: DEBUG nova.compute.manager [req-2451a4e0-edc5-4428-a538-3f99d473f5db req-94e97cfb-d5c0-4bda-b19a-1f308d19d583 service nova] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Received event network-changed-86c31049-161d-4c6f-a233-d4c3c529ea4b {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:47:43 user nova-compute[73497]: DEBUG nova.compute.manager [req-2451a4e0-edc5-4428-a538-3f99d473f5db req-94e97cfb-d5c0-4bda-b19a-1f308d19d583 service nova] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Refreshing instance network info cache due to event network-changed-86c31049-161d-4c6f-a233-d4c3c529ea4b. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:47:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2451a4e0-edc5-4428-a538-3f99d473f5db req-94e97cfb-d5c0-4bda-b19a-1f308d19d583 service nova] Acquiring lock "refresh_cache-09e66daf-783e-4f8f-8188-13fdcf679eb0" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:47:43 user nova-compute[73497]: DEBUG nova.network.neutron [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:47:43 user nova-compute[73497]: DEBUG nova.network.neutron [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Updating instance_info_cache with network_info: [{"id": "86c31049-161d-4c6f-a233-d4c3c529ea4b", "address": "fa:16:3e:14:98:e5", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c31049-16", "ovs_interfaceid": "86c31049-161d-4c6f-a233-d4c3c529ea4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:47:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Releasing lock "refresh_cache-09e66daf-783e-4f8f-8188-13fdcf679eb0" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:47:43 user nova-compute[73497]: DEBUG nova.compute.manager [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Instance network_info: |[{"id": "86c31049-161d-4c6f-a233-d4c3c529ea4b", "address": "fa:16:3e:14:98:e5", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c31049-16", "ovs_interfaceid": "86c31049-161d-4c6f-a233-d4c3c529ea4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:47:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2451a4e0-edc5-4428-a538-3f99d473f5db req-94e97cfb-d5c0-4bda-b19a-1f308d19d583 service nova] Acquired lock "refresh_cache-09e66daf-783e-4f8f-8188-13fdcf679eb0" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:47:43 user nova-compute[73497]: DEBUG nova.network.neutron [req-2451a4e0-edc5-4428-a538-3f99d473f5db req-94e97cfb-d5c0-4bda-b19a-1f308d19d583 service nova] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Refreshing network info cache for port 86c31049-161d-4c6f-a233-d4c3c529ea4b {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:47:44 user nova-compute[73497]: DEBUG nova.network.neutron [req-2451a4e0-edc5-4428-a538-3f99d473f5db req-94e97cfb-d5c0-4bda-b19a-1f308d19d583 service nova] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Updated VIF entry in instance network info cache for port 86c31049-161d-4c6f-a233-d4c3c529ea4b. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:47:44 user nova-compute[73497]: DEBUG nova.network.neutron [req-2451a4e0-edc5-4428-a538-3f99d473f5db req-94e97cfb-d5c0-4bda-b19a-1f308d19d583 service nova] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Updating instance_info_cache with network_info: [{"id": "86c31049-161d-4c6f-a233-d4c3c529ea4b", "address": "fa:16:3e:14:98:e5", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c31049-16", "ovs_interfaceid": "86c31049-161d-4c6f-a233-d4c3c529ea4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:47:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2451a4e0-edc5-4428-a538-3f99d473f5db req-94e97cfb-d5c0-4bda-b19a-1f308d19d583 service nova] Releasing lock "refresh_cache-09e66daf-783e-4f8f-8188-13fdcf679eb0" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:47:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:47:47 user nova-compute[73497]: DEBUG os_brick.utils [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:47:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:47:47 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d5509e-ab30-43b9-8893-48e6bcd3ef27]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:47:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:47:47 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1872c6-556a-4881-b66a-eecbef17983a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:47:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:47:47 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a218315-ba4e-4194-97f9-648620bfc9ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:47:47 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcdc826-9e82-4d68-b971-75072d236cc7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:47:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:47:47 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:47:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:47 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:47:47 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:47:47 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[29041225-f71f-46cc-8e7b-9b87a67158e7]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:47:47 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:47:47 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:47:47 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:47:47 user nova-compute[73497]: DEBUG os_brick.utils [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:47:47 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Updating existing volume attachment record: bc3750e9-f526-4e12-9aa8-efbe0b1da119 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:47:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:47:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:47:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:47:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG nova.compute.manager [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:47:58 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Creating image(s)
Aug 26 23:47:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Did not create local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Ensure instance console log exists: /opt/stack/data/nova/instances/09e66daf-783e-4f8f-8188-13fdcf679eb0/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Start _get_guest_xml network_info=[{"id": "86c31049-161d-4c6f-a233-d4c3c529ea4b", "address": "fa:16:3e:14:98:e5", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c31049-16", "ovs_interfaceid": "86c31049-161d-4c6f-a233-d4c3c529ea4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'bc3750e9-f526-4e12-9aa8-efbe0b1da119', 'guest_format': None, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SxlogVzm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '09e66daf-783e-4f8f-8188-13fdcf679eb0', 'attached_at': '', 'detached_at': '', 'volume_id': 'bddbf911-ef83-423e-bca1-c596c81b0588', 'serial': 'bddbf911-ef83-423e-bca1-c596c81b0588'}, 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:47:58 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:47:58 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:47:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SxlogVzm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:47:58 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:47:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:47:58 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:47:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:47:58 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:47:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[001e458e-6270-4935-bb7b-97db4d37e435]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:47:58 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f484bcf7-3040-43f9-a4be-0acb78e7bf59]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588] added
Aug 26 23:47:58 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[52dd7a65-c600-4302-9a49-9521e0751525]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d427fc9d-88bb-4b3d-b98a-a895848c29c8]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SxlogVzm {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SxlogVzm" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d07818e-267b-4b2f-b69c-3c3cfa91b947]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SxlogVzm'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9a5f03-4600-4be8-835f-7c4999be59dd]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc7bcd3-ea2c-4872-8976-b5229badb3ba]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 23:47:58 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 23:47:58 user nova-compute[73497]:  {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:47:58 user nova-compute[73497]: WARNING os_brick.initiator.connectors.iscsi [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 23:47:58 user nova-compute[73497]: 
Aug 26 23:47:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac864df9-74cb-4785-a257-35a4605f3768]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588, portal: 172.16.0.220,3260]
Aug 26 23:47:58 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588, portal: 172.16.0.220,3260] successful.
Aug 26 23:47:58 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[97899307-7f0c-47d0-88d0-20d28e0d2edd]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[860c9090-f805-4ad7-83ab-a19c7f6a65a4]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 (non-flash)
Aug 26 23:47:58 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 (non-flash)
Aug 26 23:47:58 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf75e62-e176-44af-b79b-ba6a3bf83636]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:47:58 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:47:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:47:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:47:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:47:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:47:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:47:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:47:59 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:47:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SxlogVzm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:47:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:47:59 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23536396264346337', 'path': '/dev/sdb'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:47:59 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536396264346337', 'path': '/dev/sdb'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:47:59 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:47:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-511937552',display_name='tempest-TestVolumeBootPattern-server-511937552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-511937552',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba3491abf5cc4e77aed2997a5ac8aeee',ramdisk_id='',reservation_id='r-w3c7i25f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-377601332',owner_user_name='tempest-TestVolumeBootPattern-377601332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:47:42Z,user_data=None,user_id='dbd048b30716490880ff4b28758536a5',uuid=09e66daf-783e-4f8f-8188-13fdcf679eb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86c31049-161d-4c6f-a233-d4c3c529ea4b", "address": "fa:16:3e:14:98:e5", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c31049-16", "ovs_interfaceid": "86c31049-161d-4c6f-a233-d4c3c529ea4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:47:59 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Converting VIF {"id": "86c31049-161d-4c6f-a233-d4c3c529ea4b", "address": "fa:16:3e:14:98:e5", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c31049-16", "ovs_interfaceid": "86c31049-161d-4c6f-a233-d4c3c529ea4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:47:59 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:98:e5,bridge_name='br-int',has_traffic_filtering=True,id=86c31049-161d-4c6f-a233-d4c3c529ea4b,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86c31049-16') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:47:59 user nova-compute[73497]: DEBUG nova.objects.instance [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lazy-loading 'pci_devices' on Instance uuid 09e66daf-783e-4f8f-8188-13fdcf679eb0 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:47:59 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:47:59 user nova-compute[73497]:   <uuid>09e66daf-783e-4f8f-8188-13fdcf679eb0</uuid>
Aug 26 23:47:59 user nova-compute[73497]:   <name>instance-0000002f</name>
Aug 26 23:47:59 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:47:59 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:47:59 user nova-compute[73497]:   <metadata>
Aug 26 23:47:59 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:47:59 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:47:59 user nova-compute[73497]:       <nova:name>tempest-TestVolumeBootPattern-server-511937552</nova:name>
Aug 26 23:47:59 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:47:58</nova:creationTime>
Aug 26 23:47:59 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:47:59 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:47:59 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:47:59 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:47:59 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:47:59 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:47:59 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:47:59 user nova-compute[73497]:       <nova:owner>
Aug 26 23:47:59 user nova-compute[73497]:         <nova:user uuid="dbd048b30716490880ff4b28758536a5">tempest-TestVolumeBootPattern-377601332-project-member</nova:user>
Aug 26 23:47:59 user nova-compute[73497]:         <nova:project uuid="ba3491abf5cc4e77aed2997a5ac8aeee">tempest-TestVolumeBootPattern-377601332</nova:project>
Aug 26 23:47:59 user nova-compute[73497]:       </nova:owner>
Aug 26 23:47:59 user nova-compute[73497]:       <nova:ports>
Aug 26 23:47:59 user nova-compute[73497]:         <nova:port uuid="86c31049-161d-4c6f-a233-d4c3c529ea4b">
Aug 26 23:47:59 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 23:47:59 user nova-compute[73497]:         </nova:port>
Aug 26 23:47:59 user nova-compute[73497]:       </nova:ports>
Aug 26 23:47:59 user nova-compute[73497]:     </nova:instance>
Aug 26 23:47:59 user nova-compute[73497]:   </metadata>
Aug 26 23:47:59 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:47:59 user nova-compute[73497]:     <system>
Aug 26 23:47:59 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:47:59 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:47:59 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:47:59 user nova-compute[73497]:       <entry name="serial">09e66daf-783e-4f8f-8188-13fdcf679eb0</entry>
Aug 26 23:47:59 user nova-compute[73497]:       <entry name="uuid">09e66daf-783e-4f8f-8188-13fdcf679eb0</entry>
Aug 26 23:47:59 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:47:59 user nova-compute[73497]:     </system>
Aug 26 23:47:59 user nova-compute[73497]:   </sysinfo>
Aug 26 23:47:59 user nova-compute[73497]:   <os>
Aug 26 23:47:59 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:47:59 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:47:59 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:47:59 user nova-compute[73497]:   </os>
Aug 26 23:47:59 user nova-compute[73497]:   <features>
Aug 26 23:47:59 user nova-compute[73497]:     <acpi/>
Aug 26 23:47:59 user nova-compute[73497]:     <apic/>
Aug 26 23:47:59 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:47:59 user nova-compute[73497]:   </features>
Aug 26 23:47:59 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:47:59 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:47:59 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:47:59 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:47:59 user nova-compute[73497]:   </clock>
Aug 26 23:47:59 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:47:59 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:47:59 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:47:59 user nova-compute[73497]:   </cpu>
Aug 26 23:47:59 user nova-compute[73497]:   <devices>
Aug 26 23:47:59 user nova-compute[73497]:     <disk type="block" device="disk">
Aug 26 23:47:59 user nova-compute[73497]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:47:59 user nova-compute[73497]:       <source dev="/dev/sdb"/>
Aug 26 23:47:59 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:47:59 user nova-compute[73497]:       <serial>bddbf911-ef83-423e-bca1-c596c81b0588</serial>
Aug 26 23:47:59 user nova-compute[73497]:     </disk>
Aug 26 23:47:59 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:47:59 user nova-compute[73497]:       <mac address="fa:16:3e:14:98:e5"/>
Aug 26 23:47:59 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:47:59 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:47:59 user nova-compute[73497]:       <target dev="tap86c31049-16"/>
Aug 26 23:47:59 user nova-compute[73497]:     </interface>
Aug 26 23:47:59 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:47:59 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/09e66daf-783e-4f8f-8188-13fdcf679eb0/console.log" append="off"/>
Aug 26 23:47:59 user nova-compute[73497]:     </serial>
Aug 26 23:47:59 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:47:59 user nova-compute[73497]:     <video>
Aug 26 23:47:59 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:47:59 user nova-compute[73497]:     </video>
Aug 26 23:47:59 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:47:59 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:47:59 user nova-compute[73497]:     </rng>
Aug 26 23:47:59 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:47:59 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:47:59 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:47:59 user nova-compute[73497]:     </memballoon>
Aug 26 23:47:59 user nova-compute[73497]:   </devices>
Aug 26 23:47:59 user nova-compute[73497]: </domain>
Aug 26 23:47:59 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:47:59 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:47:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-511937552',display_name='tempest-TestVolumeBootPattern-server-511937552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-511937552',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba3491abf5cc4e77aed2997a5ac8aeee',ramdisk_id='',reservation_id='r-w3c7i25f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-377601332',owner_user_name='tempest-TestVolumeBootPattern-377601332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:47:42Z,user_data=None,user_id='dbd048b30716490880ff4b28758536a5',uuid=09e66daf-783e-4f8f-8188-13fdcf679eb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86c31049-161d-4c6f-a233-d4c3c529ea4b", "address": "fa:16:3e:14:98:e5", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c31049-16", "ovs_interfaceid": "86c31049-161d-4c6f-a233-d4c3c529ea4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:47:59 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Converting VIF {"id": "86c31049-161d-4c6f-a233-d4c3c529ea4b", "address": "fa:16:3e:14:98:e5", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c31049-16", "ovs_interfaceid": "86c31049-161d-4c6f-a233-d4c3c529ea4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:47:59 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:98:e5,bridge_name='br-int',has_traffic_filtering=True,id=86c31049-161d-4c6f-a233-d4c3c529ea4b,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86c31049-16') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:47:59 user nova-compute[73497]: DEBUG os_vif [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:98:e5,bridge_name='br-int',has_traffic_filtering=True,id=86c31049-161d-4c6f-a233-d4c3c529ea4b,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86c31049-16') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:47:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:47:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:47:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:47:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:47:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86c31049-16, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:47:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap86c31049-16, col_values=(('external_ids', {'iface-id': '86c31049-161d-4c6f-a233-d4c3c529ea4b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:98:e5', 'vm-uuid': '09e66daf-783e-4f8f-8188-13fdcf679eb0'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:47:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:47:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:47:59 user nova-compute[73497]: INFO os_vif [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:98:e5,bridge_name='br-int',has_traffic_filtering=True,id=86c31049-161d-4c6f-a233-d4c3c529ea4b,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86c31049-16')
Aug 26 23:48:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:48:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] No VIF found with MAC fa:16:3e:14:98:e5, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:48:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:48:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:48:01 user nova-compute[73497]: DEBUG nova.compute.manager [req-386962a2-6717-414b-b688-8800beb10665 req-8a2c05be-4d1e-4cb6-9318-f89e212c5861 service nova] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Received event network-vif-plugged-86c31049-161d-4c6f-a233-d4c3c529ea4b {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:48:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-386962a2-6717-414b-b688-8800beb10665 req-8a2c05be-4d1e-4cb6-9318-f89e212c5861 service nova] Acquiring lock "09e66daf-783e-4f8f-8188-13fdcf679eb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:48:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-386962a2-6717-414b-b688-8800beb10665 req-8a2c05be-4d1e-4cb6-9318-f89e212c5861 service nova] Lock "09e66daf-783e-4f8f-8188-13fdcf679eb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:48:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-386962a2-6717-414b-b688-8800beb10665 req-8a2c05be-4d1e-4cb6-9318-f89e212c5861 service nova] Lock "09e66daf-783e-4f8f-8188-13fdcf679eb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:48:01 user nova-compute[73497]: DEBUG nova.compute.manager [req-386962a2-6717-414b-b688-8800beb10665 req-8a2c05be-4d1e-4cb6-9318-f89e212c5861 service nova] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] No waiting events found dispatching network-vif-plugged-86c31049-161d-4c6f-a233-d4c3c529ea4b {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:48:01 user nova-compute[73497]: WARNING nova.compute.manager [req-386962a2-6717-414b-b688-8800beb10665 req-8a2c05be-4d1e-4cb6-9318-f89e212c5861 service nova] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Received unexpected event network-vif-plugged-86c31049-161d-4c6f-a233-d4c3c529ea4b for instance with vm_state building and task_state spawning.
Aug 26 23:48:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:48:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Acquiring lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:48:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:48:01 user nova-compute[73497]: DEBUG nova.objects.instance [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lazy-loading 'flavor' on Instance uuid b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:48:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:48:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:48:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:48:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:48:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:48:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Acquiring lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:48:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:48:02 user nova-compute[73497]: INFO nova.compute.manager [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Attaching volume 53252cdd-6765-41ad-8e5c-7b5869424f19 to /dev/vdb
Aug 26 23:48:02 user nova-compute[73497]: DEBUG os_brick.utils [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:48:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:48:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:48:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71d088b-d525-441c-9629-62c99999f079]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:48:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:48:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:48:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1bd03b-d9ac-4965-9c40-359f043bb04e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:48:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:48:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:48:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ac760a-db75-43dc-b2d2-e40eff830922]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:48:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a681aa-f7bf-47ac-b4e1-a2a2ca56a8ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:48:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:48:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:48:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:48:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:48:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:48:02 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:48:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc0dd00-f376-4aa1-bd60-4c5aa367abb1]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:48:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:48:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:48:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:48:02 user nova-compute[73497]: DEBUG os_brick.utils [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:48:02 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Updating existing volume attachment record: 39432ee4-0627-4fc0-bc5a-fabd380d24d8 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:48:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:48:03 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693093683.502256, 09e66daf-783e-4f8f-8188-13fdcf679eb0 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:48:03 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] VM Resumed (Lifecycle Event)
Aug 26 23:48:03 user nova-compute[73497]: DEBUG nova.compute.manager [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:48:03 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:48:03 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Instance spawned successfully.
Aug 26 23:48:03 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:48:03 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:48:03 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:48:03 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:48:03 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:48:03 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:48:03 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:48:03 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:48:03 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:48:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-afb334cc-dcc4-4f5c-b1de-9fbd3f59984c req-447ae3a3-e0c6-40b7-844c-10da00c79801 service nova] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Received event network-vif-plugged-86c31049-161d-4c6f-a233-d4c3c529ea4b {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:48:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-afb334cc-dcc4-4f5c-b1de-9fbd3f59984c req-447ae3a3-e0c6-40b7-844c-10da00c79801 service nova] Acquiring lock "09e66daf-783e-4f8f-8188-13fdcf679eb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:48:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-afb334cc-dcc4-4f5c-b1de-9fbd3f59984c req-447ae3a3-e0c6-40b7-844c-10da00c79801 service nova] Lock "09e66daf-783e-4f8f-8188-13fdcf679eb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:48:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-afb334cc-dcc4-4f5c-b1de-9fbd3f59984c req-447ae3a3-e0c6-40b7-844c-10da00c79801 service nova] Lock "09e66daf-783e-4f8f-8188-13fdcf679eb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:48:03 user nova-compute[73497]: DEBUG nova.compute.manager [req-afb334cc-dcc4-4f5c-b1de-9fbd3f59984c req-447ae3a3-e0c6-40b7-844c-10da00c79801 service nova] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] No waiting events found dispatching network-vif-plugged-86c31049-161d-4c6f-a233-d4c3c529ea4b {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:48:03 user nova-compute[73497]: WARNING nova.compute.manager [req-afb334cc-dcc4-4f5c-b1de-9fbd3f59984c req-447ae3a3-e0c6-40b7-844c-10da00c79801 service nova] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Received unexpected event network-vif-plugged-86c31049-161d-4c6f-a233-d4c3c529ea4b for instance with vm_state building and task_state spawning.
Aug 26 23:48:03 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:48:03 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693093683.5043278, 09e66daf-783e-4f8f-8188-13fdcf679eb0 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:48:03 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] VM Started (Lifecycle Event)
Aug 26 23:48:03 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:48:03 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:48:03 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:48:03 user nova-compute[73497]: INFO nova.compute.manager [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Took 5.09 seconds to spawn the instance on the hypervisor.
Aug 26 23:48:03 user nova-compute[73497]: DEBUG nova.compute.manager [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:48:03 user nova-compute[73497]: INFO nova.compute.manager [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Took 22.65 seconds to build instance.
Aug 26 23:48:03 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-46b53bf2-95a7-46b4-b667-902c7ae93a89 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "09e66daf-783e-4f8f-8188-13fdcf679eb0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.744s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:48:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:48:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:48:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:48:12 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:48:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:48:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:48:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:48:12 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:48:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:48:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:48:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:48:12 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:48:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:48:13 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:48:13 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:48:13 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8531MB free_disk=25.06012725830078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 09e66daf-783e-4f8f-8188-13fdcf679eb0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.236s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JdnjHXEB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:48:13 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:48:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:48:13 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:48:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:48:13 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:48:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa1e68c-2364-488c-a114-c79dade7552b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:48:13 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90c0f88-d0ba-4209-91ac-91a4fd770a2d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19] added
Aug 26 23:48:13 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b15c2d-d0cf-4803-8797-301152f23f94]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b57b49-1d35-4b62-bc25-8c4169449ff3]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JdnjHXEB {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JdnjHXEB" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b6e145-1b5f-49ee-9844-69ba7e7f6541]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JdnjHXEB'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c99cc8-7e79-4fad-b88f-57d677db85ed]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0e14c5-2ae4-426f-b1a0-b59efd27e2c2]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 (non-flash)
Aug 26 23:48:13 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 (non-flash)
Aug 26 23:48:13 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:48:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:48:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:48:14 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d9cc54-35a9-4ab3-8f59-40e4dbbe2398]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:48:14 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19, portal: 172.16.0.220,3260]
Aug 26 23:48:14 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19, portal: 172.16.0.220,3260] successful.
Aug 26 23:48:14 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:48:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:48:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:48:14 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ebf916-e332-4d4f-b425-5c8bc3060c64]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:48:14 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:48:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:48:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:48:14 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24c6b95-e525-40c1-b8cd-def69b4a9247]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:48:14 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 (non-flash)
Aug 26 23:48:14 user nova-compute[73497]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19 (non-flash)
Aug 26 23:48:14 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:48:14 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 (non-flash)
Aug 26 23:48:14 user nova-compute[73497]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19 (non-flash)
Aug 26 23:48:14 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:48:14 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:48:14 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:48:14 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:48:14 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:48:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:48:14 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:48:14 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3adb7a-8bdd-4535-9c30-1a5deb79858e]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:48:14 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:48:14 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JdnjHXEB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:48:14 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:48:14 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:48:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:48:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:48:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:48:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:48:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:48:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:48:15 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:48:15 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23362646231653931', 'path': '/dev/sdc'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:48:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362646231653931', 'path': '/dev/sdc'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:48:15 user nova-compute[73497]: DEBUG nova.objects.instance [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lazy-loading 'flavor' on Instance uuid b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:48:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 23:48:15 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:48:15 user nova-compute[73497]:   <source dev="/dev/sdc"/>
Aug 26 23:48:15 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:48:15 user nova-compute[73497]:   <serial>53252cdd-6765-41ad-8e5c-7b5869424f19</serial>
Aug 26 23:48:15 user nova-compute[73497]: </disk>
Aug 26 23:48:15 user nova-compute[73497]:  {{(pid=73497) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 23:48:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:48:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:48:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] No VIF found with MAC fa:16:3e:9e:da:e1, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:48:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-037548b4-0b21-4283-96ce-666ac0b2b980 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.815s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:48:16 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:48:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e8113905-ebfb-4071-b6eb-601833333b89 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Acquiring lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e8113905-ebfb-4071-b6eb-601833333b89 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:48:18 user nova-compute[73497]: INFO nova.compute.manager [None req-e8113905-ebfb-4071-b6eb-601833333b89 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Detaching volume 53252cdd-6765-41ad-8e5c-7b5869424f19
Aug 26 23:48:18 user nova-compute[73497]: INFO nova.virt.block_device [None req-e8113905-ebfb-4071-b6eb-601833333b89 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Attempting to driver detach volume 53252cdd-6765-41ad-8e5c-7b5869424f19 from mountpoint /dev/vdb
Aug 26 23:48:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e8113905-ebfb-4071-b6eb-601833333b89 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Attempting to detach device vdb from instance b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 from the persistent domain config. {{(pid=73497) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-e8113905-ebfb-4071-b6eb-601833333b89 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:48:18 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:48:18 user nova-compute[73497]:   <source dev="/dev/sdc"/>
Aug 26 23:48:18 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:48:18 user nova-compute[73497]:   <serial>53252cdd-6765-41ad-8e5c-7b5869424f19</serial>
Aug 26 23:48:18 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:48:18 user nova-compute[73497]: </disk>
Aug 26 23:48:18 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:48:18 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-e8113905-ebfb-4071-b6eb-601833333b89 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Successfully detached device vdb from instance b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 from the persistent domain config.
Aug 26 23:48:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e8113905-ebfb-4071-b6eb-601833333b89 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 from the live domain config. {{(pid=73497) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-e8113905-ebfb-4071-b6eb-601833333b89 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:48:18 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:48:18 user nova-compute[73497]:   <source dev="/dev/sdc"/>
Aug 26 23:48:18 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:48:18 user nova-compute[73497]:   <serial>53252cdd-6765-41ad-8e5c-7b5869424f19</serial>
Aug 26 23:48:18 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:48:18 user nova-compute[73497]: </disk>
Aug 26 23:48:18 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Received event <DeviceRemovedEvent: 1693093698.5984032, b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73497) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e8113905-ebfb-4071-b6eb-601833333b89 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 {{(pid=73497) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 23:48:18 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-e8113905-ebfb-4071-b6eb-601833333b89 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Successfully detached device vdb from instance b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 from the live domain config.
Aug 26 23:48:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8113905-ebfb-4071-b6eb-601833333b89 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8113905-ebfb-4071-b6eb-601833333b89 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JdnjHXEB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:48:18 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-e8113905-ebfb-4071-b6eb-601833333b89 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:48:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e8113905-ebfb-4071-b6eb-601833333b89 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e8113905-ebfb-4071-b6eb-601833333b89 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8113905-ebfb-4071-b6eb-601833333b89 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcae7f9-7b10-49e7-bf35-4b6fbeab53e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[32035ddb-3b07-4a41-b54e-7edb298d6809]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8113905-ebfb-4071-b6eb-601833333b89 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 (non-flash)
Aug 26 23:48:18 user nova-compute[73497]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19 (non-flash)
Aug 26 23:48:18 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8113905-ebfb-4071-b6eb-601833333b89 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 (non-flash)
Aug 26 23:48:18 user nova-compute[73497]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19 (non-flash)
Aug 26 23:48:18 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8113905-ebfb-4071-b6eb-601833333b89 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281c3820e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19'): ({'sdc'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-e8113905-ebfb-4071-b6eb-601833333b89 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Removing single pathed devices sdc {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[92595d8c-49f9-46e2-a06e-014000aa5fb6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[020b8647-8637-495d-914f-9868a0b6e494]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-e8113905-ebfb-4071-b6eb-601833333b89 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Flushing IO for device /dev/sdc {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1aebbf-6b16-420f-bd73-5ab026235473]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-e8113905-ebfb-4071-b6eb-601833333b89 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bd4ce8-779f-4172-ab6d-16f6439a2f55]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-e8113905-ebfb-4071-b6eb-601833333b89 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-e8113905-ebfb-4071-b6eb-601833333b89 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] SCSI volumes sdc have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8113905-ebfb-4071-b6eb-601833333b89 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d19219-492f-4377-8afd-31308e251819]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8113905-ebfb-4071-b6eb-601833333b89 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[deee9227-f255-490d-9114-8420d841127a]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8113905-ebfb-4071-b6eb-601833333b89 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19, portal: 172.16.0.220,3260]
Aug 26 23:48:18 user nova-compute[73497]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19, portal: 172.16.0.220,3260] successful.
Aug 26 23:48:18 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53252cdd-6765-41ad-8e5c-7b5869424f19 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8e5dee-850c-411b-b094-d5915ee3c054]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8113905-ebfb-4071-b6eb-601833333b89 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e8113905-ebfb-4071-b6eb-601833333b89 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8113905-ebfb-4071-b6eb-601833333b89 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] <== disconnect_volume: return (284ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:48:18 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8113905-ebfb-4071-b6eb-601833333b89 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:48:19 user nova-compute[73497]: DEBUG nova.objects.instance [None req-e8113905-ebfb-4071-b6eb-601833333b89 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lazy-loading 'flavor' on Instance uuid b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:48:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e8113905-ebfb-4071-b6eb-601833333b89 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.757s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:48:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:48:20 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:48:21 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:48:22 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:48:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:48:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:48:26 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:48:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:48:29 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:48:30 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:48:30 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:48:30 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:48:30 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Rebuilding the list of instances to heal {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 23:48:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:48:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:48:30 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:48:30 user nova-compute[73497]: DEBUG nova.objects.instance [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lazy-loading 'info_cache' on Instance uuid b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:48:30 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Updating instance_info_cache with network_info: [{"id": "be3535c5-b3b6-4ba8-b65f-52aab2b14bd7", "address": "fa:16:3e:9e:da:e1", "network": {"id": "0e605a84-41cf-4b4e-9c26-c97bc4635df8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-20815531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84b4e25a5f524b9a9a68b736ac63c374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3535c5-b3", "ovs_interfaceid": "be3535c5-b3b6-4ba8-b65f-52aab2b14bd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:48:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:48:30 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:48:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:48:35 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:48:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:48:40 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:48:43 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:48:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:48:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:48:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:48:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:48:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:48:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:48:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.imagecache [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Verify base images {{(pid=73497) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 26 23:48:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.imagecache [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=73497) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 26 23:48:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.imagecache [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Image id 0c532d88-7808-4cc1-8183-4c200f1ab99a yields fingerprint 0329cd0ac9e7f4717219a84dae97d40eb87ee981 {{(pid=73497) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 26 23:48:43 user nova-compute[73497]: INFO nova.virt.libvirt.imagecache [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] image 0c532d88-7808-4cc1-8183-4c200f1ab99a at (/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981): checking
Aug 26 23:48:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.imagecache [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] image 0c532d88-7808-4cc1-8183-4c200f1ab99a at (/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981): image is in use {{(pid=73497) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 26 23:48:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.imagecache [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] 09e66daf-783e-4f8f-8188-13fdcf679eb0 is a valid instance name {{(pid=73497) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 26 23:48:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.imagecache [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 is a valid instance name {{(pid=73497) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 26 23:48:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.imagecache [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 has a disk file {{(pid=73497) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 26 23:48:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:48:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:48:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.imagecache [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 is backed by 0329cd0ac9e7f4717219a84dae97d40eb87ee981 {{(pid=73497) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 26 23:48:43 user nova-compute[73497]: WARNING nova.virt.libvirt.imagecache [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Unknown base file: /opt/stack/data/nova/instances/_base/c6f1b512f47f2bd534f5e05671634bf5116c3e50
Aug 26 23:48:43 user nova-compute[73497]: WARNING nova.virt.libvirt.imagecache [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Unknown base file: /opt/stack/data/nova/instances/_base/f56ba919411ad91408e2d93c58a1f340e4bd8b77
Aug 26 23:48:43 user nova-compute[73497]: WARNING nova.virt.libvirt.imagecache [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Unknown base file: /opt/stack/data/nova/instances/_base/d10355a36084f1abecfd1941abf367c9cbe44fa7
Aug 26 23:48:43 user nova-compute[73497]: WARNING nova.virt.libvirt.imagecache [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Unknown base file: /opt/stack/data/nova/instances/_base/f949bc567bec28223247d57b206a7b129fed282e
Aug 26 23:48:43 user nova-compute[73497]: WARNING nova.virt.libvirt.imagecache [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Unknown base file: /opt/stack/data/nova/instances/_base/8772755b70e609d92c1d6cfcb74a391d9e9c9f87
Aug 26 23:48:43 user nova-compute[73497]: WARNING nova.virt.libvirt.imagecache [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Unknown base file: /opt/stack/data/nova/instances/_base/44b98a23174cd0776d8897282861d8e40962c11c
Aug 26 23:48:43 user nova-compute[73497]: WARNING nova.virt.libvirt.imagecache [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Unknown base file: /opt/stack/data/nova/instances/_base/930c5246d5d1dd8f93734b8bd20eaa1a1067cc13
Aug 26 23:48:43 user nova-compute[73497]: WARNING nova.virt.libvirt.imagecache [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Unknown base file: /opt/stack/data/nova/instances/_base/0c2e0ea5333f3f17caca52f28c36f71d3fad0b6a
Aug 26 23:48:43 user nova-compute[73497]: WARNING nova.virt.libvirt.imagecache [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Unknown base file: /opt/stack/data/nova/instances/_base/7318ea1cb0483324ccf7b626ca52f289b79cb0d7
Aug 26 23:48:43 user nova-compute[73497]: INFO nova.virt.libvirt.imagecache [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Active base files: /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981
Aug 26 23:48:43 user nova-compute[73497]: INFO nova.virt.libvirt.imagecache [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Removable base files: /opt/stack/data/nova/instances/_base/c6f1b512f47f2bd534f5e05671634bf5116c3e50 /opt/stack/data/nova/instances/_base/f56ba919411ad91408e2d93c58a1f340e4bd8b77 /opt/stack/data/nova/instances/_base/d10355a36084f1abecfd1941abf367c9cbe44fa7 /opt/stack/data/nova/instances/_base/f949bc567bec28223247d57b206a7b129fed282e /opt/stack/data/nova/instances/_base/8772755b70e609d92c1d6cfcb74a391d9e9c9f87 /opt/stack/data/nova/instances/_base/44b98a23174cd0776d8897282861d8e40962c11c /opt/stack/data/nova/instances/_base/930c5246d5d1dd8f93734b8bd20eaa1a1067cc13 /opt/stack/data/nova/instances/_base/0c2e0ea5333f3f17caca52f28c36f71d3fad0b6a /opt/stack/data/nova/instances/_base/7318ea1cb0483324ccf7b626ca52f289b79cb0d7
Aug 26 23:48:43 user nova-compute[73497]: INFO nova.virt.libvirt.imagecache [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c6f1b512f47f2bd534f5e05671634bf5116c3e50
Aug 26 23:48:43 user nova-compute[73497]: INFO nova.virt.libvirt.imagecache [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f56ba919411ad91408e2d93c58a1f340e4bd8b77
Aug 26 23:48:43 user nova-compute[73497]: INFO nova.virt.libvirt.imagecache [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d10355a36084f1abecfd1941abf367c9cbe44fa7
Aug 26 23:48:43 user nova-compute[73497]: INFO nova.virt.libvirt.imagecache [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f949bc567bec28223247d57b206a7b129fed282e
Aug 26 23:48:43 user nova-compute[73497]: INFO nova.virt.libvirt.imagecache [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8772755b70e609d92c1d6cfcb74a391d9e9c9f87
Aug 26 23:48:43 user nova-compute[73497]: INFO nova.virt.libvirt.imagecache [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/44b98a23174cd0776d8897282861d8e40962c11c
Aug 26 23:48:43 user nova-compute[73497]: INFO nova.virt.libvirt.imagecache [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/930c5246d5d1dd8f93734b8bd20eaa1a1067cc13
Aug 26 23:48:43 user nova-compute[73497]: INFO nova.virt.libvirt.imagecache [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0c2e0ea5333f3f17caca52f28c36f71d3fad0b6a
Aug 26 23:48:43 user nova-compute[73497]: INFO nova.virt.libvirt.imagecache [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7318ea1cb0483324ccf7b626ca52f289b79cb0d7
Aug 26 23:48:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.imagecache [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Verification complete {{(pid=73497) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 26 23:48:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.imagecache [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Verify swap images {{(pid=73497) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 26 23:48:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.imagecache [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Verify ephemeral images {{(pid=73497) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 26 23:48:45 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:48:50 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:48:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:48:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:49:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:49:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:49:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:49:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:49:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:49:00 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:49:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:49:10 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:49:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:49:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Acquiring lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:49:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:49:13 user nova-compute[73497]: DEBUG nova.objects.instance [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lazy-loading 'flavor' on Instance uuid b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:49:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:49:13 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:49:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Acquiring lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:49:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:49:13 user nova-compute[73497]: INFO nova.compute.manager [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Attaching volume 2087174b-e545-44a8-8b4b-03d0e1ee362b to /dev/vdb
Aug 26 23:49:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:49:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:49:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:49:13 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:49:13 user nova-compute[73497]: DEBUG os_brick.utils [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:49:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:49:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:49:13 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae03917-5466-4648-883b-e7506224da4e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:49:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:49:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:49:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:49:13 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[27375a76-6e16-484b-aff0-c23ee5d58091]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:49:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:49:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:49:13 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4dce464-1d7e-4c60-9007-bfb6fa866b46]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:49:13 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5324a222-d7f2-49d3-9051-595a21bbea4d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:49:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:49:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:49:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:49:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:49:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:49:13 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:49:13 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc85235-2658-4d78-8867-6f963ca43d03]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:49:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:49:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:49:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:49:13 user nova-compute[73497]: DEBUG os_brick.utils [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:49:13 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Updating existing volume attachment record: de7106c8-b03e-463d-a267-72169e121524 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:49:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:49:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:49:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:49:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:49:14 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:49:14 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:49:14 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8566MB free_disk=25.049407958984375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:49:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:49:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:49:14 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:49:14 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 09e66daf-783e-4f8f-8188-13fdcf679eb0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:49:14 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:49:14 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:49:14 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:49:14 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:49:14 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:49:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.302s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:49:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:49:15 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:49:15 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:49:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:49:18 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:49:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:49:21 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:49:22 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:49:22 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gblDUXRF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:49:24 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:49:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:49:24 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:49:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:49:24 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:49:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c96e1f4-6751-4bf1-9763-6b6162907a35]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:49:24 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa762a3-837d-4da9-bab0-687b09d80a69]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b] added
Aug 26 23:49:24 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc4e4c4-4eff-4626-906a-a57a8b794f88]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[13207063-23fe-4bdd-9d54-720bb6b3e4af]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gblDUXRF {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gblDUXRF" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8caef144-ee1b-42a1-ae8b-3f6239d2842f]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gblDUXRF'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a487ab8c-c761-41f2-83c5-70bbe98a6283]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a16f5a6-7be1-4f0b-ba3a-23b22b5bd6fe]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 (non-flash)
Aug 26 23:49:24 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 (non-flash)
Aug 26 23:49:24 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[794f0895-d9e5-4724-add0-5384ae0b1f2c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b, portal: 172.16.0.220,3260]
Aug 26 23:49:24 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b, portal: 172.16.0.220,3260] successful.
Aug 26 23:49:24 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[770612f7-3202-49a0-b385-50a8b1f91c53]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:49:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:49:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:49:25 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e76fe7-55ea-4994-9c46-cc144e46bc3b]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:49:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 (non-flash)
Aug 26 23:49:25 user nova-compute[73497]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b (non-flash)
Aug 26 23:49:25 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:49:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 (non-flash)
Aug 26 23:49:25 user nova-compute[73497]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b (non-flash)
Aug 26 23:49:25 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:49:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:49:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:49:25 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:49:25 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:49:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:49:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:49:25 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6ef9e5-be47-40c2-961a-33b6e3422ad0]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:49:25 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:49:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gblDUXRF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:49:25 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:49:25 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:49:25 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:49:25 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:49:25 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:49:25 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:49:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:49:26 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23163313230336335', 'path': '/dev/sdc'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:49:26 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163313230336335', 'path': '/dev/sdc'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:49:26 user nova-compute[73497]: DEBUG nova.objects.instance [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lazy-loading 'flavor' on Instance uuid b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:49:26 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 23:49:26 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:49:26 user nova-compute[73497]:   <source dev="/dev/sdc"/>
Aug 26 23:49:26 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:49:26 user nova-compute[73497]:   <serial>2087174b-e545-44a8-8b4b-03d0e1ee362b</serial>
Aug 26 23:49:26 user nova-compute[73497]: </disk>
Aug 26 23:49:26 user nova-compute[73497]:  {{(pid=73497) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 23:49:26 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:49:26 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:49:26 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] No VIF found with MAC fa:16:3e:9e:da:e1, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:49:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-db36644f-e823-439f-97b2-b27d7541988f tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.150s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:49:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:49:28 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:49:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e3750906-2345-4c61-bf47-558be4aea217 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Acquiring lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:49:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e3750906-2345-4c61-bf47-558be4aea217 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:49:28 user nova-compute[73497]: INFO nova.compute.manager [None req-e3750906-2345-4c61-bf47-558be4aea217 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Detaching volume 2087174b-e545-44a8-8b4b-03d0e1ee362b
Aug 26 23:49:29 user nova-compute[73497]: INFO nova.virt.block_device [None req-e3750906-2345-4c61-bf47-558be4aea217 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Attempting to driver detach volume 2087174b-e545-44a8-8b4b-03d0e1ee362b from mountpoint /dev/vdb
Aug 26 23:49:29 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e3750906-2345-4c61-bf47-558be4aea217 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Attempting to detach device vdb from instance b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 from the persistent domain config. {{(pid=73497) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-e3750906-2345-4c61-bf47-558be4aea217 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:49:29 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:49:29 user nova-compute[73497]:   <source dev="/dev/sdc"/>
Aug 26 23:49:29 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:49:29 user nova-compute[73497]:   <serial>2087174b-e545-44a8-8b4b-03d0e1ee362b</serial>
Aug 26 23:49:29 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:49:29 user nova-compute[73497]: </disk>
Aug 26 23:49:29 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:49:29 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-e3750906-2345-4c61-bf47-558be4aea217 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Successfully detached device vdb from instance b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 from the persistent domain config.
Aug 26 23:49:29 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e3750906-2345-4c61-bf47-558be4aea217 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 from the live domain config. {{(pid=73497) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-e3750906-2345-4c61-bf47-558be4aea217 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 23:49:29 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:49:29 user nova-compute[73497]:   <source dev="/dev/sdc"/>
Aug 26 23:49:29 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 26 23:49:29 user nova-compute[73497]:   <serial>2087174b-e545-44a8-8b4b-03d0e1ee362b</serial>
Aug 26 23:49:29 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 23:49:29 user nova-compute[73497]: </disk>
Aug 26 23:49:29 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Received event <DeviceRemovedEvent: 1693093769.4479027, b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73497) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-e3750906-2345-4c61-bf47-558be4aea217 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 {{(pid=73497) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 23:49:29 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-e3750906-2345-4c61-bf47-558be4aea217 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Successfully detached device vdb from instance b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 from the live domain config.
Aug 26 23:49:29 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3750906-2345-4c61-bf47-558be4aea217 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3750906-2345-4c61-bf47-558be4aea217 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gblDUXRF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:49:29 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-e3750906-2345-4c61-bf47-558be4aea217 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:49:29 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e3750906-2345-4c61-bf47-558be4aea217 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e3750906-2345-4c61-bf47-558be4aea217 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3750906-2345-4c61-bf47-558be4aea217 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[873676a3-1055-4cb7-bcbd-c684e33b4994]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b985f0-46af-42cf-9068-08c1ec55e5c6]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3750906-2345-4c61-bf47-558be4aea217 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 (non-flash)
Aug 26 23:49:29 user nova-compute[73497]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b (non-flash)
Aug 26 23:49:29 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3750906-2345-4c61-bf47-558be4aea217 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 (non-flash)
Aug 26 23:49:29 user nova-compute[73497]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b (non-flash)
Aug 26 23:49:29 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3750906-2345-4c61-bf47-558be4aea217 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281c380940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b'): ({'sdc'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-e3750906-2345-4c61-bf47-558be4aea217 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Removing single pathed devices sdc {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f0e3aa-eeec-4308-a6e6-e00b4bffd8ea]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca71bc6-4338-40ce-8597-6264008c8553]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-e3750906-2345-4c61-bf47-558be4aea217 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Flushing IO for device /dev/sdc {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3607f0-e2b5-4a9a-88a6-2f81b1664da2]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-e3750906-2345-4c61-bf47-558be4aea217 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d08d4af-1326-4e47-9589-8e61be63a718]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-e3750906-2345-4c61-bf47-558be4aea217 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-e3750906-2345-4c61-bf47-558be4aea217 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] SCSI volumes sdc have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3750906-2345-4c61-bf47-558be4aea217 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[691a58b4-e418-4cca-8fa6-16881639d72d]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3750906-2345-4c61-bf47-558be4aea217 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6ca61b-f8d9-4a70-b84e-f4729b3f01e3]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3750906-2345-4c61-bf47-558be4aea217 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b, portal: 172.16.0.220,3260]
Aug 26 23:49:29 user nova-compute[73497]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b, portal: 172.16.0.220,3260] successful.
Aug 26 23:49:29 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2087174b-e545-44a8-8b4b-03d0e1ee362b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb08e68d-c86e-44e0-a01d-0804d9b36968]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3750906-2345-4c61-bf47-558be4aea217 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-e3750906-2345-4c61-bf47-558be4aea217 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3750906-2345-4c61-bf47-558be4aea217 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] <== disconnect_volume: return (302ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:49:29 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3750906-2345-4c61-bf47-558be4aea217 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:49:30 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:49:30 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:49:30 user nova-compute[73497]: DEBUG nova.objects.instance [None req-e3750906-2345-4c61-bf47-558be4aea217 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lazy-loading 'flavor' on Instance uuid b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:49:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-e3750906-2345-4c61-bf47-558be4aea217 tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.699s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:49:31 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:49:31 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Cleaning up deleted instances {{(pid=73497) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 23:49:31 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] There are 0 instances to clean {{(pid=73497) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 23:49:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "09e66daf-783e-4f8f-8188-13fdcf679eb0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:49:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "09e66daf-783e-4f8f-8188-13fdcf679eb0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:49:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "09e66daf-783e-4f8f-8188-13fdcf679eb0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:49:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "09e66daf-783e-4f8f-8188-13fdcf679eb0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:49:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "09e66daf-783e-4f8f-8188-13fdcf679eb0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:49:31 user nova-compute[73497]: INFO nova.compute.manager [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Terminating instance
Aug 26 23:49:31 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:49:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:49:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:49:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:49:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:49:31 user nova-compute[73497]: DEBUG nova.compute.manager [req-fcc42e14-6ace-4c4f-adef-a868643e460a req-31470426-b98d-404a-a137-fee25c270aeb service nova] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Received event network-vif-unplugged-86c31049-161d-4c6f-a233-d4c3c529ea4b {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:49:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-fcc42e14-6ace-4c4f-adef-a868643e460a req-31470426-b98d-404a-a137-fee25c270aeb service nova] Acquiring lock "09e66daf-783e-4f8f-8188-13fdcf679eb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:49:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-fcc42e14-6ace-4c4f-adef-a868643e460a req-31470426-b98d-404a-a137-fee25c270aeb service nova] Lock "09e66daf-783e-4f8f-8188-13fdcf679eb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:49:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-fcc42e14-6ace-4c4f-adef-a868643e460a req-31470426-b98d-404a-a137-fee25c270aeb service nova] Lock "09e66daf-783e-4f8f-8188-13fdcf679eb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:49:31 user nova-compute[73497]: DEBUG nova.compute.manager [req-fcc42e14-6ace-4c4f-adef-a868643e460a req-31470426-b98d-404a-a137-fee25c270aeb service nova] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] No waiting events found dispatching network-vif-unplugged-86c31049-161d-4c6f-a233-d4c3c529ea4b {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:49:31 user nova-compute[73497]: DEBUG nova.compute.manager [req-fcc42e14-6ace-4c4f-adef-a868643e460a req-31470426-b98d-404a-a137-fee25c270aeb service nova] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Received event network-vif-unplugged-86c31049-161d-4c6f-a233-d4c3c529ea4b for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Skipping network cache update for instance because it is being deleted. {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9891}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Didn't find any instances for network info cache update. {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Cleaning up deleted instances with incomplete migration  {{(pid=73497) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 23:49:32 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Instance destroyed successfully.
Aug 26 23:49:32 user nova-compute[73497]: DEBUG nova.objects.instance [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lazy-loading 'resources' on Instance uuid 09e66daf-783e-4f8f-8188-13fdcf679eb0 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:47:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-511937552',display_name='tempest-TestVolumeBootPattern-server-511937552',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-511937552',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:48:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba3491abf5cc4e77aed2997a5ac8aeee',ramdisk_id='',reservation_id='r-w3c7i25f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-377601332',owner_user_name='tempest-TestVolumeBootPattern-377601332-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:48:04Z,user_data=None,user_id='dbd048b30716490880ff4b28758536a5',uuid=09e66daf-783e-4f8f-8188-13fdcf679eb0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86c31049-161d-4c6f-a233-d4c3c529ea4b", "address": "fa:16:3e:14:98:e5", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c31049-16", "ovs_interfaceid": "86c31049-161d-4c6f-a233-d4c3c529ea4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Converting VIF {"id": "86c31049-161d-4c6f-a233-d4c3c529ea4b", "address": "fa:16:3e:14:98:e5", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c31049-16", "ovs_interfaceid": "86c31049-161d-4c6f-a233-d4c3c529ea4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:98:e5,bridge_name='br-int',has_traffic_filtering=True,id=86c31049-161d-4c6f-a233-d4c3c529ea4b,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86c31049-16') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG os_vif [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:98:e5,bridge_name='br-int',has_traffic_filtering=True,id=86c31049-161d-4c6f-a233-d4c3c529ea4b,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86c31049-16') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86c31049-16, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:49:32 user nova-compute[73497]: INFO os_vif [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:98:e5,bridge_name='br-int',has_traffic_filtering=True,id=86c31049-161d-4c6f-a233-d4c3c529ea4b,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86c31049-16')
Aug 26 23:49:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SxlogVzm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:49:32 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:49:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6c8613-dd60-46ce-97d3-3d3abad1223e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[63589102-8165-44fe-9ca5-fd870e39594c]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 (non-flash)
Aug 26 23:49:32 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 (non-flash)
Aug 26 23:49:32 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2839aaa950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588'): ({'sdb'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Removing single pathed devices sdb {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1856ccc7-af1c-4896-9f15-cba1716efa7d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6639ba32-5b1a-45af-913f-460cb4d9be57]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Flushing IO for device /dev/sdb {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c72b07-69ce-4f62-8a77-8b698c31a2ab]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f1aacc-ddcf-4454-ba86-82b68e19bb15]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOf8fa1ae8-569bd4c7b4fa2d7e', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f8fa1ae8', '/dev/disk/by-id/scsi-23536396264346337') {{(pid=84617) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a2d292-7d81-4791-888d-7b63c6f2ecd2]: (4, None) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f9db4c-9d14-46f2-b58f-4d7e0630b92d]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2172b876-71c0-4842-9a95-6a0ab9031b58]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588, portal: 172.16.0.220,3260]
Aug 26 23:49:32 user nova-compute[73497]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588, portal: 172.16.0.220,3260] successful.
Aug 26 23:49:32 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bddbf911-ef83-423e-bca1-c596c81b0588 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.057s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc1b417-1b54-427d-9880-7c4def396608]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] <== disconnect_volume: return (311ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:49:32 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Deleting instance files /opt/stack/data/nova/instances/09e66daf-783e-4f8f-8188-13fdcf679eb0_del
Aug 26 23:49:32 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Deletion of /opt/stack/data/nova/instances/09e66daf-783e-4f8f-8188-13fdcf679eb0_del complete
Aug 26 23:49:32 user nova-compute[73497]: INFO nova.compute.manager [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 26 23:49:32 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:49:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:49:33 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:49:33 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Took 0.47 seconds to deallocate network for instance.
Aug 26 23:49:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-114ab80a-21e9-4a65-8a61-62ad84fae7d2 req-0b41ea60-0728-4f07-a090-bfd2047f1307 service nova] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Received event network-vif-plugged-86c31049-161d-4c6f-a233-d4c3c529ea4b {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:49:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-114ab80a-21e9-4a65-8a61-62ad84fae7d2 req-0b41ea60-0728-4f07-a090-bfd2047f1307 service nova] Acquiring lock "09e66daf-783e-4f8f-8188-13fdcf679eb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:49:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-114ab80a-21e9-4a65-8a61-62ad84fae7d2 req-0b41ea60-0728-4f07-a090-bfd2047f1307 service nova] Lock "09e66daf-783e-4f8f-8188-13fdcf679eb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:49:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-114ab80a-21e9-4a65-8a61-62ad84fae7d2 req-0b41ea60-0728-4f07-a090-bfd2047f1307 service nova] Lock "09e66daf-783e-4f8f-8188-13fdcf679eb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:49:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-114ab80a-21e9-4a65-8a61-62ad84fae7d2 req-0b41ea60-0728-4f07-a090-bfd2047f1307 service nova] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] No waiting events found dispatching network-vif-plugged-86c31049-161d-4c6f-a233-d4c3c529ea4b {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:49:33 user nova-compute[73497]: WARNING nova.compute.manager [req-114ab80a-21e9-4a65-8a61-62ad84fae7d2 req-0b41ea60-0728-4f07-a090-bfd2047f1307 service nova] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Received unexpected event network-vif-plugged-86c31049-161d-4c6f-a233-d4c3c529ea4b for instance with vm_state active and task_state deleting.
Aug 26 23:49:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-114ab80a-21e9-4a65-8a61-62ad84fae7d2 req-0b41ea60-0728-4f07-a090-bfd2047f1307 service nova] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Received event network-vif-deleted-86c31049-161d-4c6f-a233-d4c3c529ea4b {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:49:34 user nova-compute[73497]: INFO nova.compute.manager [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Took 0.94 seconds to detach 1 volumes for instance.
Aug 26 23:49:34 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Deleting volume: bddbf911-ef83-423e-bca1-c596c81b0588 {{(pid=73497) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 23:49:34 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:49:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:49:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:49:34 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:49:34 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:49:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.143s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:49:34 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Deleted allocations for instance 09e66daf-783e-4f8f-8188-13fdcf679eb0
Aug 26 23:49:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9b5f172f-cf1d-4127-8748-612c03ce9535 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "09e66daf-783e-4f8f-8188-13fdcf679eb0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.042s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:49:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:49:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:49:47 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693093772.3373165, 09e66daf-783e-4f8f-8188-13fdcf679eb0 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:49:47 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] VM Stopped (Lifecycle Event)
Aug 26 23:49:47 user nova-compute[73497]: DEBUG nova.compute.manager [None req-2d35a6b3-c60c-411f-8390-656812ce4241 None None] [instance: 09e66daf-783e-4f8f-8188-13fdcf679eb0] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:49:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:49:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:49:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:49:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:49:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:49:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:49:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:49:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:50:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:50:02 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_power_states {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:50:02 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Triggering sync for uuid b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 {{(pid=73497) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 23:50:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:50:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:50:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:50:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:50:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:50:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:50:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:50:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:50:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:50:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:50:13 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:50:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:50:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:50:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:50:13 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:50:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:50:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:50:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:50:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:50:14 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:50:14 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:50:14 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8636MB free_disk=25.047760009765625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:50:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:50:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:50:14 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:50:14 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:50:14 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:50:14 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:50:14 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:50:14 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:50:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.206s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:50:17 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:50:17 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:50:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:50:19 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:50:21 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:50:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:50:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:50:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:50:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:50:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:50:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:50:23 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:50:26 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:50:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:50:29 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:50:32 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:50:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:50:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:50:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:50:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:50:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:50:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:50:34 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:50:34 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:50:34 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Rebuilding the list of instances to heal {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 23:50:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:50:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:50:34 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:50:34 user nova-compute[73497]: DEBUG nova.objects.instance [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lazy-loading 'info_cache' on Instance uuid b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:50:35 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Updating instance_info_cache with network_info: [{"id": "be3535c5-b3b6-4ba8-b65f-52aab2b14bd7", "address": "fa:16:3e:9e:da:e1", "network": {"id": "0e605a84-41cf-4b4e-9c26-c97bc4635df8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-20815531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84b4e25a5f524b9a9a68b736ac63c374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3535c5-b3", "ovs_interfaceid": "be3535c5-b3b6-4ba8-b65f-52aab2b14bd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:50:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:50:35 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:50:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:50:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:50:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:50:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:50:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:50:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:50:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:50:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:50:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:50:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "2d7e3edd-c03b-43ec-85d4-ada44181f10d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:50:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "2d7e3edd-c03b-43ec-85d4-ada44181f10d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:50:51 user nova-compute[73497]: DEBUG nova.compute.manager [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:50:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:50:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:50:51 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:50:51 user nova-compute[73497]: INFO nova.compute.claims [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Claim successful on node user
Aug 26 23:50:52 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:50:52 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:50:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.228s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:50:52 user nova-compute[73497]: DEBUG nova.compute.manager [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:50:52 user nova-compute[73497]: DEBUG nova.compute.manager [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:50:52 user nova-compute[73497]: DEBUG nova.network.neutron [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:50:52 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:50:52 user nova-compute[73497]: DEBUG nova.compute.manager [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:50:52 user nova-compute[73497]: INFO nova.virt.block_device [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Booting with volume 506ff10c-b609-487a-ac7a-6fa06e43bb02 at /dev/vda
Aug 26 23:50:52 user nova-compute[73497]: DEBUG nova.policy [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dbd048b30716490880ff4b28758536a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3491abf5cc4e77aed2997a5ac8aeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:50:52 user nova-compute[73497]: DEBUG os_brick.utils [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:50:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:50:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:50:52 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fd6b9e-715c-406e-abef-2bc6623041c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:50:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:50:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:50:52 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bca815-8afe-4d40-8e0e-89f30ce8c930]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:50:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:50:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:50:52 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37615fb-039e-4a62-bf6f-ce52a464d84b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:50:52 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fab059-cb9c-438d-b2a3-5e613fde6531]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:50:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:50:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:50:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:50:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:50:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:50:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:50:52 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:50:52 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[828c9536-452c-43f6-bff1-741c2414f3d8]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:50:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:50:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:50:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:50:52 user nova-compute[73497]: DEBUG os_brick.utils [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:50:52 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Updating existing volume attachment record: 2824391b-dc96-411f-9beb-30d8c4448913 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:50:52 user nova-compute[73497]: DEBUG nova.network.neutron [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Successfully created port: 6df10372-5b2e-4b60-bd27-2c23866e83d0 {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:50:53 user nova-compute[73497]: DEBUG nova.network.neutron [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Successfully updated port: 6df10372-5b2e-4b60-bd27-2c23866e83d0 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:50:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "refresh_cache-2d7e3edd-c03b-43ec-85d4-ada44181f10d" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:50:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquired lock "refresh_cache-2d7e3edd-c03b-43ec-85d4-ada44181f10d" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:50:53 user nova-compute[73497]: DEBUG nova.network.neutron [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:50:53 user nova-compute[73497]: DEBUG nova.compute.manager [req-519f5184-d49d-4c25-87e2-6871494c5939 req-7a8e2af6-6854-4c7b-8754-013e052d8042 service nova] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Received event network-changed-6df10372-5b2e-4b60-bd27-2c23866e83d0 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:50:53 user nova-compute[73497]: DEBUG nova.compute.manager [req-519f5184-d49d-4c25-87e2-6871494c5939 req-7a8e2af6-6854-4c7b-8754-013e052d8042 service nova] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Refreshing instance network info cache due to event network-changed-6df10372-5b2e-4b60-bd27-2c23866e83d0. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:50:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-519f5184-d49d-4c25-87e2-6871494c5939 req-7a8e2af6-6854-4c7b-8754-013e052d8042 service nova] Acquiring lock "refresh_cache-2d7e3edd-c03b-43ec-85d4-ada44181f10d" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:50:53 user nova-compute[73497]: DEBUG nova.network.neutron [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:50:54 user nova-compute[73497]: DEBUG nova.network.neutron [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Updating instance_info_cache with network_info: [{"id": "6df10372-5b2e-4b60-bd27-2c23866e83d0", "address": "fa:16:3e:cf:5c:0d", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df10372-5b", "ovs_interfaceid": "6df10372-5b2e-4b60-bd27-2c23866e83d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:50:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Releasing lock "refresh_cache-2d7e3edd-c03b-43ec-85d4-ada44181f10d" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:50:54 user nova-compute[73497]: DEBUG nova.compute.manager [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Instance network_info: |[{"id": "6df10372-5b2e-4b60-bd27-2c23866e83d0", "address": "fa:16:3e:cf:5c:0d", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df10372-5b", "ovs_interfaceid": "6df10372-5b2e-4b60-bd27-2c23866e83d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:50:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-519f5184-d49d-4c25-87e2-6871494c5939 req-7a8e2af6-6854-4c7b-8754-013e052d8042 service nova] Acquired lock "refresh_cache-2d7e3edd-c03b-43ec-85d4-ada44181f10d" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:50:54 user nova-compute[73497]: DEBUG nova.network.neutron [req-519f5184-d49d-4c25-87e2-6871494c5939 req-7a8e2af6-6854-4c7b-8754-013e052d8042 service nova] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Refreshing network info cache for port 6df10372-5b2e-4b60-bd27-2c23866e83d0 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:50:54 user nova-compute[73497]: DEBUG nova.network.neutron [req-519f5184-d49d-4c25-87e2-6871494c5939 req-7a8e2af6-6854-4c7b-8754-013e052d8042 service nova] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Updated VIF entry in instance network info cache for port 6df10372-5b2e-4b60-bd27-2c23866e83d0. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:50:54 user nova-compute[73497]: DEBUG nova.network.neutron [req-519f5184-d49d-4c25-87e2-6871494c5939 req-7a8e2af6-6854-4c7b-8754-013e052d8042 service nova] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Updating instance_info_cache with network_info: [{"id": "6df10372-5b2e-4b60-bd27-2c23866e83d0", "address": "fa:16:3e:cf:5c:0d", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df10372-5b", "ovs_interfaceid": "6df10372-5b2e-4b60-bd27-2c23866e83d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:50:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-519f5184-d49d-4c25-87e2-6871494c5939 req-7a8e2af6-6854-4c7b-8754-013e052d8042 service nova] Releasing lock "refresh_cache-2d7e3edd-c03b-43ec-85d4-ada44181f10d" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:50:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:51:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG nova.compute.manager [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:51:04 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Creating image(s)
Aug 26 23:51:04 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Did not create local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Ensure instance console log exists: /opt/stack/data/nova/instances/2d7e3edd-c03b-43ec-85d4-ada44181f10d/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Start _get_guest_xml network_info=[{"id": "6df10372-5b2e-4b60-bd27-2c23866e83d0", "address": "fa:16:3e:cf:5c:0d", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df10372-5b", "ovs_interfaceid": "6df10372-5b2e-4b60-bd27-2c23866e83d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2824391b-dc96-411f-9beb-30d8c4448913', 'guest_format': None, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DzudlWLk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2d7e3edd-c03b-43ec-85d4-ada44181f10d', 'attached_at': '', 'detached_at': '', 'volume_id': '506ff10c-b609-487a-ac7a-6fa06e43bb02', 'serial': '506ff10c-b609-487a-ac7a-6fa06e43bb02'}, 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:51:04 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:51:04 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:51:04 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DzudlWLk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:51:04 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:51:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:51:04 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:51:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:51:04 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:51:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9595c5c0-b333-43a0-a610-49ce60154985]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:51:04 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b786dbe9-80fc-430f-9ebf-cca5f0c30404]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02] added
Aug 26 23:51:04 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c7911e-a570-40e7-a293-54636c306bec]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca985377-f513-4bca-8636-c0a12fb0e9d8]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DzudlWLk {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DzudlWLk" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7809beb7-5fdb-402f-9ff3-13ab4e27677b]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DzudlWLk'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc99217e-02c1-4594-bf0e-ac8abe3131ac]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c9e7fc-de6b-47f7-a0f1-633c7c5b3fb2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 23:51:04 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 23:51:04 user nova-compute[73497]:  {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:51:04 user nova-compute[73497]: WARNING os_brick.initiator.connectors.iscsi [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 23:51:04 user nova-compute[73497]: 
Aug 26 23:51:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[228417eb-f411-4406-abb2-6417708871d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02, portal: 172.16.0.220,3260]
Aug 26 23:51:04 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02, portal: 172.16.0.220,3260] successful.
Aug 26 23:51:04 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec89d3cf-0f86-4680-bebc-5f8d92e17c84]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3bd941-a770-4d68-8181-f6d67a9cca75]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02 (non-flash)
Aug 26 23:51:04 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02 (non-flash)
Aug 26 23:51:04 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[52751396-1a31-4f66-962b-44c0c2738694]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:51:04 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:51:05 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:51:05 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DzudlWLk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:51:05 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:51:05 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '26339656532336661', 'path': '/dev/sdb'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:51:05 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339656532336661', 'path': '/dev/sdb'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:51:05 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:50:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-210262312',display_name='tempest-TestVolumeBootPattern-volume-backed-server-210262312',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-210262312',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4MR2FG7BqlrKo75NYMKAFq7lqm7HDvYw55d2SQjEuOE+3uidRIMTHejVRoV3sNAoT9EkMQQH7F+ifmSjH02xgswW0k7okIr91koWaMuawetFmfmiXe5S3wgF/FuCfvQw==',key_name='tempest-keypair-1270060275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba3491abf5cc4e77aed2997a5ac8aeee',ramdisk_id='',reservation_id='r-84ki0n32',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-377601332',owner_user_name='tempest-TestVolumeBootPattern-377601332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:50:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbd048b30716490880ff4b28758536a5',uuid=2d7e3edd-c03b-43ec-85d4-ada44181f10d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6df10372-5b2e-4b60-bd27-2c23866e83d0", "address": "fa:16:3e:cf:5c:0d", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df10372-5b", "ovs_interfaceid": "6df10372-5b2e-4b60-bd27-2c23866e83d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:51:05 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Converting VIF {"id": "6df10372-5b2e-4b60-bd27-2c23866e83d0", "address": "fa:16:3e:cf:5c:0d", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df10372-5b", "ovs_interfaceid": "6df10372-5b2e-4b60-bd27-2c23866e83d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:51:05 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:5c:0d,bridge_name='br-int',has_traffic_filtering=True,id=6df10372-5b2e-4b60-bd27-2c23866e83d0,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df10372-5b') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:51:05 user nova-compute[73497]: DEBUG nova.objects.instance [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d7e3edd-c03b-43ec-85d4-ada44181f10d {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:51:05 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:51:05 user nova-compute[73497]:   <uuid>2d7e3edd-c03b-43ec-85d4-ada44181f10d</uuid>
Aug 26 23:51:05 user nova-compute[73497]:   <name>instance-00000030</name>
Aug 26 23:51:05 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:51:05 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:51:05 user nova-compute[73497]:   <metadata>
Aug 26 23:51:05 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:51:05 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:51:05 user nova-compute[73497]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-210262312</nova:name>
Aug 26 23:51:05 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:51:04</nova:creationTime>
Aug 26 23:51:05 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:51:05 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:51:05 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:51:05 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:51:05 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:51:05 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:51:05 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:51:05 user nova-compute[73497]:       <nova:owner>
Aug 26 23:51:05 user nova-compute[73497]:         <nova:user uuid="dbd048b30716490880ff4b28758536a5">tempest-TestVolumeBootPattern-377601332-project-member</nova:user>
Aug 26 23:51:05 user nova-compute[73497]:         <nova:project uuid="ba3491abf5cc4e77aed2997a5ac8aeee">tempest-TestVolumeBootPattern-377601332</nova:project>
Aug 26 23:51:05 user nova-compute[73497]:       </nova:owner>
Aug 26 23:51:05 user nova-compute[73497]:       <nova:ports>
Aug 26 23:51:05 user nova-compute[73497]:         <nova:port uuid="6df10372-5b2e-4b60-bd27-2c23866e83d0">
Aug 26 23:51:05 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 23:51:05 user nova-compute[73497]:         </nova:port>
Aug 26 23:51:05 user nova-compute[73497]:       </nova:ports>
Aug 26 23:51:05 user nova-compute[73497]:     </nova:instance>
Aug 26 23:51:05 user nova-compute[73497]:   </metadata>
Aug 26 23:51:05 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:51:05 user nova-compute[73497]:     <system>
Aug 26 23:51:05 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:51:05 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:51:05 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:51:05 user nova-compute[73497]:       <entry name="serial">2d7e3edd-c03b-43ec-85d4-ada44181f10d</entry>
Aug 26 23:51:05 user nova-compute[73497]:       <entry name="uuid">2d7e3edd-c03b-43ec-85d4-ada44181f10d</entry>
Aug 26 23:51:05 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:51:05 user nova-compute[73497]:     </system>
Aug 26 23:51:05 user nova-compute[73497]:   </sysinfo>
Aug 26 23:51:05 user nova-compute[73497]:   <os>
Aug 26 23:51:05 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:51:05 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:51:05 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:51:05 user nova-compute[73497]:   </os>
Aug 26 23:51:05 user nova-compute[73497]:   <features>
Aug 26 23:51:05 user nova-compute[73497]:     <acpi/>
Aug 26 23:51:05 user nova-compute[73497]:     <apic/>
Aug 26 23:51:05 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:51:05 user nova-compute[73497]:   </features>
Aug 26 23:51:05 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:51:05 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:51:05 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:51:05 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:51:05 user nova-compute[73497]:   </clock>
Aug 26 23:51:05 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:51:05 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:51:05 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:51:05 user nova-compute[73497]:   </cpu>
Aug 26 23:51:05 user nova-compute[73497]:   <devices>
Aug 26 23:51:05 user nova-compute[73497]:     <disk type="block" device="disk">
Aug 26 23:51:05 user nova-compute[73497]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:51:05 user nova-compute[73497]:       <source dev="/dev/sdb"/>
Aug 26 23:51:05 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:51:05 user nova-compute[73497]:       <serial>506ff10c-b609-487a-ac7a-6fa06e43bb02</serial>
Aug 26 23:51:05 user nova-compute[73497]:     </disk>
Aug 26 23:51:05 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:51:05 user nova-compute[73497]:       <mac address="fa:16:3e:cf:5c:0d"/>
Aug 26 23:51:05 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:51:05 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:51:05 user nova-compute[73497]:       <target dev="tap6df10372-5b"/>
Aug 26 23:51:05 user nova-compute[73497]:     </interface>
Aug 26 23:51:05 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:51:05 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/2d7e3edd-c03b-43ec-85d4-ada44181f10d/console.log" append="off"/>
Aug 26 23:51:05 user nova-compute[73497]:     </serial>
Aug 26 23:51:05 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:51:05 user nova-compute[73497]:     <video>
Aug 26 23:51:05 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:51:05 user nova-compute[73497]:     </video>
Aug 26 23:51:05 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:51:05 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:51:05 user nova-compute[73497]:     </rng>
Aug 26 23:51:05 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:51:05 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:51:05 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:51:05 user nova-compute[73497]:     </memballoon>
Aug 26 23:51:05 user nova-compute[73497]:   </devices>
Aug 26 23:51:05 user nova-compute[73497]: </domain>
Aug 26 23:51:05 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:51:05 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:50:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-210262312',display_name='tempest-TestVolumeBootPattern-volume-backed-server-210262312',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-210262312',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4MR2FG7BqlrKo75NYMKAFq7lqm7HDvYw55d2SQjEuOE+3uidRIMTHejVRoV3sNAoT9EkMQQH7F+ifmSjH02xgswW0k7okIr91koWaMuawetFmfmiXe5S3wgF/FuCfvQw==',key_name='tempest-keypair-1270060275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba3491abf5cc4e77aed2997a5ac8aeee',ramdisk_id='',reservation_id='r-84ki0n32',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-377601332',owner_user_name='tempest-TestVolumeBootPattern-377601332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:50:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbd048b30716490880ff4b28758536a5',uuid=2d7e3edd-c03b-43ec-85d4-ada44181f10d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6df10372-5b2e-4b60-bd27-2c23866e83d0", "address": "fa:16:3e:cf:5c:0d", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df10372-5b", "ovs_interfaceid": "6df10372-5b2e-4b60-bd27-2c23866e83d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:51:05 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Converting VIF {"id": "6df10372-5b2e-4b60-bd27-2c23866e83d0", "address": "fa:16:3e:cf:5c:0d", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df10372-5b", "ovs_interfaceid": "6df10372-5b2e-4b60-bd27-2c23866e83d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:51:05 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:5c:0d,bridge_name='br-int',has_traffic_filtering=True,id=6df10372-5b2e-4b60-bd27-2c23866e83d0,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df10372-5b') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:51:05 user nova-compute[73497]: DEBUG os_vif [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:5c:0d,bridge_name='br-int',has_traffic_filtering=True,id=6df10372-5b2e-4b60-bd27-2c23866e83d0,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df10372-5b') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:51:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:51:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:51:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:51:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:51:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6df10372-5b, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:51:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6df10372-5b, col_values=(('external_ids', {'iface-id': '6df10372-5b2e-4b60-bd27-2c23866e83d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:5c:0d', 'vm-uuid': '2d7e3edd-c03b-43ec-85d4-ada44181f10d'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:51:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:51:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:51:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:51:05 user nova-compute[73497]: INFO os_vif [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:5c:0d,bridge_name='br-int',has_traffic_filtering=True,id=6df10372-5b2e-4b60-bd27-2c23866e83d0,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df10372-5b')
Aug 26 23:51:05 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:51:05 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] No VIF found with MAC fa:16:3e:cf:5c:0d, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:51:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:51:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:51:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:51:07 user nova-compute[73497]: DEBUG nova.compute.manager [req-1ad829ba-bdf9-4940-8434-47cc10f78ad0 req-7adaf55b-a865-4743-9149-671e4b5c6450 service nova] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Received event network-vif-plugged-6df10372-5b2e-4b60-bd27-2c23866e83d0 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:51:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1ad829ba-bdf9-4940-8434-47cc10f78ad0 req-7adaf55b-a865-4743-9149-671e4b5c6450 service nova] Acquiring lock "2d7e3edd-c03b-43ec-85d4-ada44181f10d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:51:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1ad829ba-bdf9-4940-8434-47cc10f78ad0 req-7adaf55b-a865-4743-9149-671e4b5c6450 service nova] Lock "2d7e3edd-c03b-43ec-85d4-ada44181f10d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:51:07 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1ad829ba-bdf9-4940-8434-47cc10f78ad0 req-7adaf55b-a865-4743-9149-671e4b5c6450 service nova] Lock "2d7e3edd-c03b-43ec-85d4-ada44181f10d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:51:07 user nova-compute[73497]: DEBUG nova.compute.manager [req-1ad829ba-bdf9-4940-8434-47cc10f78ad0 req-7adaf55b-a865-4743-9149-671e4b5c6450 service nova] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] No waiting events found dispatching network-vif-plugged-6df10372-5b2e-4b60-bd27-2c23866e83d0 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:51:07 user nova-compute[73497]: WARNING nova.compute.manager [req-1ad829ba-bdf9-4940-8434-47cc10f78ad0 req-7adaf55b-a865-4743-9149-671e4b5c6450 service nova] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Received unexpected event network-vif-plugged-6df10372-5b2e-4b60-bd27-2c23866e83d0 for instance with vm_state building and task_state spawning.
Aug 26 23:51:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:51:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:51:09 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693093869.3928368, 2d7e3edd-c03b-43ec-85d4-ada44181f10d => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:51:09 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] VM Resumed (Lifecycle Event)
Aug 26 23:51:09 user nova-compute[73497]: DEBUG nova.compute.manager [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:51:09 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:51:09 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Instance spawned successfully.
Aug 26 23:51:09 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:51:09 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:51:09 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:51:09 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:51:09 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:51:09 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:51:09 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:51:09 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:51:09 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:51:09 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:51:09 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693093869.3942184, 2d7e3edd-c03b-43ec-85d4-ada44181f10d => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:51:09 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] VM Started (Lifecycle Event)
Aug 26 23:51:09 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:51:09 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:51:09 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:51:09 user nova-compute[73497]: INFO nova.compute.manager [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Took 5.18 seconds to spawn the instance on the hypervisor.
Aug 26 23:51:09 user nova-compute[73497]: DEBUG nova.compute.manager [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:51:09 user nova-compute[73497]: INFO nova.compute.manager [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Took 17.79 seconds to build instance.
Aug 26 23:51:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-db6f5c1a-3ef2-4b32-98f3-fb87502ad271 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "2d7e3edd-c03b-43ec-85d4-ada44181f10d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.893s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:51:09 user nova-compute[73497]: DEBUG nova.compute.manager [req-abb55d10-0f29-4acf-b592-6476ae503988 req-e250d932-1f00-4edf-a399-294806fd2b91 service nova] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Received event network-vif-plugged-6df10372-5b2e-4b60-bd27-2c23866e83d0 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:51:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-abb55d10-0f29-4acf-b592-6476ae503988 req-e250d932-1f00-4edf-a399-294806fd2b91 service nova] Acquiring lock "2d7e3edd-c03b-43ec-85d4-ada44181f10d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:51:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-abb55d10-0f29-4acf-b592-6476ae503988 req-e250d932-1f00-4edf-a399-294806fd2b91 service nova] Lock "2d7e3edd-c03b-43ec-85d4-ada44181f10d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:51:09 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-abb55d10-0f29-4acf-b592-6476ae503988 req-e250d932-1f00-4edf-a399-294806fd2b91 service nova] Lock "2d7e3edd-c03b-43ec-85d4-ada44181f10d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:51:09 user nova-compute[73497]: DEBUG nova.compute.manager [req-abb55d10-0f29-4acf-b592-6476ae503988 req-e250d932-1f00-4edf-a399-294806fd2b91 service nova] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] No waiting events found dispatching network-vif-plugged-6df10372-5b2e-4b60-bd27-2c23866e83d0 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:51:09 user nova-compute[73497]: WARNING nova.compute.manager [req-abb55d10-0f29-4acf-b592-6476ae503988 req-e250d932-1f00-4edf-a399-294806fd2b91 service nova] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Received unexpected event network-vif-plugged-6df10372-5b2e-4b60-bd27-2c23866e83d0 for instance with vm_state active and task_state None.
Aug 26 23:51:10 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:51:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c6331f7f-6e86-4fc7-a996-221c2db3135a tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Acquiring lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:51:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c6331f7f-6e86-4fc7-a996-221c2db3135a tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:51:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c6331f7f-6e86-4fc7-a996-221c2db3135a tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Acquiring lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:51:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c6331f7f-6e86-4fc7-a996-221c2db3135a tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:51:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c6331f7f-6e86-4fc7-a996-221c2db3135a tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:51:12 user nova-compute[73497]: INFO nova.compute.manager [None req-c6331f7f-6e86-4fc7-a996-221c2db3135a tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Terminating instance
Aug 26 23:51:12 user nova-compute[73497]: DEBUG nova.compute.manager [None req-c6331f7f-6e86-4fc7-a996-221c2db3135a tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:51:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:51:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:51:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:51:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:51:12 user nova-compute[73497]: DEBUG nova.compute.manager [req-5c7ec7bf-6d46-4cd1-9aba-1e14b896ead6 req-fbf5d903-68e7-4c32-8b42-95e96879e40a service nova] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Received event network-vif-unplugged-be3535c5-b3b6-4ba8-b65f-52aab2b14bd7 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:51:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-5c7ec7bf-6d46-4cd1-9aba-1e14b896ead6 req-fbf5d903-68e7-4c32-8b42-95e96879e40a service nova] Acquiring lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:51:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-5c7ec7bf-6d46-4cd1-9aba-1e14b896ead6 req-fbf5d903-68e7-4c32-8b42-95e96879e40a service nova] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:51:12 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-5c7ec7bf-6d46-4cd1-9aba-1e14b896ead6 req-fbf5d903-68e7-4c32-8b42-95e96879e40a service nova] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:51:12 user nova-compute[73497]: DEBUG nova.compute.manager [req-5c7ec7bf-6d46-4cd1-9aba-1e14b896ead6 req-fbf5d903-68e7-4c32-8b42-95e96879e40a service nova] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] No waiting events found dispatching network-vif-unplugged-be3535c5-b3b6-4ba8-b65f-52aab2b14bd7 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:51:12 user nova-compute[73497]: DEBUG nova.compute.manager [req-5c7ec7bf-6d46-4cd1-9aba-1e14b896ead6 req-fbf5d903-68e7-4c32-8b42-95e96879e40a service nova] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Received event network-vif-unplugged-be3535c5-b3b6-4ba8-b65f-52aab2b14bd7 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:51:12 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Instance destroyed successfully.
Aug 26 23:51:12 user nova-compute[73497]: DEBUG nova.objects.instance [None req-c6331f7f-6e86-4fc7-a996-221c2db3135a tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lazy-loading 'resources' on Instance uuid b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:51:12 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-c6331f7f-6e86-4fc7-a996-221c2db3135a tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:43:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1372230139',display_name='tempest-SnapshotDataIntegrityTests-server-1372230139',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1372230139',id=46,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrDeQSWLaQk2aT4W//nQDr35jKm356Eei4uFN/RFJ8nOvpJZXruXwqVc6ZsnfkGZetRjoZyWlwNxZEqy0no4k9oSSK+uSHD8to4wRbYBvud2RMLsSjiyGAHuew3fhpi+Q==',key_name='tempest-keypair-1650802611',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:43:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84b4e25a5f524b9a9a68b736ac63c374',ramdisk_id='',reservation_id='r-0t9010l2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1593163983',owner_user_name='tempest-SnapshotDataIntegrityTests-1593163983-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:43:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad03475a8f5948fcbc8f1c56ca7a0bb7',uuid=b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be3535c5-b3b6-4ba8-b65f-52aab2b14bd7", "address": "fa:16:3e:9e:da:e1", "network": {"id": "0e605a84-41cf-4b4e-9c26-c97bc4635df8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-20815531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84b4e25a5f524b9a9a68b736ac63c374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3535c5-b3", "ovs_interfaceid": "be3535c5-b3b6-4ba8-b65f-52aab2b14bd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:51:12 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-c6331f7f-6e86-4fc7-a996-221c2db3135a tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Converting VIF {"id": "be3535c5-b3b6-4ba8-b65f-52aab2b14bd7", "address": "fa:16:3e:9e:da:e1", "network": {"id": "0e605a84-41cf-4b4e-9c26-c97bc4635df8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-20815531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84b4e25a5f524b9a9a68b736ac63c374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3535c5-b3", "ovs_interfaceid": "be3535c5-b3b6-4ba8-b65f-52aab2b14bd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:51:12 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-c6331f7f-6e86-4fc7-a996-221c2db3135a tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:da:e1,bridge_name='br-int',has_traffic_filtering=True,id=be3535c5-b3b6-4ba8-b65f-52aab2b14bd7,network=Network(0e605a84-41cf-4b4e-9c26-c97bc4635df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe3535c5-b3') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:51:12 user nova-compute[73497]: DEBUG os_vif [None req-c6331f7f-6e86-4fc7-a996-221c2db3135a tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:da:e1,bridge_name='br-int',has_traffic_filtering=True,id=be3535c5-b3b6-4ba8-b65f-52aab2b14bd7,network=Network(0e605a84-41cf-4b4e-9c26-c97bc4635df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe3535c5-b3') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:51:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:51:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe3535c5-b3, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:51:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:51:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:51:12 user nova-compute[73497]: INFO os_vif [None req-c6331f7f-6e86-4fc7-a996-221c2db3135a tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:da:e1,bridge_name='br-int',has_traffic_filtering=True,id=be3535c5-b3b6-4ba8-b65f-52aab2b14bd7,network=Network(0e605a84-41cf-4b4e-9c26-c97bc4635df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe3535c5-b3')
Aug 26 23:51:12 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-c6331f7f-6e86-4fc7-a996-221c2db3135a tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Deleting instance files /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02_del
Aug 26 23:51:12 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-c6331f7f-6e86-4fc7-a996-221c2db3135a tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Deletion of /opt/stack/data/nova/instances/b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02_del complete
Aug 26 23:51:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:51:12 user nova-compute[73497]: INFO nova.compute.manager [None req-c6331f7f-6e86-4fc7-a996-221c2db3135a tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 26 23:51:12 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-c6331f7f-6e86-4fc7-a996-221c2db3135a tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:51:12 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:51:12 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:51:13 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:51:13 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Took 0.91 seconds to deallocate network for instance.
Aug 26 23:51:13 user nova-compute[73497]: DEBUG nova.compute.manager [req-ca079010-03e7-49aa-9196-3cf2272aac8a req-eaf44c12-e01b-4493-b81a-77a494af049b service nova] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Received event network-vif-deleted-be3535c5-b3b6-4ba8-b65f-52aab2b14bd7 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:51:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c6331f7f-6e86-4fc7-a996-221c2db3135a tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:51:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c6331f7f-6e86-4fc7-a996-221c2db3135a tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:51:13 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-c6331f7f-6e86-4fc7-a996-221c2db3135a tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Refreshing inventories for resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 23:51:14 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-c6331f7f-6e86-4fc7-a996-221c2db3135a tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Updating ProviderTree inventory for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 23:51:14 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-c6331f7f-6e86-4fc7-a996-221c2db3135a tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Updating inventory in ProviderTree for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 23:51:14 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-c6331f7f-6e86-4fc7-a996-221c2db3135a tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Refreshing aggregate associations for resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1, aggregates: None {{(pid=73497) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 23:51:14 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-c6331f7f-6e86-4fc7-a996-221c2db3135a tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Refreshing trait associations for resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING {{(pid=73497) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 23:51:14 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-c6331f7f-6e86-4fc7-a996-221c2db3135a tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:51:14 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-c6331f7f-6e86-4fc7-a996-221c2db3135a tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:51:14 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:51:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c6331f7f-6e86-4fc7-a996-221c2db3135a tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.264s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:51:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:51:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:51:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:51:14 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:51:14 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-c6331f7f-6e86-4fc7-a996-221c2db3135a tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Deleted allocations for instance b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02
Aug 26 23:51:14 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:51:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-c6331f7f-6e86-4fc7-a996-221c2db3135a tempest-SnapshotDataIntegrityTests-1593163983 tempest-SnapshotDataIntegrityTests-1593163983-project-member] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.309s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:51:14 user nova-compute[73497]: DEBUG nova.compute.manager [req-d2c61412-6792-4252-a177-36b783cc77a5 req-2647f29b-4f6b-4c93-8a0a-e32c07841dbe service nova] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Received event network-vif-plugged-be3535c5-b3b6-4ba8-b65f-52aab2b14bd7 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:51:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d2c61412-6792-4252-a177-36b783cc77a5 req-2647f29b-4f6b-4c93-8a0a-e32c07841dbe service nova] Acquiring lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:51:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d2c61412-6792-4252-a177-36b783cc77a5 req-2647f29b-4f6b-4c93-8a0a-e32c07841dbe service nova] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:51:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-d2c61412-6792-4252-a177-36b783cc77a5 req-2647f29b-4f6b-4c93-8a0a-e32c07841dbe service nova] Lock "b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:51:14 user nova-compute[73497]: DEBUG nova.compute.manager [req-d2c61412-6792-4252-a177-36b783cc77a5 req-2647f29b-4f6b-4c93-8a0a-e32c07841dbe service nova] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] No waiting events found dispatching network-vif-plugged-be3535c5-b3b6-4ba8-b65f-52aab2b14bd7 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:51:14 user nova-compute[73497]: WARNING nova.compute.manager [req-d2c61412-6792-4252-a177-36b783cc77a5 req-2647f29b-4f6b-4c93-8a0a-e32c07841dbe service nova] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Received unexpected event network-vif-plugged-be3535c5-b3b6-4ba8-b65f-52aab2b14bd7 for instance with vm_state deleted and task_state None.
Aug 26 23:51:14 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:51:14 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:51:14 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8788MB free_disk=25.072486877441406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:51:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:51:14 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:51:14 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 2d7e3edd-c03b-43ec-85d4-ada44181f10d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:51:14 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:51:14 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:51:14 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:51:14 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:51:15 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:51:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:51:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:51:19 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:51:19 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:51:20 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:51:22 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:51:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:51:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:51:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:51:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:51:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:51:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:51:25 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:51:27 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:51:27 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693093872.8221383, b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:51:27 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] VM Stopped (Lifecycle Event)
Aug 26 23:51:27 user nova-compute[73497]: DEBUG nova.compute.manager [None req-21892193-51e1-412f-ab9e-eaafdb188ca5 None None] [instance: b1ddbbb3-fb9c-49d7-962b-7fdc6d9b0d02] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:51:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:51:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:51:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:51:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:51:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:51:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:51:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:51:31 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:51:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:51:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:51:33 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:51:35 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:51:35 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:51:35 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Rebuilding the list of instances to heal {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 23:51:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-2d7e3edd-c03b-43ec-85d4-ada44181f10d" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:51:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-2d7e3edd-c03b-43ec-85d4-ada44181f10d" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:51:35 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:51:35 user nova-compute[73497]: DEBUG nova.objects.instance [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lazy-loading 'info_cache' on Instance uuid 2d7e3edd-c03b-43ec-85d4-ada44181f10d {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:51:35 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Updating instance_info_cache with network_info: [{"id": "6df10372-5b2e-4b60-bd27-2c23866e83d0", "address": "fa:16:3e:cf:5c:0d", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df10372-5b", "ovs_interfaceid": "6df10372-5b2e-4b60-bd27-2c23866e83d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:51:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-2d7e3edd-c03b-43ec-85d4-ada44181f10d" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:51:35 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:51:36 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:51:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:51:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:51:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:51:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:51:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:51:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:52:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:52:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:52:05 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:52:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:52:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:52:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:52:15 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:52:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:52:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:52:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:52:15 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:52:15 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:52:15 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:52:15 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:52:15 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8778MB free_disk=25.070953369140625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:52:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:52:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:52:15 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 2d7e3edd-c03b-43ec-85d4-ada44181f10d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:52:15 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:52:15 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:52:15 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:52:15 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:52:15 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:52:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:52:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:52:19 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:52:19 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:52:22 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:52:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:52:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:52:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:52:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:52:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:52:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:52:24 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:52:26 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:52:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:52:28 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:52:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:52:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:52:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:52:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:52:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:52:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:52:33 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:52:35 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:52:36 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:52:36 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:52:36 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Rebuilding the list of instances to heal {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 23:52:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-2d7e3edd-c03b-43ec-85d4-ada44181f10d" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:52:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-2d7e3edd-c03b-43ec-85d4-ada44181f10d" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:52:36 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:52:36 user nova-compute[73497]: DEBUG nova.objects.instance [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lazy-loading 'info_cache' on Instance uuid 2d7e3edd-c03b-43ec-85d4-ada44181f10d {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:52:36 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Updating instance_info_cache with network_info: [{"id": "6df10372-5b2e-4b60-bd27-2c23866e83d0", "address": "fa:16:3e:cf:5c:0d", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df10372-5b", "ovs_interfaceid": "6df10372-5b2e-4b60-bd27-2c23866e83d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:52:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-2d7e3edd-c03b-43ec-85d4-ada44181f10d" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:52:36 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:52:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:52:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:52:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:52:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:52:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:52:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:52:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:52:43 user nova-compute[73497]: DEBUG nova.compute.manager [req-2c78a78c-81d0-4f10-97a0-eb234b294bae req-07f8aca3-5e5f-49aa-b533-283dfa4b23dd service nova] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Received event network-changed-6df10372-5b2e-4b60-bd27-2c23866e83d0 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:52:43 user nova-compute[73497]: DEBUG nova.compute.manager [req-2c78a78c-81d0-4f10-97a0-eb234b294bae req-07f8aca3-5e5f-49aa-b533-283dfa4b23dd service nova] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Refreshing instance network info cache due to event network-changed-6df10372-5b2e-4b60-bd27-2c23866e83d0. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:52:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2c78a78c-81d0-4f10-97a0-eb234b294bae req-07f8aca3-5e5f-49aa-b533-283dfa4b23dd service nova] Acquiring lock "refresh_cache-2d7e3edd-c03b-43ec-85d4-ada44181f10d" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:52:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2c78a78c-81d0-4f10-97a0-eb234b294bae req-07f8aca3-5e5f-49aa-b533-283dfa4b23dd service nova] Acquired lock "refresh_cache-2d7e3edd-c03b-43ec-85d4-ada44181f10d" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:52:43 user nova-compute[73497]: DEBUG nova.network.neutron [req-2c78a78c-81d0-4f10-97a0-eb234b294bae req-07f8aca3-5e5f-49aa-b533-283dfa4b23dd service nova] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Refreshing network info cache for port 6df10372-5b2e-4b60-bd27-2c23866e83d0 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:52:43 user nova-compute[73497]: DEBUG nova.network.neutron [req-2c78a78c-81d0-4f10-97a0-eb234b294bae req-07f8aca3-5e5f-49aa-b533-283dfa4b23dd service nova] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Updated VIF entry in instance network info cache for port 6df10372-5b2e-4b60-bd27-2c23866e83d0. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:52:43 user nova-compute[73497]: DEBUG nova.network.neutron [req-2c78a78c-81d0-4f10-97a0-eb234b294bae req-07f8aca3-5e5f-49aa-b533-283dfa4b23dd service nova] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Updating instance_info_cache with network_info: [{"id": "6df10372-5b2e-4b60-bd27-2c23866e83d0", "address": "fa:16:3e:cf:5c:0d", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df10372-5b", "ovs_interfaceid": "6df10372-5b2e-4b60-bd27-2c23866e83d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:52:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2c78a78c-81d0-4f10-97a0-eb234b294bae req-07f8aca3-5e5f-49aa-b533-283dfa4b23dd service nova] Releasing lock "refresh_cache-2d7e3edd-c03b-43ec-85d4-ada44181f10d" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:52:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:52:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:52:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:52:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:52:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "e331c230-4482-4bff-8a19-1509178b8f49" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:52:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "e331c230-4482-4bff-8a19-1509178b8f49" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:52:55 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:52:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:52:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:52:55 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:52:55 user nova-compute[73497]: INFO nova.compute.claims [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Claim successful on node user
Aug 26 23:52:56 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:52:56 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:52:56 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:52:56 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:52:56 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:52:56 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:52:56 user nova-compute[73497]: DEBUG nova.network.neutron [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:52:56 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:52:56 user nova-compute[73497]: INFO nova.virt.block_device [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Booting with volume snapshot 7ea7e4b7-af7f-47c3-871c-3930b794655d at /dev/vda
Aug 26 23:52:56 user nova-compute[73497]: DEBUG nova.policy [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dbd048b30716490880ff4b28758536a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3491abf5cc4e77aed2997a5ac8aeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:52:57 user nova-compute[73497]: DEBUG nova.network.neutron [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Successfully created port: a5113499-36a4-445b-b6c9-0563e08235e2 {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:52:57 user nova-compute[73497]: DEBUG nova.network.neutron [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Successfully updated port: a5113499-36a4-445b-b6c9-0563e08235e2 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:52:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "refresh_cache-e331c230-4482-4bff-8a19-1509178b8f49" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:52:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquired lock "refresh_cache-e331c230-4482-4bff-8a19-1509178b8f49" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:52:57 user nova-compute[73497]: DEBUG nova.network.neutron [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:52:57 user nova-compute[73497]: DEBUG nova.compute.manager [req-496b3cf8-2d29-459d-947c-ff01d4ab047d req-b3952532-11c4-47c9-bb17-a30cd807348d service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Received event network-changed-a5113499-36a4-445b-b6c9-0563e08235e2 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:52:57 user nova-compute[73497]: DEBUG nova.compute.manager [req-496b3cf8-2d29-459d-947c-ff01d4ab047d req-b3952532-11c4-47c9-bb17-a30cd807348d service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Refreshing instance network info cache due to event network-changed-a5113499-36a4-445b-b6c9-0563e08235e2. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:52:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-496b3cf8-2d29-459d-947c-ff01d4ab047d req-b3952532-11c4-47c9-bb17-a30cd807348d service nova] Acquiring lock "refresh_cache-e331c230-4482-4bff-8a19-1509178b8f49" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:52:57 user nova-compute[73497]: DEBUG nova.network.neutron [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:52:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:52:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:52:58 user nova-compute[73497]: DEBUG nova.network.neutron [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Updating instance_info_cache with network_info: [{"id": "a5113499-36a4-445b-b6c9-0563e08235e2", "address": "fa:16:3e:70:89:8f", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5113499-36", "ovs_interfaceid": "a5113499-36a4-445b-b6c9-0563e08235e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:52:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Releasing lock "refresh_cache-e331c230-4482-4bff-8a19-1509178b8f49" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:52:58 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Instance network_info: |[{"id": "a5113499-36a4-445b-b6c9-0563e08235e2", "address": "fa:16:3e:70:89:8f", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5113499-36", "ovs_interfaceid": "a5113499-36a4-445b-b6c9-0563e08235e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:52:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-496b3cf8-2d29-459d-947c-ff01d4ab047d req-b3952532-11c4-47c9-bb17-a30cd807348d service nova] Acquired lock "refresh_cache-e331c230-4482-4bff-8a19-1509178b8f49" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:52:58 user nova-compute[73497]: DEBUG nova.network.neutron [req-496b3cf8-2d29-459d-947c-ff01d4ab047d req-b3952532-11c4-47c9-bb17-a30cd807348d service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Refreshing network info cache for port a5113499-36a4-445b-b6c9-0563e08235e2 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:52:58 user nova-compute[73497]: DEBUG nova.network.neutron [req-496b3cf8-2d29-459d-947c-ff01d4ab047d req-b3952532-11c4-47c9-bb17-a30cd807348d service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Updated VIF entry in instance network info cache for port a5113499-36a4-445b-b6c9-0563e08235e2. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:52:58 user nova-compute[73497]: DEBUG nova.network.neutron [req-496b3cf8-2d29-459d-947c-ff01d4ab047d req-b3952532-11c4-47c9-bb17-a30cd807348d service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Updating instance_info_cache with network_info: [{"id": "a5113499-36a4-445b-b6c9-0563e08235e2", "address": "fa:16:3e:70:89:8f", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5113499-36", "ovs_interfaceid": "a5113499-36a4-445b-b6c9-0563e08235e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:52:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-496b3cf8-2d29-459d-947c-ff01d4ab047d req-b3952532-11c4-47c9-bb17-a30cd807348d service nova] Releasing lock "refresh_cache-e331c230-4482-4bff-8a19-1509178b8f49" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:53:02 user nova-compute[73497]: DEBUG os_brick.utils [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:53:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:53:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:53:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a192e6a-fa89-4af4-b43a-928562903f34]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:53:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:53:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:53:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2a4687-b88a-405a-b96e-ead1eb53e8f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:53:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:53:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:53:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1de5ae4-8020-43f8-8f3d-9f317cda97ab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:53:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[666c087c-e5d6-41a4-8799-74f1d3f6b6e0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:53:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:53:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:53:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:53:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:53:02 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:53:02 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:53:02 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[638ba2e1-a67f-4fb8-bfff-46d6d424b5ab]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:53:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:53:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:53:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:53:02 user nova-compute[73497]: DEBUG os_brick.utils [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:53:02 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Updating existing volume attachment record: 806df8f1-8364-4fcc-8859-99bffbeff307 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:53:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:53:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:53:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:53:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:53:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:53:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:53:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:53:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:53:13 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Creating image(s)
Aug 26 23:53:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Did not create local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Ensure instance console log exists: /opt/stack/data/nova/instances/e331c230-4482-4bff-8a19-1509178b8f49/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Start _get_guest_xml network_info=[{"id": "a5113499-36a4-445b-b6c9-0563e08235e2", "address": "fa:16:3e:70:89:8f", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5113499-36", "ovs_interfaceid": "a5113499-36a4-445b-b6c9-0563e08235e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-26T23:52:44Z,direct_url=<?>,disk_format='qcow2',id=64f24293-4a5b-423d-8568-e148e7b34929,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1791167352',owner='ba3491abf5cc4e77aed2997a5ac8aeee',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-26T23:52:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '806df8f1-8364-4fcc-8859-99bffbeff307', 'guest_format': None, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KuiaDvtI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e331c230-4482-4bff-8a19-1509178b8f49', 'attached_at': '', 'detached_at': '', 'volume_id': 'd6578f85-8747-4d8f-90f8-a1e0934db13f', 'serial': 'd6578f85-8747-4d8f-90f8-a1e0934db13f'}, 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:53:13 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:53:13 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:53:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-26T23:52:44Z,direct_url=<?>,disk_format='qcow2',id=64f24293-4a5b-423d-8568-e148e7b34929,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1791167352',owner='ba3491abf5cc4e77aed2997a5ac8aeee',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-26T23:52:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KuiaDvtI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:53:13 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:53:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:53:13 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:53:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:53:13 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:53:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd08a5f9-7232-4535-aae2-ec4935977025]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:53:13 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5ab662-098d-46d3-827a-d22de6ccb50c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f] added
Aug 26 23:53:13 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea684af-4115-44be-a712-ed9267a9cf49]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[988d808e-9966-4c6a-b660-4383a207ffc0]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KuiaDvtI {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KuiaDvtI" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be43437-07c1-4b90-a238-24bde512415f]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KuiaDvtI'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[26166737-5935-479b-b530-43fa4ec6f803]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7547e0a9-0822-43da-b380-2f69419cc53a]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02 (non-flash)
Aug 26 23:53:13 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02 (non-flash)
Aug 26 23:53:13 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[242d58c2-8718-47bb-a4d3-babd41af9e82]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f, portal: 172.16.0.220,3260]
Aug 26 23:53:13 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f, portal: 172.16.0.220,3260] successful.
Aug 26 23:53:13 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea03e79-fa72-4875-b7eb-074237c760b9]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f63c7a-03ef-4f90-8126-f15d698c47c1]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02 (non-flash)
Aug 26 23:53:13 user nova-compute[73497]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f (non-flash)
Aug 26 23:53:13 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02 (non-flash)
Aug 26 23:53:13 user nova-compute[73497]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f (non-flash)
Aug 26 23:53:13 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[27beb768-ff45-41a9-b716-f2d1cbd153bd]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:53:13 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KuiaDvtI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:53:14 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:53:14 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23066396230383639', 'path': '/dev/sdc'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:53:14 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066396230383639', 'path': '/dev/sdc'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:53:14 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-121325070',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-121325070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-121325070',id=49,image_ref='64f24293-4a5b-423d-8568-e148e7b34929',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPt6513oYHHBetYSEDTDRhX+xYcZzP336edFWGaU6CV+ScSciZX/7YeU3EM5POXYNPjElBZahQnAkYQ5farFXnmQayp+4u65raymwWSifDiZBrRAtML5kSwZZ30BcD9pkQ==',key_name='tempest-keypair-186744434',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba3491abf5cc4e77aed2997a5ac8aeee',ramdisk_id='',reservation_id='r-7daoww6l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-377601332',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-377601332-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-377601332',owner_user_name='tempest-TestVolumeBootPattern-377601332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:52:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbd048b30716490880ff4b28758536a5',uuid=e331c230-4482-4bff-8a19-1509178b8f49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5113499-36a4-445b-b6c9-0563e08235e2", "address": "fa:16:3e:70:89:8f", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5113499-36", "ovs_interfaceid": "a5113499-36a4-445b-b6c9-0563e08235e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:53:14 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Converting VIF {"id": "a5113499-36a4-445b-b6c9-0563e08235e2", "address": "fa:16:3e:70:89:8f", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5113499-36", "ovs_interfaceid": "a5113499-36a4-445b-b6c9-0563e08235e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:53:14 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:89:8f,bridge_name='br-int',has_traffic_filtering=True,id=a5113499-36a4-445b-b6c9-0563e08235e2,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5113499-36') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:53:14 user nova-compute[73497]: DEBUG nova.objects.instance [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lazy-loading 'pci_devices' on Instance uuid e331c230-4482-4bff-8a19-1509178b8f49 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:53:14 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:53:14 user nova-compute[73497]:   <uuid>e331c230-4482-4bff-8a19-1509178b8f49</uuid>
Aug 26 23:53:14 user nova-compute[73497]:   <name>instance-00000031</name>
Aug 26 23:53:14 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:53:14 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:53:14 user nova-compute[73497]:   <metadata>
Aug 26 23:53:14 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:53:14 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:53:14 user nova-compute[73497]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-121325070</nova:name>
Aug 26 23:53:14 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:53:13</nova:creationTime>
Aug 26 23:53:14 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:53:14 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:53:14 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:53:14 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:53:14 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:53:14 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:53:14 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:53:14 user nova-compute[73497]:       <nova:owner>
Aug 26 23:53:14 user nova-compute[73497]:         <nova:user uuid="dbd048b30716490880ff4b28758536a5">tempest-TestVolumeBootPattern-377601332-project-member</nova:user>
Aug 26 23:53:14 user nova-compute[73497]:         <nova:project uuid="ba3491abf5cc4e77aed2997a5ac8aeee">tempest-TestVolumeBootPattern-377601332</nova:project>
Aug 26 23:53:14 user nova-compute[73497]:       </nova:owner>
Aug 26 23:53:14 user nova-compute[73497]:       <nova:root type="image" uuid="64f24293-4a5b-423d-8568-e148e7b34929"/>
Aug 26 23:53:14 user nova-compute[73497]:       <nova:ports>
Aug 26 23:53:14 user nova-compute[73497]:         <nova:port uuid="a5113499-36a4-445b-b6c9-0563e08235e2">
Aug 26 23:53:14 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 23:53:14 user nova-compute[73497]:         </nova:port>
Aug 26 23:53:14 user nova-compute[73497]:       </nova:ports>
Aug 26 23:53:14 user nova-compute[73497]:     </nova:instance>
Aug 26 23:53:14 user nova-compute[73497]:   </metadata>
Aug 26 23:53:14 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:53:14 user nova-compute[73497]:     <system>
Aug 26 23:53:14 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:53:14 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:53:14 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:53:14 user nova-compute[73497]:       <entry name="serial">e331c230-4482-4bff-8a19-1509178b8f49</entry>
Aug 26 23:53:14 user nova-compute[73497]:       <entry name="uuid">e331c230-4482-4bff-8a19-1509178b8f49</entry>
Aug 26 23:53:14 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:53:14 user nova-compute[73497]:     </system>
Aug 26 23:53:14 user nova-compute[73497]:   </sysinfo>
Aug 26 23:53:14 user nova-compute[73497]:   <os>
Aug 26 23:53:14 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:53:14 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:53:14 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:53:14 user nova-compute[73497]:   </os>
Aug 26 23:53:14 user nova-compute[73497]:   <features>
Aug 26 23:53:14 user nova-compute[73497]:     <acpi/>
Aug 26 23:53:14 user nova-compute[73497]:     <apic/>
Aug 26 23:53:14 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:53:14 user nova-compute[73497]:   </features>
Aug 26 23:53:14 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:53:14 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:53:14 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:53:14 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:53:14 user nova-compute[73497]:   </clock>
Aug 26 23:53:14 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:53:14 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:53:14 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:53:14 user nova-compute[73497]:   </cpu>
Aug 26 23:53:14 user nova-compute[73497]:   <devices>
Aug 26 23:53:14 user nova-compute[73497]:     <disk type="block" device="disk">
Aug 26 23:53:14 user nova-compute[73497]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:53:14 user nova-compute[73497]:       <source dev="/dev/sdc"/>
Aug 26 23:53:14 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:53:14 user nova-compute[73497]:       <serial>d6578f85-8747-4d8f-90f8-a1e0934db13f</serial>
Aug 26 23:53:14 user nova-compute[73497]:     </disk>
Aug 26 23:53:14 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:53:14 user nova-compute[73497]:       <mac address="fa:16:3e:70:89:8f"/>
Aug 26 23:53:14 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:53:14 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:53:14 user nova-compute[73497]:       <target dev="tapa5113499-36"/>
Aug 26 23:53:14 user nova-compute[73497]:     </interface>
Aug 26 23:53:14 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:53:14 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/e331c230-4482-4bff-8a19-1509178b8f49/console.log" append="off"/>
Aug 26 23:53:14 user nova-compute[73497]:     </serial>
Aug 26 23:53:14 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:53:14 user nova-compute[73497]:     <video>
Aug 26 23:53:14 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:53:14 user nova-compute[73497]:     </video>
Aug 26 23:53:14 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:53:14 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:53:14 user nova-compute[73497]:     </rng>
Aug 26 23:53:14 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:53:14 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:53:14 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:53:14 user nova-compute[73497]:     </memballoon>
Aug 26 23:53:14 user nova-compute[73497]:   </devices>
Aug 26 23:53:14 user nova-compute[73497]: </domain>
Aug 26 23:53:14 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:53:14 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-121325070',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-121325070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-121325070',id=49,image_ref='64f24293-4a5b-423d-8568-e148e7b34929',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPt6513oYHHBetYSEDTDRhX+xYcZzP336edFWGaU6CV+ScSciZX/7YeU3EM5POXYNPjElBZahQnAkYQ5farFXnmQayp+4u65raymwWSifDiZBrRAtML5kSwZZ30BcD9pkQ==',key_name='tempest-keypair-186744434',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba3491abf5cc4e77aed2997a5ac8aeee',ramdisk_id='',reservation_id='r-7daoww6l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-377601332',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-377601332-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-377601332',owner_user_name='tempest-TestVolumeBootPattern-377601332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:52:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbd048b30716490880ff4b28758536a5',uuid=e331c230-4482-4bff-8a19-1509178b8f49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5113499-36a4-445b-b6c9-0563e08235e2", "address": "fa:16:3e:70:89:8f", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5113499-36", "ovs_interfaceid": "a5113499-36a4-445b-b6c9-0563e08235e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:53:14 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Converting VIF {"id": "a5113499-36a4-445b-b6c9-0563e08235e2", "address": "fa:16:3e:70:89:8f", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5113499-36", "ovs_interfaceid": "a5113499-36a4-445b-b6c9-0563e08235e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:53:14 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:89:8f,bridge_name='br-int',has_traffic_filtering=True,id=a5113499-36a4-445b-b6c9-0563e08235e2,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5113499-36') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:53:14 user nova-compute[73497]: DEBUG os_vif [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:89:8f,bridge_name='br-int',has_traffic_filtering=True,id=a5113499-36a4-445b-b6c9-0563e08235e2,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5113499-36') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:53:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:53:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:53:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:53:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:53:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5113499-36, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:53:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa5113499-36, col_values=(('external_ids', {'iface-id': 'a5113499-36a4-445b-b6c9-0563e08235e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:89:8f', 'vm-uuid': 'e331c230-4482-4bff-8a19-1509178b8f49'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:53:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:53:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:53:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:53:14 user nova-compute[73497]: INFO os_vif [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:89:8f,bridge_name='br-int',has_traffic_filtering=True,id=a5113499-36a4-445b-b6c9-0563e08235e2,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5113499-36')
Aug 26 23:53:14 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:53:14 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] No VIF found with MAC fa:16:3e:70:89:8f, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:53:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:53:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:53:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:53:15 user nova-compute[73497]: DEBUG nova.compute.manager [req-1a5ef227-4185-4cf0-9906-b4c0f917ad64 req-5596a9eb-c264-4966-bf3b-ec9ca746765e service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Received event network-vif-plugged-a5113499-36a4-445b-b6c9-0563e08235e2 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:53:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1a5ef227-4185-4cf0-9906-b4c0f917ad64 req-5596a9eb-c264-4966-bf3b-ec9ca746765e service nova] Acquiring lock "e331c230-4482-4bff-8a19-1509178b8f49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:53:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1a5ef227-4185-4cf0-9906-b4c0f917ad64 req-5596a9eb-c264-4966-bf3b-ec9ca746765e service nova] Lock "e331c230-4482-4bff-8a19-1509178b8f49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:53:15 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1a5ef227-4185-4cf0-9906-b4c0f917ad64 req-5596a9eb-c264-4966-bf3b-ec9ca746765e service nova] Lock "e331c230-4482-4bff-8a19-1509178b8f49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:53:15 user nova-compute[73497]: DEBUG nova.compute.manager [req-1a5ef227-4185-4cf0-9906-b4c0f917ad64 req-5596a9eb-c264-4966-bf3b-ec9ca746765e service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] No waiting events found dispatching network-vif-plugged-a5113499-36a4-445b-b6c9-0563e08235e2 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:53:15 user nova-compute[73497]: WARNING nova.compute.manager [req-1a5ef227-4185-4cf0-9906-b4c0f917ad64 req-5596a9eb-c264-4966-bf3b-ec9ca746765e service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Received unexpected event network-vif-plugged-a5113499-36a4-445b-b6c9-0563e08235e2 for instance with vm_state building and task_state spawning.
Aug 26 23:53:15 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:53:16 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:53:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:53:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:53:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:53:16 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:53:16 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:53:16 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:53:16 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:53:17 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693093997.783394, e331c230-4482-4bff-8a19-1509178b8f49 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:53:17 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e331c230-4482-4bff-8a19-1509178b8f49] VM Resumed (Lifecycle Event)
Aug 26 23:53:17 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:53:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:53:17 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:53:17 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:53:17 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8736MB free_disk=25.06148910522461GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:53:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:53:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:53:17 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Instance spawned successfully.
Aug 26 23:53:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:53:17 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:53:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:53:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:53:17 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:53:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:53:17 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e331c230-4482-4bff-8a19-1509178b8f49] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:53:17 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693093997.7836025, e331c230-4482-4bff-8a19-1509178b8f49 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:53:17 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e331c230-4482-4bff-8a19-1509178b8f49] VM Started (Lifecycle Event)
Aug 26 23:53:17 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 2d7e3edd-c03b-43ec-85d4-ada44181f10d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:53:17 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance e331c230-4482-4bff-8a19-1509178b8f49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:53:17 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:53:17 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:53:18 user nova-compute[73497]: INFO nova.compute.manager [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Took 4.98 seconds to spawn the instance on the hypervisor.
Aug 26 23:53:18 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:53:18 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:53:18 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:53:18 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: e331c230-4482-4bff-8a19-1509178b8f49] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:53:18 user nova-compute[73497]: DEBUG nova.compute.manager [req-052b75dc-fc02-4e1f-a6a6-1b295c6a9436 req-cb073f55-ce32-4d79-bd15-dc6ecada5cc9 service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Received event network-vif-plugged-a5113499-36a4-445b-b6c9-0563e08235e2 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:53:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-052b75dc-fc02-4e1f-a6a6-1b295c6a9436 req-cb073f55-ce32-4d79-bd15-dc6ecada5cc9 service nova] Acquiring lock "e331c230-4482-4bff-8a19-1509178b8f49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:53:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-052b75dc-fc02-4e1f-a6a6-1b295c6a9436 req-cb073f55-ce32-4d79-bd15-dc6ecada5cc9 service nova] Lock "e331c230-4482-4bff-8a19-1509178b8f49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:53:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-052b75dc-fc02-4e1f-a6a6-1b295c6a9436 req-cb073f55-ce32-4d79-bd15-dc6ecada5cc9 service nova] Lock "e331c230-4482-4bff-8a19-1509178b8f49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:53:18 user nova-compute[73497]: DEBUG nova.compute.manager [req-052b75dc-fc02-4e1f-a6a6-1b295c6a9436 req-cb073f55-ce32-4d79-bd15-dc6ecada5cc9 service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] No waiting events found dispatching network-vif-plugged-a5113499-36a4-445b-b6c9-0563e08235e2 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:53:18 user nova-compute[73497]: WARNING nova.compute.manager [req-052b75dc-fc02-4e1f-a6a6-1b295c6a9436 req-cb073f55-ce32-4d79-bd15-dc6ecada5cc9 service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Received unexpected event network-vif-plugged-a5113499-36a4-445b-b6c9-0563e08235e2 for instance with vm_state building and task_state spawning.
Aug 26 23:53:18 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:53:18 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:53:18 user nova-compute[73497]: INFO nova.compute.manager [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Took 22.32 seconds to build instance.
Aug 26 23:53:18 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:53:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:53:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9255e69c-11b9-431b-85da-8b6fd8ca423c tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "e331c230-4482-4bff-8a19-1509178b8f49" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.420s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:53:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:53:23 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:53:23 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:53:23 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:53:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:53:25 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:53:26 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:53:29 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:53:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:53:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:53:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:53:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:53:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:53:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:53:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:53:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:53:35 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:53:36 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:53:37 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:53:37 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:53:37 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Rebuilding the list of instances to heal {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 23:53:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-2d7e3edd-c03b-43ec-85d4-ada44181f10d" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:53:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-2d7e3edd-c03b-43ec-85d4-ada44181f10d" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:53:37 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:53:37 user nova-compute[73497]: DEBUG nova.objects.instance [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lazy-loading 'info_cache' on Instance uuid 2d7e3edd-c03b-43ec-85d4-ada44181f10d {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:53:37 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Updating instance_info_cache with network_info: [{"id": "6df10372-5b2e-4b60-bd27-2c23866e83d0", "address": "fa:16:3e:cf:5c:0d", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df10372-5b", "ovs_interfaceid": "6df10372-5b2e-4b60-bd27-2c23866e83d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:53:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-2d7e3edd-c03b-43ec-85d4-ada44181f10d" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:53:37 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:53:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:53:38 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:53:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:53:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:53:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:53:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:53:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:53:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:53:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:54:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:54:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:54:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:54:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:54:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:54:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:54:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:54:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:54:17 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:54:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:54:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:54:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:54:17 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:54:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:54:17 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:54:17 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:54:17 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:54:17 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8689MB free_disk=25.06039047241211GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:54:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:54:17 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:54:17 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 2d7e3edd-c03b-43ec-85d4-ada44181f10d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:54:17 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance e331c230-4482-4bff-8a19-1509178b8f49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:54:17 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:54:17 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:54:17 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:54:17 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:54:18 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:54:18 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.331s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:54:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:54:23 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:54:23 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:54:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:54:25 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:54:26 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:54:28 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:54:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:54:30 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:54:30 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:54:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:54:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:54:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:54:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:54:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:54:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:54:36 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:54:36 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:54:37 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:54:37 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Cleaning up deleted instances with incomplete migration  {{(pid=73497) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 23:54:38 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:54:38 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:54:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-e331c230-4482-4bff-8a19-1509178b8f49" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:54:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-e331c230-4482-4bff-8a19-1509178b8f49" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:54:38 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:54:38 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Updating instance_info_cache with network_info: [{"id": "a5113499-36a4-445b-b6c9-0563e08235e2", "address": "fa:16:3e:70:89:8f", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5113499-36", "ovs_interfaceid": "a5113499-36a4-445b-b6c9-0563e08235e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:54:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-e331c230-4482-4bff-8a19-1509178b8f49" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:54:38 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:54:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:54:44 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:54:44 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Cleaning up deleted instances {{(pid=73497) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 23:54:44 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] There are 0 instances to clean {{(pid=73497) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 23:54:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:54:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:54:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:54:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:54:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:54:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:54:46 user nova-compute[73497]: DEBUG nova.compute.manager [req-2e2805fa-bab8-4bf5-ad0a-a73af7c27ae8 req-45cf7e49-9c75-4fbe-851a-19d85a13bb1d service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Received event network-changed-a5113499-36a4-445b-b6c9-0563e08235e2 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:54:46 user nova-compute[73497]: DEBUG nova.compute.manager [req-2e2805fa-bab8-4bf5-ad0a-a73af7c27ae8 req-45cf7e49-9c75-4fbe-851a-19d85a13bb1d service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Refreshing instance network info cache due to event network-changed-a5113499-36a4-445b-b6c9-0563e08235e2. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:54:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2e2805fa-bab8-4bf5-ad0a-a73af7c27ae8 req-45cf7e49-9c75-4fbe-851a-19d85a13bb1d service nova] Acquiring lock "refresh_cache-e331c230-4482-4bff-8a19-1509178b8f49" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:54:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2e2805fa-bab8-4bf5-ad0a-a73af7c27ae8 req-45cf7e49-9c75-4fbe-851a-19d85a13bb1d service nova] Acquired lock "refresh_cache-e331c230-4482-4bff-8a19-1509178b8f49" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:54:46 user nova-compute[73497]: DEBUG nova.network.neutron [req-2e2805fa-bab8-4bf5-ad0a-a73af7c27ae8 req-45cf7e49-9c75-4fbe-851a-19d85a13bb1d service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Refreshing network info cache for port a5113499-36a4-445b-b6c9-0563e08235e2 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:54:47 user nova-compute[73497]: DEBUG nova.network.neutron [req-2e2805fa-bab8-4bf5-ad0a-a73af7c27ae8 req-45cf7e49-9c75-4fbe-851a-19d85a13bb1d service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Updated VIF entry in instance network info cache for port a5113499-36a4-445b-b6c9-0563e08235e2. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:54:47 user nova-compute[73497]: DEBUG nova.network.neutron [req-2e2805fa-bab8-4bf5-ad0a-a73af7c27ae8 req-45cf7e49-9c75-4fbe-851a-19d85a13bb1d service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Updating instance_info_cache with network_info: [{"id": "a5113499-36a4-445b-b6c9-0563e08235e2", "address": "fa:16:3e:70:89:8f", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5113499-36", "ovs_interfaceid": "a5113499-36a4-445b-b6c9-0563e08235e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:54:47 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-2e2805fa-bab8-4bf5-ad0a-a73af7c27ae8 req-45cf7e49-9c75-4fbe-851a-19d85a13bb1d service nova] Releasing lock "refresh_cache-e331c230-4482-4bff-8a19-1509178b8f49" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:54:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:54:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "e331c230-4482-4bff-8a19-1509178b8f49" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:54:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "e331c230-4482-4bff-8a19-1509178b8f49" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:54:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "e331c230-4482-4bff-8a19-1509178b8f49-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:54:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "e331c230-4482-4bff-8a19-1509178b8f49-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:54:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "e331c230-4482-4bff-8a19-1509178b8f49-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:54:48 user nova-compute[73497]: INFO nova.compute.manager [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Terminating instance
Aug 26 23:54:48 user nova-compute[73497]: DEBUG nova.compute.manager [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:54:48 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:54:48 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:54:48 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:54:48 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:54:48 user nova-compute[73497]: DEBUG nova.compute.manager [req-37b2bd4c-4d4c-4180-95c9-c2922445923a req-7db4be92-baff-4af9-bb2c-d9d0e4c30276 service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Received event network-vif-unplugged-a5113499-36a4-445b-b6c9-0563e08235e2 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:54:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-37b2bd4c-4d4c-4180-95c9-c2922445923a req-7db4be92-baff-4af9-bb2c-d9d0e4c30276 service nova] Acquiring lock "e331c230-4482-4bff-8a19-1509178b8f49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:54:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-37b2bd4c-4d4c-4180-95c9-c2922445923a req-7db4be92-baff-4af9-bb2c-d9d0e4c30276 service nova] Lock "e331c230-4482-4bff-8a19-1509178b8f49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:54:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-37b2bd4c-4d4c-4180-95c9-c2922445923a req-7db4be92-baff-4af9-bb2c-d9d0e4c30276 service nova] Lock "e331c230-4482-4bff-8a19-1509178b8f49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:54:48 user nova-compute[73497]: DEBUG nova.compute.manager [req-37b2bd4c-4d4c-4180-95c9-c2922445923a req-7db4be92-baff-4af9-bb2c-d9d0e4c30276 service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] No waiting events found dispatching network-vif-unplugged-a5113499-36a4-445b-b6c9-0563e08235e2 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:54:48 user nova-compute[73497]: DEBUG nova.compute.manager [req-37b2bd4c-4d4c-4180-95c9-c2922445923a req-7db4be92-baff-4af9-bb2c-d9d0e4c30276 service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Received event network-vif-unplugged-a5113499-36a4-445b-b6c9-0563e08235e2 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:54:49 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Instance destroyed successfully.
Aug 26 23:54:49 user nova-compute[73497]: DEBUG nova.objects.instance [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lazy-loading 'resources' on Instance uuid e331c230-4482-4bff-8a19-1509178b8f49 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-121325070',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-121325070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-121325070',id=49,image_ref='64f24293-4a5b-423d-8568-e148e7b34929',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPt6513oYHHBetYSEDTDRhX+xYcZzP336edFWGaU6CV+ScSciZX/7YeU3EM5POXYNPjElBZahQnAkYQ5farFXnmQayp+4u65raymwWSifDiZBrRAtML5kSwZZ30BcD9pkQ==',key_name='tempest-keypair-186744434',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:53:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba3491abf5cc4e77aed2997a5ac8aeee',ramdisk_id='',reservation_id='r-7daoww6l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-377601332',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-377601332-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-377601332',owner_user_name='tempest-TestVolumeBootPattern-377601332-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:53:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbd048b30716490880ff4b28758536a5',uuid=e331c230-4482-4bff-8a19-1509178b8f49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5113499-36a4-445b-b6c9-0563e08235e2", "address": "fa:16:3e:70:89:8f", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5113499-36", "ovs_interfaceid": "a5113499-36a4-445b-b6c9-0563e08235e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Converting VIF {"id": "a5113499-36a4-445b-b6c9-0563e08235e2", "address": "fa:16:3e:70:89:8f", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5113499-36", "ovs_interfaceid": "a5113499-36a4-445b-b6c9-0563e08235e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:89:8f,bridge_name='br-int',has_traffic_filtering=True,id=a5113499-36a4-445b-b6c9-0563e08235e2,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5113499-36') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG os_vif [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:89:8f,bridge_name='br-int',has_traffic_filtering=True,id=a5113499-36a4-445b-b6c9-0563e08235e2,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5113499-36') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5113499-36, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:54:49 user nova-compute[73497]: INFO os_vif [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:89:8f,bridge_name='br-int',has_traffic_filtering=True,id=a5113499-36a4-445b-b6c9-0563e08235e2,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5113499-36')
Aug 26 23:54:49 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KuiaDvtI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:54:49 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:54:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6898fdd8-7e26-45e4-a4b6-41bbf235f667]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8781279-b541-4b39-b4ae-6777b744475e]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02 (non-flash)
Aug 26 23:54:49 user nova-compute[73497]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f (non-flash)
Aug 26 23:54:49 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02 (non-flash)
Aug 26 23:54:49 user nova-compute[73497]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f (non-flash)
Aug 26 23:54:49 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281c3d6170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f'): ({'sdc'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Removing single pathed devices sdc {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce37514-2885-4bd6-a343-2f85b64ac403]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b4c767-1258-4fb0-b912-96e8c168ed30]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Flushing IO for device /dev/sdc {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee06a3f2-11e1-4095-826d-74b26f0f1016]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e472e124-c651-4277-91da-f3795ff6fdef]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] SCSI volumes sdc have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba4d523-72bb-4e1a-a6a8-11a9be96ab60]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[506df5fa-e4cf-413b-ac65-a1948eafbfe3]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f, portal: 172.16.0.220,3260]
Aug 26 23:54:49 user nova-compute[73497]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f, portal: 172.16.0.220,3260] successful.
Aug 26 23:54:49 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6578f85-8747-4d8f-90f8-a1e0934db13f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b0d087-1be8-4e82-a8bf-d715ed708314]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] <== disconnect_volume: return (286ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:54:49 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Deleting instance files /opt/stack/data/nova/instances/e331c230-4482-4bff-8a19-1509178b8f49_del
Aug 26 23:54:49 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Deletion of /opt/stack/data/nova/instances/e331c230-4482-4bff-8a19-1509178b8f49_del complete
Aug 26 23:54:49 user nova-compute[73497]: INFO nova.compute.manager [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 26 23:54:49 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: e331c230-4482-4bff-8a19-1509178b8f49] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:54:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:54:50 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:54:50 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Took 0.91 seconds to deallocate network for instance.
Aug 26 23:54:50 user nova-compute[73497]: DEBUG nova.compute.manager [req-8038bf66-6d5c-4dcf-9639-45c4a7a148ae req-9d9a5baa-37c6-45f8-b8f1-1ca6334bc95a service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Received event network-vif-deleted-a5113499-36a4-445b-b6c9-0563e08235e2 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:54:50 user nova-compute[73497]: INFO nova.compute.manager [req-8038bf66-6d5c-4dcf-9639-45c4a7a148ae req-9d9a5baa-37c6-45f8-b8f1-1ca6334bc95a service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Neutron deleted interface a5113499-36a4-445b-b6c9-0563e08235e2; detaching it from the instance and deleting it from the info cache
Aug 26 23:54:50 user nova-compute[73497]: DEBUG nova.network.neutron [req-8038bf66-6d5c-4dcf-9639-45c4a7a148ae req-9d9a5baa-37c6-45f8-b8f1-1ca6334bc95a service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:54:50 user nova-compute[73497]: DEBUG nova.compute.manager [req-8038bf66-6d5c-4dcf-9639-45c4a7a148ae req-9d9a5baa-37c6-45f8-b8f1-1ca6334bc95a service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Detach interface failed, port_id=a5113499-36a4-445b-b6c9-0563e08235e2, reason: Instance e331c230-4482-4bff-8a19-1509178b8f49 could not be found. {{(pid=73497) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 23:54:50 user nova-compute[73497]: DEBUG nova.compute.manager [req-31057ee8-35a2-4de4-ac16-1ad6aece28cb req-d978effc-a46f-47f2-9c28-ea7db7735f67 service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Received event network-vif-plugged-a5113499-36a4-445b-b6c9-0563e08235e2 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:54:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-31057ee8-35a2-4de4-ac16-1ad6aece28cb req-d978effc-a46f-47f2-9c28-ea7db7735f67 service nova] Acquiring lock "e331c230-4482-4bff-8a19-1509178b8f49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:54:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-31057ee8-35a2-4de4-ac16-1ad6aece28cb req-d978effc-a46f-47f2-9c28-ea7db7735f67 service nova] Lock "e331c230-4482-4bff-8a19-1509178b8f49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:54:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-31057ee8-35a2-4de4-ac16-1ad6aece28cb req-d978effc-a46f-47f2-9c28-ea7db7735f67 service nova] Lock "e331c230-4482-4bff-8a19-1509178b8f49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:54:50 user nova-compute[73497]: DEBUG nova.compute.manager [req-31057ee8-35a2-4de4-ac16-1ad6aece28cb req-d978effc-a46f-47f2-9c28-ea7db7735f67 service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] No waiting events found dispatching network-vif-plugged-a5113499-36a4-445b-b6c9-0563e08235e2 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:54:50 user nova-compute[73497]: WARNING nova.compute.manager [req-31057ee8-35a2-4de4-ac16-1ad6aece28cb req-d978effc-a46f-47f2-9c28-ea7db7735f67 service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Received unexpected event network-vif-plugged-a5113499-36a4-445b-b6c9-0563e08235e2 for instance with vm_state active and task_state deleting.
Aug 26 23:54:50 user nova-compute[73497]: DEBUG nova.compute.manager [req-31057ee8-35a2-4de4-ac16-1ad6aece28cb req-d978effc-a46f-47f2-9c28-ea7db7735f67 service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Received event network-vif-plugged-a5113499-36a4-445b-b6c9-0563e08235e2 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:54:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-31057ee8-35a2-4de4-ac16-1ad6aece28cb req-d978effc-a46f-47f2-9c28-ea7db7735f67 service nova] Acquiring lock "e331c230-4482-4bff-8a19-1509178b8f49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:54:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-31057ee8-35a2-4de4-ac16-1ad6aece28cb req-d978effc-a46f-47f2-9c28-ea7db7735f67 service nova] Lock "e331c230-4482-4bff-8a19-1509178b8f49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:54:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-31057ee8-35a2-4de4-ac16-1ad6aece28cb req-d978effc-a46f-47f2-9c28-ea7db7735f67 service nova] Lock "e331c230-4482-4bff-8a19-1509178b8f49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:54:50 user nova-compute[73497]: DEBUG nova.compute.manager [req-31057ee8-35a2-4de4-ac16-1ad6aece28cb req-d978effc-a46f-47f2-9c28-ea7db7735f67 service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] No waiting events found dispatching network-vif-plugged-a5113499-36a4-445b-b6c9-0563e08235e2 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:54:50 user nova-compute[73497]: WARNING nova.compute.manager [req-31057ee8-35a2-4de4-ac16-1ad6aece28cb req-d978effc-a46f-47f2-9c28-ea7db7735f67 service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Received unexpected event network-vif-plugged-a5113499-36a4-445b-b6c9-0563e08235e2 for instance with vm_state active and task_state deleting.
Aug 26 23:54:50 user nova-compute[73497]: DEBUG nova.compute.manager [req-31057ee8-35a2-4de4-ac16-1ad6aece28cb req-d978effc-a46f-47f2-9c28-ea7db7735f67 service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Received event network-vif-plugged-a5113499-36a4-445b-b6c9-0563e08235e2 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:54:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-31057ee8-35a2-4de4-ac16-1ad6aece28cb req-d978effc-a46f-47f2-9c28-ea7db7735f67 service nova] Acquiring lock "e331c230-4482-4bff-8a19-1509178b8f49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:54:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-31057ee8-35a2-4de4-ac16-1ad6aece28cb req-d978effc-a46f-47f2-9c28-ea7db7735f67 service nova] Lock "e331c230-4482-4bff-8a19-1509178b8f49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:54:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-31057ee8-35a2-4de4-ac16-1ad6aece28cb req-d978effc-a46f-47f2-9c28-ea7db7735f67 service nova] Lock "e331c230-4482-4bff-8a19-1509178b8f49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:54:50 user nova-compute[73497]: DEBUG nova.compute.manager [req-31057ee8-35a2-4de4-ac16-1ad6aece28cb req-d978effc-a46f-47f2-9c28-ea7db7735f67 service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] No waiting events found dispatching network-vif-plugged-a5113499-36a4-445b-b6c9-0563e08235e2 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:54:50 user nova-compute[73497]: WARNING nova.compute.manager [req-31057ee8-35a2-4de4-ac16-1ad6aece28cb req-d978effc-a46f-47f2-9c28-ea7db7735f67 service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Received unexpected event network-vif-plugged-a5113499-36a4-445b-b6c9-0563e08235e2 for instance with vm_state active and task_state deleting.
Aug 26 23:54:50 user nova-compute[73497]: DEBUG nova.compute.manager [req-31057ee8-35a2-4de4-ac16-1ad6aece28cb req-d978effc-a46f-47f2-9c28-ea7db7735f67 service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Received event network-vif-unplugged-a5113499-36a4-445b-b6c9-0563e08235e2 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:54:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-31057ee8-35a2-4de4-ac16-1ad6aece28cb req-d978effc-a46f-47f2-9c28-ea7db7735f67 service nova] Acquiring lock "e331c230-4482-4bff-8a19-1509178b8f49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:54:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-31057ee8-35a2-4de4-ac16-1ad6aece28cb req-d978effc-a46f-47f2-9c28-ea7db7735f67 service nova] Lock "e331c230-4482-4bff-8a19-1509178b8f49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:54:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-31057ee8-35a2-4de4-ac16-1ad6aece28cb req-d978effc-a46f-47f2-9c28-ea7db7735f67 service nova] Lock "e331c230-4482-4bff-8a19-1509178b8f49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:54:50 user nova-compute[73497]: DEBUG nova.compute.manager [req-31057ee8-35a2-4de4-ac16-1ad6aece28cb req-d978effc-a46f-47f2-9c28-ea7db7735f67 service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] No waiting events found dispatching network-vif-unplugged-a5113499-36a4-445b-b6c9-0563e08235e2 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:54:50 user nova-compute[73497]: DEBUG nova.compute.manager [req-31057ee8-35a2-4de4-ac16-1ad6aece28cb req-d978effc-a46f-47f2-9c28-ea7db7735f67 service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Received event network-vif-unplugged-a5113499-36a4-445b-b6c9-0563e08235e2 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:54:50 user nova-compute[73497]: DEBUG nova.compute.manager [req-31057ee8-35a2-4de4-ac16-1ad6aece28cb req-d978effc-a46f-47f2-9c28-ea7db7735f67 service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Received event network-vif-plugged-a5113499-36a4-445b-b6c9-0563e08235e2 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:54:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-31057ee8-35a2-4de4-ac16-1ad6aece28cb req-d978effc-a46f-47f2-9c28-ea7db7735f67 service nova] Acquiring lock "e331c230-4482-4bff-8a19-1509178b8f49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:54:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-31057ee8-35a2-4de4-ac16-1ad6aece28cb req-d978effc-a46f-47f2-9c28-ea7db7735f67 service nova] Lock "e331c230-4482-4bff-8a19-1509178b8f49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:54:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-31057ee8-35a2-4de4-ac16-1ad6aece28cb req-d978effc-a46f-47f2-9c28-ea7db7735f67 service nova] Lock "e331c230-4482-4bff-8a19-1509178b8f49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:54:50 user nova-compute[73497]: DEBUG nova.compute.manager [req-31057ee8-35a2-4de4-ac16-1ad6aece28cb req-d978effc-a46f-47f2-9c28-ea7db7735f67 service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] No waiting events found dispatching network-vif-plugged-a5113499-36a4-445b-b6c9-0563e08235e2 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:54:50 user nova-compute[73497]: WARNING nova.compute.manager [req-31057ee8-35a2-4de4-ac16-1ad6aece28cb req-d978effc-a46f-47f2-9c28-ea7db7735f67 service nova] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Received unexpected event network-vif-plugged-a5113499-36a4-445b-b6c9-0563e08235e2 for instance with vm_state active and task_state deleting.
Aug 26 23:54:51 user nova-compute[73497]: INFO nova.compute.manager [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Took 0.80 seconds to detach 1 volumes for instance.
Aug 26 23:54:51 user nova-compute[73497]: DEBUG nova.compute.manager [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Deleting volume: d6578f85-8747-4d8f-90f8-a1e0934db13f {{(pid=73497) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 23:54:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:54:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:54:51 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:54:51 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:54:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.211s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:54:51 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Deleted allocations for instance e331c230-4482-4bff-8a19-1509178b8f49
Aug 26 23:54:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0f8db6cd-6747-4a0d-aa8e-aafe20540cb0 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "e331c230-4482-4bff-8a19-1509178b8f49" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.338s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:54:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:54:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:54:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:54:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:54:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:54:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:54:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:54:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:55:04 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693094089.2871182, e331c230-4482-4bff-8a19-1509178b8f49 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:55:04 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: e331c230-4482-4bff-8a19-1509178b8f49] VM Stopped (Lifecycle Event)
Aug 26 23:55:04 user nova-compute[73497]: DEBUG nova.compute.manager [None req-98605e02-8ab8-41a3-aa69-927d5e0373cf None None] [instance: e331c230-4482-4bff-8a19-1509178b8f49] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:55:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:55:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:55:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:55:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:55:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:55:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:55:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:55:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:55:19 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:55:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:55:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:55:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:55:19 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:55:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:55:19 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:55:19 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:55:19 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:55:19 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8789MB free_disk=25.059429168701172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:55:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:55:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:55:19 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 2d7e3edd-c03b-43ec-85d4-ada44181f10d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:55:19 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:55:19 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:55:19 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:55:19 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:55:19 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:55:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:55:23 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:55:23 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:55:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:55:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:55:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:55:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:55:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:55:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:55:25 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:55:26 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:55:28 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:55:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:55:31 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:55:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:55:36 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:55:37 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:55:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:55:40 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:55:40 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:55:40 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:55:40 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Rebuilding the list of instances to heal {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 23:55:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-2d7e3edd-c03b-43ec-85d4-ada44181f10d" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:55:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-2d7e3edd-c03b-43ec-85d4-ada44181f10d" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:55:40 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:55:40 user nova-compute[73497]: DEBUG nova.objects.instance [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lazy-loading 'info_cache' on Instance uuid 2d7e3edd-c03b-43ec-85d4-ada44181f10d {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:55:40 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Updating instance_info_cache with network_info: [{"id": "6df10372-5b2e-4b60-bd27-2c23866e83d0", "address": "fa:16:3e:cf:5c:0d", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df10372-5b", "ovs_interfaceid": "6df10372-5b2e-4b60-bd27-2c23866e83d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:55:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-2d7e3edd-c03b-43ec-85d4-ada44181f10d" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:55:40 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:55:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:55:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "2d7e3edd-c03b-43ec-85d4-ada44181f10d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:55:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "2d7e3edd-c03b-43ec-85d4-ada44181f10d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:55:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "2d7e3edd-c03b-43ec-85d4-ada44181f10d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:55:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "2d7e3edd-c03b-43ec-85d4-ada44181f10d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:55:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "2d7e3edd-c03b-43ec-85d4-ada44181f10d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:55:45 user nova-compute[73497]: INFO nova.compute.manager [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Terminating instance
Aug 26 23:55:45 user nova-compute[73497]: DEBUG nova.compute.manager [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:55:45 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:55:45 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:55:45 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:55:45 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:55:45 user nova-compute[73497]: DEBUG nova.compute.manager [req-77f7f6b4-abf8-431e-8b9e-5264c7edf906 req-c0150912-f94b-4da6-b640-6f7f9b0b83ad service nova] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Received event network-vif-unplugged-6df10372-5b2e-4b60-bd27-2c23866e83d0 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:55:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-77f7f6b4-abf8-431e-8b9e-5264c7edf906 req-c0150912-f94b-4da6-b640-6f7f9b0b83ad service nova] Acquiring lock "2d7e3edd-c03b-43ec-85d4-ada44181f10d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:55:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-77f7f6b4-abf8-431e-8b9e-5264c7edf906 req-c0150912-f94b-4da6-b640-6f7f9b0b83ad service nova] Lock "2d7e3edd-c03b-43ec-85d4-ada44181f10d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:55:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-77f7f6b4-abf8-431e-8b9e-5264c7edf906 req-c0150912-f94b-4da6-b640-6f7f9b0b83ad service nova] Lock "2d7e3edd-c03b-43ec-85d4-ada44181f10d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:55:45 user nova-compute[73497]: DEBUG nova.compute.manager [req-77f7f6b4-abf8-431e-8b9e-5264c7edf906 req-c0150912-f94b-4da6-b640-6f7f9b0b83ad service nova] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] No waiting events found dispatching network-vif-unplugged-6df10372-5b2e-4b60-bd27-2c23866e83d0 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:55:45 user nova-compute[73497]: DEBUG nova.compute.manager [req-77f7f6b4-abf8-431e-8b9e-5264c7edf906 req-c0150912-f94b-4da6-b640-6f7f9b0b83ad service nova] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Received event network-vif-unplugged-6df10372-5b2e-4b60-bd27-2c23866e83d0 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:55:45 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:55:46 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Instance destroyed successfully.
Aug 26 23:55:46 user nova-compute[73497]: DEBUG nova.objects.instance [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lazy-loading 'resources' on Instance uuid 2d7e3edd-c03b-43ec-85d4-ada44181f10d {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:50:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-210262312',display_name='tempest-TestVolumeBootPattern-volume-backed-server-210262312',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-210262312',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4MR2FG7BqlrKo75NYMKAFq7lqm7HDvYw55d2SQjEuOE+3uidRIMTHejVRoV3sNAoT9EkMQQH7F+ifmSjH02xgswW0k7okIr91koWaMuawetFmfmiXe5S3wgF/FuCfvQw==',key_name='tempest-keypair-1270060275',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:51:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba3491abf5cc4e77aed2997a5ac8aeee',ramdisk_id='',reservation_id='r-84ki0n32',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-377601332',owner_user_name='tempest-TestVolumeBootPattern-377601332-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:51:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbd048b30716490880ff4b28758536a5',uuid=2d7e3edd-c03b-43ec-85d4-ada44181f10d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6df10372-5b2e-4b60-bd27-2c23866e83d0", "address": "fa:16:3e:cf:5c:0d", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df10372-5b", "ovs_interfaceid": "6df10372-5b2e-4b60-bd27-2c23866e83d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Converting VIF {"id": "6df10372-5b2e-4b60-bd27-2c23866e83d0", "address": "fa:16:3e:cf:5c:0d", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df10372-5b", "ovs_interfaceid": "6df10372-5b2e-4b60-bd27-2c23866e83d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:5c:0d,bridge_name='br-int',has_traffic_filtering=True,id=6df10372-5b2e-4b60-bd27-2c23866e83d0,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df10372-5b') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG os_vif [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:5c:0d,bridge_name='br-int',has_traffic_filtering=True,id=6df10372-5b2e-4b60-bd27-2c23866e83d0,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df10372-5b') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6df10372-5b, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:55:46 user nova-compute[73497]: INFO os_vif [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:5c:0d,bridge_name='br-int',has_traffic_filtering=True,id=6df10372-5b2e-4b60-bd27-2c23866e83d0,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df10372-5b')
Aug 26 23:55:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DzudlWLk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:55:46 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:55:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10b6df5-a5cf-40d6-b709-43f44137aa34]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8793f74f-00a2-4b34-86bb-bea3a645a75d]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02 (non-flash)
Aug 26 23:55:46 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02 (non-flash)
Aug 26 23:55:46 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281c258c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02'): ({'sdb'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Removing single pathed devices sdb {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[546c67f4-4e31-434f-bee6-04d8f7cfecb0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d20324-a15b-4097-ba7a-6b7676460408]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Flushing IO for device /dev/sdb {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ad3dba-c40b-4b3e-a29e-f888b3575b5c]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86542a6-9185-4198-87c9-d0a9dc54f78e]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26339656532336661', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_bf144a00', '/dev/disk/by-id/scsi-1SCST_BIObf144a00-c9ee23fa818ba6e8') {{(pid=84617) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[39883acc-531c-471c-b7d8-6f9b739e8aec]: (4, None) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f745622-7151-49db-9cc6-80538f8a9193]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb4fec0-f92f-4744-ad64-924f7452c054]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02, portal: 172.16.0.220,3260]
Aug 26 23:55:46 user nova-compute[73497]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02, portal: 172.16.0.220,3260] successful.
Aug 26 23:55:46 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:506ff10c-b609-487a-ac7a-6fa06e43bb02 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42bf41d-136a-438f-84aa-e28394faad28]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] <== disconnect_volume: return (280ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:55:46 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Deleting instance files /opt/stack/data/nova/instances/2d7e3edd-c03b-43ec-85d4-ada44181f10d_del
Aug 26 23:55:46 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Deletion of /opt/stack/data/nova/instances/2d7e3edd-c03b-43ec-85d4-ada44181f10d_del complete
Aug 26 23:55:46 user nova-compute[73497]: INFO nova.compute.manager [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Took 1.11 seconds to destroy the instance on the hypervisor.
Aug 26 23:55:46 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:55:46 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:55:47 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:55:47 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Took 0.78 seconds to deallocate network for instance.
Aug 26 23:55:47 user nova-compute[73497]: DEBUG nova.compute.manager [req-f9e37baa-a72d-46cd-86ff-1c4419c79d5e req-514b0517-490a-4866-935f-2eee9794be24 service nova] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Received event network-vif-deleted-6df10372-5b2e-4b60-bd27-2c23866e83d0 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:55:47 user nova-compute[73497]: INFO nova.compute.manager [req-f9e37baa-a72d-46cd-86ff-1c4419c79d5e req-514b0517-490a-4866-935f-2eee9794be24 service nova] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Neutron deleted interface 6df10372-5b2e-4b60-bd27-2c23866e83d0; detaching it from the instance and deleting it from the info cache
Aug 26 23:55:47 user nova-compute[73497]: DEBUG nova.network.neutron [req-f9e37baa-a72d-46cd-86ff-1c4419c79d5e req-514b0517-490a-4866-935f-2eee9794be24 service nova] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:55:47 user nova-compute[73497]: DEBUG nova.compute.manager [req-f9e37baa-a72d-46cd-86ff-1c4419c79d5e req-514b0517-490a-4866-935f-2eee9794be24 service nova] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Detach interface failed, port_id=6df10372-5b2e-4b60-bd27-2c23866e83d0, reason: Instance 2d7e3edd-c03b-43ec-85d4-ada44181f10d could not be found. {{(pid=73497) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 23:55:47 user nova-compute[73497]: DEBUG nova.compute.manager [req-ae2edb0e-1b8d-431a-b4d1-3f564c0159bd req-84241928-4f47-44c0-a838-5c9069dad990 service nova] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Received event network-vif-plugged-6df10372-5b2e-4b60-bd27-2c23866e83d0 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:55:47 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ae2edb0e-1b8d-431a-b4d1-3f564c0159bd req-84241928-4f47-44c0-a838-5c9069dad990 service nova] Acquiring lock "2d7e3edd-c03b-43ec-85d4-ada44181f10d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:55:47 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ae2edb0e-1b8d-431a-b4d1-3f564c0159bd req-84241928-4f47-44c0-a838-5c9069dad990 service nova] Lock "2d7e3edd-c03b-43ec-85d4-ada44181f10d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:55:47 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ae2edb0e-1b8d-431a-b4d1-3f564c0159bd req-84241928-4f47-44c0-a838-5c9069dad990 service nova] Lock "2d7e3edd-c03b-43ec-85d4-ada44181f10d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:55:47 user nova-compute[73497]: DEBUG nova.compute.manager [req-ae2edb0e-1b8d-431a-b4d1-3f564c0159bd req-84241928-4f47-44c0-a838-5c9069dad990 service nova] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] No waiting events found dispatching network-vif-plugged-6df10372-5b2e-4b60-bd27-2c23866e83d0 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:55:47 user nova-compute[73497]: WARNING nova.compute.manager [req-ae2edb0e-1b8d-431a-b4d1-3f564c0159bd req-84241928-4f47-44c0-a838-5c9069dad990 service nova] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Received unexpected event network-vif-plugged-6df10372-5b2e-4b60-bd27-2c23866e83d0 for instance with vm_state active and task_state deleting.
Aug 26 23:55:47 user nova-compute[73497]: INFO nova.compute.manager [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Took 0.77 seconds to detach 1 volumes for instance.
Aug 26 23:55:47 user nova-compute[73497]: DEBUG nova.compute.manager [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Deleting volume: 506ff10c-b609-487a-ac7a-6fa06e43bb02 {{(pid=73497) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 23:55:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:55:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:55:48 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:55:48 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:55:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.113s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:55:48 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Deleted allocations for instance 2d7e3edd-c03b-43ec-85d4-ada44181f10d
Aug 26 23:55:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-0e630d3c-e7cd-44af-9b78-e05a9da14d7f tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "2d7e3edd-c03b-43ec-85d4-ada44181f10d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.008s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:55:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:55:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:56:01 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693094146.039327, 2d7e3edd-c03b-43ec-85d4-ada44181f10d => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:56:01 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] VM Stopped (Lifecycle Event)
Aug 26 23:56:01 user nova-compute[73497]: DEBUG nova.compute.manager [None req-91c950b7-d4b4-4d8c-83a0-82507295e55f None None] [instance: 2d7e3edd-c03b-43ec-85d4-ada44181f10d] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:56:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:56:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:56:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:56:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:56:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:56:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:56:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:56:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:56:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:56:20 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:56:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:56:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:56:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:56:20 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:56:20 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:56:20 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:56:20 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8925MB free_disk=25.058609008789062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:56:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:56:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:56:20 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:56:20 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:56:20 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Refreshing inventories for resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 23:56:20 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Updating ProviderTree inventory for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 23:56:20 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Updating inventory in ProviderTree for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 23:56:20 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Refreshing aggregate associations for resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1, aggregates: None {{(pid=73497) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 23:56:20 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Refreshing trait associations for resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING {{(pid=73497) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 23:56:20 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:56:20 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:56:20 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:56:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.263s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:56:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:56:25 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:56:25 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:56:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:56:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:56:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:56:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:56:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:56:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:56:26 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:56:26 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:56:28 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:56:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:56:33 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:56:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:56:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:56:36 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:56:39 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:56:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:56:41 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:56:41 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:56:41 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Rebuilding the list of instances to heal {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 23:56:41 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Didn't find any instances for network info cache update. {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 23:56:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:56:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:56:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:56:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:56:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:56:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:56:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "a2dc5340-84cd-44de-8f31-88b60a1eca81" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:56:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "a2dc5340-84cd-44de-8f31-88b60a1eca81" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:56:50 user nova-compute[73497]: DEBUG nova.compute.manager [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:56:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:56:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:56:50 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:56:50 user nova-compute[73497]: INFO nova.compute.claims [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Claim successful on node user
Aug 26 23:56:50 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:56:50 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:56:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.179s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:56:50 user nova-compute[73497]: DEBUG nova.compute.manager [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:56:50 user nova-compute[73497]: DEBUG nova.compute.manager [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:56:50 user nova-compute[73497]: DEBUG nova.network.neutron [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:56:50 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:56:50 user nova-compute[73497]: DEBUG nova.compute.manager [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:56:50 user nova-compute[73497]: INFO nova.virt.block_device [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Booting with volume 50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 at /dev/vda
Aug 26 23:56:50 user nova-compute[73497]: DEBUG nova.policy [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dbd048b30716490880ff4b28758536a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3491abf5cc4e77aed2997a5ac8aeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:56:50 user nova-compute[73497]: DEBUG os_brick.utils [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:56:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:56:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:56:50 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6331b790-b7dc-4506-8fde-6e1961d00f76]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:56:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:56:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:56:50 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9646e60a-5cff-41d0-ba1e-080404dac340]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:56:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:56:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:56:50 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[083ca489-e47c-4763-9800-c4efaf8677a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:56:50 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4498657-473d-4059-b315-b9941a6e8cf2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:56:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:56:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:56:50 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:56:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:56:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:56:50 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:56:50 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47ed4e4-cb4c-4b4e-a38c-71f6714ad364]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:56:50 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:56:50 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:56:50 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:56:50 user nova-compute[73497]: DEBUG os_brick.utils [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:56:50 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Updating existing volume attachment record: 10dd57ea-c925-4c16-928a-3372dbeb9aa3 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:56:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:56:51 user nova-compute[73497]: DEBUG nova.network.neutron [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Successfully created port: e6cd8015-e039-417d-af6f-957163cdae0d {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:56:52 user nova-compute[73497]: DEBUG nova.network.neutron [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Successfully updated port: e6cd8015-e039-417d-af6f-957163cdae0d {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:56:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "refresh_cache-a2dc5340-84cd-44de-8f31-88b60a1eca81" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:56:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquired lock "refresh_cache-a2dc5340-84cd-44de-8f31-88b60a1eca81" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:56:52 user nova-compute[73497]: DEBUG nova.network.neutron [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:56:52 user nova-compute[73497]: DEBUG nova.network.neutron [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:56:52 user nova-compute[73497]: DEBUG nova.compute.manager [req-36566401-b6d0-492c-871f-0cd952318f4f req-64acbd10-2af9-46a1-9fe4-2775316d5e2e service nova] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Received event network-changed-e6cd8015-e039-417d-af6f-957163cdae0d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:56:52 user nova-compute[73497]: DEBUG nova.compute.manager [req-36566401-b6d0-492c-871f-0cd952318f4f req-64acbd10-2af9-46a1-9fe4-2775316d5e2e service nova] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Refreshing instance network info cache due to event network-changed-e6cd8015-e039-417d-af6f-957163cdae0d. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:56:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-36566401-b6d0-492c-871f-0cd952318f4f req-64acbd10-2af9-46a1-9fe4-2775316d5e2e service nova] Acquiring lock "refresh_cache-a2dc5340-84cd-44de-8f31-88b60a1eca81" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:56:52 user nova-compute[73497]: DEBUG nova.network.neutron [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Updating instance_info_cache with network_info: [{"id": "e6cd8015-e039-417d-af6f-957163cdae0d", "address": "fa:16:3e:2e:e3:45", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6cd8015-e0", "ovs_interfaceid": "e6cd8015-e039-417d-af6f-957163cdae0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:56:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Releasing lock "refresh_cache-a2dc5340-84cd-44de-8f31-88b60a1eca81" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:56:52 user nova-compute[73497]: DEBUG nova.compute.manager [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Instance network_info: |[{"id": "e6cd8015-e039-417d-af6f-957163cdae0d", "address": "fa:16:3e:2e:e3:45", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6cd8015-e0", "ovs_interfaceid": "e6cd8015-e039-417d-af6f-957163cdae0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:56:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-36566401-b6d0-492c-871f-0cd952318f4f req-64acbd10-2af9-46a1-9fe4-2775316d5e2e service nova] Acquired lock "refresh_cache-a2dc5340-84cd-44de-8f31-88b60a1eca81" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:56:52 user nova-compute[73497]: DEBUG nova.network.neutron [req-36566401-b6d0-492c-871f-0cd952318f4f req-64acbd10-2af9-46a1-9fe4-2775316d5e2e service nova] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Refreshing network info cache for port e6cd8015-e039-417d-af6f-957163cdae0d {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:56:53 user nova-compute[73497]: DEBUG nova.network.neutron [req-36566401-b6d0-492c-871f-0cd952318f4f req-64acbd10-2af9-46a1-9fe4-2775316d5e2e service nova] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Updated VIF entry in instance network info cache for port e6cd8015-e039-417d-af6f-957163cdae0d. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:56:53 user nova-compute[73497]: DEBUG nova.network.neutron [req-36566401-b6d0-492c-871f-0cd952318f4f req-64acbd10-2af9-46a1-9fe4-2775316d5e2e service nova] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Updating instance_info_cache with network_info: [{"id": "e6cd8015-e039-417d-af6f-957163cdae0d", "address": "fa:16:3e:2e:e3:45", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6cd8015-e0", "ovs_interfaceid": "e6cd8015-e039-417d-af6f-957163cdae0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:56:53 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-36566401-b6d0-492c-871f-0cd952318f4f req-64acbd10-2af9-46a1-9fe4-2775316d5e2e service nova] Releasing lock "refresh_cache-a2dc5340-84cd-44de-8f31-88b60a1eca81" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:56:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG nova.compute.manager [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:57:01 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Creating image(s)
Aug 26 23:57:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Did not create local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Ensure instance console log exists: /opt/stack/data/nova/instances/a2dc5340-84cd-44de-8f31-88b60a1eca81/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Start _get_guest_xml network_info=[{"id": "e6cd8015-e039-417d-af6f-957163cdae0d", "address": "fa:16:3e:2e:e3:45", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6cd8015-e0", "ovs_interfaceid": "e6cd8015-e039-417d-af6f-957163cdae0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '10dd57ea-c925-4c16-928a-3372dbeb9aa3', 'guest_format': None, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMblgFXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a2dc5340-84cd-44de-8f31-88b60a1eca81', 'attached_at': '', 'detached_at': '', 'volume_id': '50abfef1-01fb-4df8-bb4a-e9f7832b3ef6', 'serial': '50abfef1-01fb-4df8-bb4a-e9f7832b3ef6'}, 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:57:01 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:57:01 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:57:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMblgFXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:57:01 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:57:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:57:01 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:57:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:57:01 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:57:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43d620f-542b-4f17-85f4-07e927b015b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:57:01 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0540adc-7db0-4ff0-83ed-59630ddb1e7d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6] added
Aug 26 23:57:01 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e389822-c673-4477-bc75-75827729176e]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4022518-2082-42e7-bf9d-5f868b11b004]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wMblgFXU {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wMblgFXU" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ea8cf9-698c-4927-a908-945e33100ea1]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wMblgFXU'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[96582425-502c-4f1c-a549-8f83d0446e6a]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[831e7b6e-3f67-45e3-95f0-4344f54872ba]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 23:57:01 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 23:57:01 user nova-compute[73497]:  {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:57:01 user nova-compute[73497]: WARNING os_brick.initiator.connectors.iscsi [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 23:57:01 user nova-compute[73497]: 
Aug 26 23:57:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e632c62-d861-45c2-8d75-fdf5a80f6ed1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6, portal: 172.16.0.220,3260]
Aug 26 23:57:01 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6, portal: 172.16.0.220,3260] successful.
Aug 26 23:57:01 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91422ce-32b7-45fb-b708-efbcd3b3c5ed]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f61bd9d-e086-4377-ae00-7d6188822ad0]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 (non-flash)
Aug 26 23:57:01 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 (non-flash)
Aug 26 23:57:01 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cd1077-1ba3-439e-97d3-40736b35afe1]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:57:01 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMblgFXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:57:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:57:02 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23038626635326133', 'path': '/dev/sdb'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:57:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038626635326133', 'path': '/dev/sdb'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:57:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-920149804',display_name='tempest-TestVolumeBootPattern-server-920149804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-920149804',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQ+N0pTaMhOCJarM3h1l7r/nXRl69icaKHUqFxozzTcIDFOjdkD/FQAV7dJ0BDWuRi4QUFih+uNp9B/6RxXoehOjwmxPJ6FmE8rwSmjVjNzJ4gi1FUwzweH3kRlzkgH2Q==',key_name='tempest-TestVolumeBootPattern-760141052',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba3491abf5cc4e77aed2997a5ac8aeee',ramdisk_id='',reservation_id='r-nm26auup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-377601332',owner_user_name='tempest-TestVolumeBootPattern-377601332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:56:51Z,user_data=None,user_id='dbd048b30716490880ff4b28758536a5',uuid=a2dc5340-84cd-44de-8f31-88b60a1eca81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6cd8015-e039-417d-af6f-957163cdae0d", "address": "fa:16:3e:2e:e3:45", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6cd8015-e0", "ovs_interfaceid": "e6cd8015-e039-417d-af6f-957163cdae0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:57:02 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Converting VIF {"id": "e6cd8015-e039-417d-af6f-957163cdae0d", "address": "fa:16:3e:2e:e3:45", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6cd8015-e0", "ovs_interfaceid": "e6cd8015-e039-417d-af6f-957163cdae0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:57:02 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:e3:45,bridge_name='br-int',has_traffic_filtering=True,id=e6cd8015-e039-417d-af6f-957163cdae0d,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6cd8015-e0') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:57:02 user nova-compute[73497]: DEBUG nova.objects.instance [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lazy-loading 'pci_devices' on Instance uuid a2dc5340-84cd-44de-8f31-88b60a1eca81 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:57:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:57:02 user nova-compute[73497]:   <uuid>a2dc5340-84cd-44de-8f31-88b60a1eca81</uuid>
Aug 26 23:57:02 user nova-compute[73497]:   <name>instance-00000032</name>
Aug 26 23:57:02 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:57:02 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:57:02 user nova-compute[73497]:   <metadata>
Aug 26 23:57:02 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:57:02 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:57:02 user nova-compute[73497]:       <nova:name>tempest-TestVolumeBootPattern-server-920149804</nova:name>
Aug 26 23:57:02 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:57:01</nova:creationTime>
Aug 26 23:57:02 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:57:02 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:57:02 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:57:02 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:57:02 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:57:02 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:57:02 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:57:02 user nova-compute[73497]:       <nova:owner>
Aug 26 23:57:02 user nova-compute[73497]:         <nova:user uuid="dbd048b30716490880ff4b28758536a5">tempest-TestVolumeBootPattern-377601332-project-member</nova:user>
Aug 26 23:57:02 user nova-compute[73497]:         <nova:project uuid="ba3491abf5cc4e77aed2997a5ac8aeee">tempest-TestVolumeBootPattern-377601332</nova:project>
Aug 26 23:57:02 user nova-compute[73497]:       </nova:owner>
Aug 26 23:57:02 user nova-compute[73497]:       <nova:ports>
Aug 26 23:57:02 user nova-compute[73497]:         <nova:port uuid="e6cd8015-e039-417d-af6f-957163cdae0d">
Aug 26 23:57:02 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 23:57:02 user nova-compute[73497]:         </nova:port>
Aug 26 23:57:02 user nova-compute[73497]:       </nova:ports>
Aug 26 23:57:02 user nova-compute[73497]:     </nova:instance>
Aug 26 23:57:02 user nova-compute[73497]:   </metadata>
Aug 26 23:57:02 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:57:02 user nova-compute[73497]:     <system>
Aug 26 23:57:02 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:57:02 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:57:02 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:57:02 user nova-compute[73497]:       <entry name="serial">a2dc5340-84cd-44de-8f31-88b60a1eca81</entry>
Aug 26 23:57:02 user nova-compute[73497]:       <entry name="uuid">a2dc5340-84cd-44de-8f31-88b60a1eca81</entry>
Aug 26 23:57:02 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:57:02 user nova-compute[73497]:     </system>
Aug 26 23:57:02 user nova-compute[73497]:   </sysinfo>
Aug 26 23:57:02 user nova-compute[73497]:   <os>
Aug 26 23:57:02 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:57:02 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:57:02 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:57:02 user nova-compute[73497]:   </os>
Aug 26 23:57:02 user nova-compute[73497]:   <features>
Aug 26 23:57:02 user nova-compute[73497]:     <acpi/>
Aug 26 23:57:02 user nova-compute[73497]:     <apic/>
Aug 26 23:57:02 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:57:02 user nova-compute[73497]:   </features>
Aug 26 23:57:02 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:57:02 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:57:02 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:57:02 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:57:02 user nova-compute[73497]:   </clock>
Aug 26 23:57:02 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:57:02 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:57:02 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:57:02 user nova-compute[73497]:   </cpu>
Aug 26 23:57:02 user nova-compute[73497]:   <devices>
Aug 26 23:57:02 user nova-compute[73497]:     <disk type="block" device="disk">
Aug 26 23:57:02 user nova-compute[73497]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:57:02 user nova-compute[73497]:       <source dev="/dev/sdb"/>
Aug 26 23:57:02 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:57:02 user nova-compute[73497]:       <serial>50abfef1-01fb-4df8-bb4a-e9f7832b3ef6</serial>
Aug 26 23:57:02 user nova-compute[73497]:     </disk>
Aug 26 23:57:02 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:57:02 user nova-compute[73497]:       <mac address="fa:16:3e:2e:e3:45"/>
Aug 26 23:57:02 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:57:02 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:57:02 user nova-compute[73497]:       <target dev="tape6cd8015-e0"/>
Aug 26 23:57:02 user nova-compute[73497]:     </interface>
Aug 26 23:57:02 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:57:02 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/a2dc5340-84cd-44de-8f31-88b60a1eca81/console.log" append="off"/>
Aug 26 23:57:02 user nova-compute[73497]:     </serial>
Aug 26 23:57:02 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:57:02 user nova-compute[73497]:     <video>
Aug 26 23:57:02 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:57:02 user nova-compute[73497]:     </video>
Aug 26 23:57:02 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:57:02 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:57:02 user nova-compute[73497]:     </rng>
Aug 26 23:57:02 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:57:02 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:57:02 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:57:02 user nova-compute[73497]:     </memballoon>
Aug 26 23:57:02 user nova-compute[73497]:   </devices>
Aug 26 23:57:02 user nova-compute[73497]: </domain>
Aug 26 23:57:02 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:57:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-920149804',display_name='tempest-TestVolumeBootPattern-server-920149804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-920149804',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQ+N0pTaMhOCJarM3h1l7r/nXRl69icaKHUqFxozzTcIDFOjdkD/FQAV7dJ0BDWuRi4QUFih+uNp9B/6RxXoehOjwmxPJ6FmE8rwSmjVjNzJ4gi1FUwzweH3kRlzkgH2Q==',key_name='tempest-TestVolumeBootPattern-760141052',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba3491abf5cc4e77aed2997a5ac8aeee',ramdisk_id='',reservation_id='r-nm26auup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-377601332',owner_user_name='tempest-TestVolumeBootPattern-377601332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:56:51Z,user_data=None,user_id='dbd048b30716490880ff4b28758536a5',uuid=a2dc5340-84cd-44de-8f31-88b60a1eca81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6cd8015-e039-417d-af6f-957163cdae0d", "address": "fa:16:3e:2e:e3:45", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6cd8015-e0", "ovs_interfaceid": "e6cd8015-e039-417d-af6f-957163cdae0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:57:02 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Converting VIF {"id": "e6cd8015-e039-417d-af6f-957163cdae0d", "address": "fa:16:3e:2e:e3:45", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6cd8015-e0", "ovs_interfaceid": "e6cd8015-e039-417d-af6f-957163cdae0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:57:02 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:e3:45,bridge_name='br-int',has_traffic_filtering=True,id=e6cd8015-e039-417d-af6f-957163cdae0d,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6cd8015-e0') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:57:02 user nova-compute[73497]: DEBUG os_vif [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:e3:45,bridge_name='br-int',has_traffic_filtering=True,id=e6cd8015-e039-417d-af6f-957163cdae0d,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6cd8015-e0') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:57:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:57:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:57:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:57:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:57:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6cd8015-e0, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:57:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape6cd8015-e0, col_values=(('external_ids', {'iface-id': 'e6cd8015-e039-417d-af6f-957163cdae0d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:e3:45', 'vm-uuid': 'a2dc5340-84cd-44de-8f31-88b60a1eca81'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:57:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:57:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:57:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:57:02 user nova-compute[73497]: INFO os_vif [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:e3:45,bridge_name='br-int',has_traffic_filtering=True,id=e6cd8015-e039-417d-af6f-957163cdae0d,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6cd8015-e0')
Aug 26 23:57:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:57:02 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] No VIF found with MAC fa:16:3e:2e:e3:45, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:57:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:57:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:57:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:57:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:57:04 user nova-compute[73497]: DEBUG nova.compute.manager [req-f3cac988-375c-4225-b3b6-ec33ff0eea7f req-eb8fbcd7-0b62-441f-9c05-5d5843d19030 service nova] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Received event network-vif-plugged-e6cd8015-e039-417d-af6f-957163cdae0d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:57:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f3cac988-375c-4225-b3b6-ec33ff0eea7f req-eb8fbcd7-0b62-441f-9c05-5d5843d19030 service nova] Acquiring lock "a2dc5340-84cd-44de-8f31-88b60a1eca81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:57:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f3cac988-375c-4225-b3b6-ec33ff0eea7f req-eb8fbcd7-0b62-441f-9c05-5d5843d19030 service nova] Lock "a2dc5340-84cd-44de-8f31-88b60a1eca81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:57:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f3cac988-375c-4225-b3b6-ec33ff0eea7f req-eb8fbcd7-0b62-441f-9c05-5d5843d19030 service nova] Lock "a2dc5340-84cd-44de-8f31-88b60a1eca81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:57:04 user nova-compute[73497]: DEBUG nova.compute.manager [req-f3cac988-375c-4225-b3b6-ec33ff0eea7f req-eb8fbcd7-0b62-441f-9c05-5d5843d19030 service nova] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] No waiting events found dispatching network-vif-plugged-e6cd8015-e039-417d-af6f-957163cdae0d {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:57:04 user nova-compute[73497]: WARNING nova.compute.manager [req-f3cac988-375c-4225-b3b6-ec33ff0eea7f req-eb8fbcd7-0b62-441f-9c05-5d5843d19030 service nova] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Received unexpected event network-vif-plugged-e6cd8015-e039-417d-af6f-957163cdae0d for instance with vm_state building and task_state spawning.
Aug 26 23:57:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:57:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:57:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:57:06 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693094226.4057367, a2dc5340-84cd-44de-8f31-88b60a1eca81 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:57:06 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] VM Resumed (Lifecycle Event)
Aug 26 23:57:06 user nova-compute[73497]: DEBUG nova.compute.manager [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:57:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:57:06 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Instance spawned successfully.
Aug 26 23:57:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:57:06 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:57:06 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:57:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:57:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:57:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:57:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:57:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:57:06 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:57:06 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:57:06 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693094226.4111855, a2dc5340-84cd-44de-8f31-88b60a1eca81 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:57:06 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] VM Started (Lifecycle Event)
Aug 26 23:57:06 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:57:06 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:57:06 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:57:06 user nova-compute[73497]: INFO nova.compute.manager [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Took 5.26 seconds to spawn the instance on the hypervisor.
Aug 26 23:57:06 user nova-compute[73497]: DEBUG nova.compute.manager [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:57:06 user nova-compute[73497]: DEBUG nova.compute.manager [req-33aea2c5-f6f7-492f-beca-725b2ee371b1 req-ec1aba7f-5e6e-4f07-90c8-b41b5e27eb88 service nova] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Received event network-vif-plugged-e6cd8015-e039-417d-af6f-957163cdae0d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:57:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-33aea2c5-f6f7-492f-beca-725b2ee371b1 req-ec1aba7f-5e6e-4f07-90c8-b41b5e27eb88 service nova] Acquiring lock "a2dc5340-84cd-44de-8f31-88b60a1eca81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:57:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-33aea2c5-f6f7-492f-beca-725b2ee371b1 req-ec1aba7f-5e6e-4f07-90c8-b41b5e27eb88 service nova] Lock "a2dc5340-84cd-44de-8f31-88b60a1eca81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:57:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-33aea2c5-f6f7-492f-beca-725b2ee371b1 req-ec1aba7f-5e6e-4f07-90c8-b41b5e27eb88 service nova] Lock "a2dc5340-84cd-44de-8f31-88b60a1eca81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:57:06 user nova-compute[73497]: DEBUG nova.compute.manager [req-33aea2c5-f6f7-492f-beca-725b2ee371b1 req-ec1aba7f-5e6e-4f07-90c8-b41b5e27eb88 service nova] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] No waiting events found dispatching network-vif-plugged-e6cd8015-e039-417d-af6f-957163cdae0d {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:57:06 user nova-compute[73497]: WARNING nova.compute.manager [req-33aea2c5-f6f7-492f-beca-725b2ee371b1 req-ec1aba7f-5e6e-4f07-90c8-b41b5e27eb88 service nova] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Received unexpected event network-vif-plugged-e6cd8015-e039-417d-af6f-957163cdae0d for instance with vm_state building and task_state spawning.
Aug 26 23:57:06 user nova-compute[73497]: INFO nova.compute.manager [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Took 16.32 seconds to build instance.
Aug 26 23:57:06 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-7d2c2882-20e5-4974-bfa8-85da620f1556 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "a2dc5340-84cd-44de-8f31-88b60a1eca81" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.422s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:57:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:57:08 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:57:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:57:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:57:20 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:57:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:57:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:57:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:57:20 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:57:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:57:20 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:57:20 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:57:20 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8718MB free_disk=25.056419372558594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:57:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:57:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:57:20 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance a2dc5340-84cd-44de-8f31-88b60a1eca81 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:57:20 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:57:20 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:57:20 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:57:20 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:57:20 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:57:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:57:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:57:23 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:57:25 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:57:25 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:57:26 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:57:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:57:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:57:28 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:57:28 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:57:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:57:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:57:35 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:57:37 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:57:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:57:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:57:40 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:57:40 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:57:42 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:57:42 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:57:42 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Rebuilding the list of instances to heal {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 23:57:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-a2dc5340-84cd-44de-8f31-88b60a1eca81" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:57:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-a2dc5340-84cd-44de-8f31-88b60a1eca81" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:57:42 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 23:57:42 user nova-compute[73497]: DEBUG nova.objects.instance [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lazy-loading 'info_cache' on Instance uuid a2dc5340-84cd-44de-8f31-88b60a1eca81 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:57:42 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Updating instance_info_cache with network_info: [{"id": "e6cd8015-e039-417d-af6f-957163cdae0d", "address": "fa:16:3e:2e:e3:45", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6cd8015-e0", "ovs_interfaceid": "e6cd8015-e039-417d-af6f-957163cdae0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:57:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-a2dc5340-84cd-44de-8f31-88b60a1eca81" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:57:42 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 23:57:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:57:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:57:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:57:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:57:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:57:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:57:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:57:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:57:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:58:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:58:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:58:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:58:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:58:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:58:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:58:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:58:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:58:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:58:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:58:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:58:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:58:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:58:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:58:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:58:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:58:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:58:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:58:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:58:20 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:58:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:58:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:58:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:58:20 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:58:20 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 23:58:20 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:58:20 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:58:20 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8763MB free_disk=25.055797576904297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:58:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:58:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:58:20 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance a2dc5340-84cd-44de-8f31-88b60a1eca81 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 23:58:20 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:58:20 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:58:20 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:58:20 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:58:20 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:58:20 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:58:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:58:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:58:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:58:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:58:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:58:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:58:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:58:27 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:58:27 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:58:28 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:58:28 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:58:30 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:58:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:58:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:58:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 23:58:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:58:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 23:58:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:58:36 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:58:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:58:39 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:58:40 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:58:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:58:42 user nova-compute[73497]: DEBUG nova.compute.manager [req-1cf74859-2344-428c-bb22-fdfb763134ca req-3b9ec89a-4a0b-4010-bb8f-c1d6c785234a service nova] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Received event network-changed-e6cd8015-e039-417d-af6f-957163cdae0d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:58:42 user nova-compute[73497]: DEBUG nova.compute.manager [req-1cf74859-2344-428c-bb22-fdfb763134ca req-3b9ec89a-4a0b-4010-bb8f-c1d6c785234a service nova] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Refreshing instance network info cache due to event network-changed-e6cd8015-e039-417d-af6f-957163cdae0d. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:58:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1cf74859-2344-428c-bb22-fdfb763134ca req-3b9ec89a-4a0b-4010-bb8f-c1d6c785234a service nova] Acquiring lock "refresh_cache-a2dc5340-84cd-44de-8f31-88b60a1eca81" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:58:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1cf74859-2344-428c-bb22-fdfb763134ca req-3b9ec89a-4a0b-4010-bb8f-c1d6c785234a service nova] Acquired lock "refresh_cache-a2dc5340-84cd-44de-8f31-88b60a1eca81" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:58:42 user nova-compute[73497]: DEBUG nova.network.neutron [req-1cf74859-2344-428c-bb22-fdfb763134ca req-3b9ec89a-4a0b-4010-bb8f-c1d6c785234a service nova] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Refreshing network info cache for port e6cd8015-e039-417d-af6f-957163cdae0d {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:58:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:58:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "a2dc5340-84cd-44de-8f31-88b60a1eca81" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:58:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "a2dc5340-84cd-44de-8f31-88b60a1eca81" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:58:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "a2dc5340-84cd-44de-8f31-88b60a1eca81-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:58:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "a2dc5340-84cd-44de-8f31-88b60a1eca81-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:58:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "a2dc5340-84cd-44de-8f31-88b60a1eca81-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:58:42 user nova-compute[73497]: INFO nova.compute.manager [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Terminating instance
Aug 26 23:58:42 user nova-compute[73497]: DEBUG nova.compute.manager [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG nova.network.neutron [req-1cf74859-2344-428c-bb22-fdfb763134ca req-3b9ec89a-4a0b-4010-bb8f-c1d6c785234a service nova] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Updated VIF entry in instance network info cache for port e6cd8015-e039-417d-af6f-957163cdae0d. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG nova.network.neutron [req-1cf74859-2344-428c-bb22-fdfb763134ca req-3b9ec89a-4a0b-4010-bb8f-c1d6c785234a service nova] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Updating instance_info_cache with network_info: [{"id": "e6cd8015-e039-417d-af6f-957163cdae0d", "address": "fa:16:3e:2e:e3:45", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6cd8015-e0", "ovs_interfaceid": "e6cd8015-e039-417d-af6f-957163cdae0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-1cf74859-2344-428c-bb22-fdfb763134ca req-3b9ec89a-4a0b-4010-bb8f-c1d6c785234a service nova] Releasing lock "refresh_cache-a2dc5340-84cd-44de-8f31-88b60a1eca81" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:58:43 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Instance destroyed successfully.
Aug 26 23:58:43 user nova-compute[73497]: DEBUG nova.objects.instance [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lazy-loading 'resources' on Instance uuid a2dc5340-84cd-44de-8f31-88b60a1eca81 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-920149804',display_name='tempest-TestVolumeBootPattern-server-920149804',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-920149804',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQ+N0pTaMhOCJarM3h1l7r/nXRl69icaKHUqFxozzTcIDFOjdkD/FQAV7dJ0BDWuRi4QUFih+uNp9B/6RxXoehOjwmxPJ6FmE8rwSmjVjNzJ4gi1FUwzweH3kRlzkgH2Q==',key_name='tempest-TestVolumeBootPattern-760141052',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:57:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba3491abf5cc4e77aed2997a5ac8aeee',ramdisk_id='',reservation_id='r-nm26auup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-377601332',owner_user_name='tempest-TestVolumeBootPattern-377601332-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:57:07Z,user_data=None,user_id='dbd048b30716490880ff4b28758536a5',uuid=a2dc5340-84cd-44de-8f31-88b60a1eca81,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6cd8015-e039-417d-af6f-957163cdae0d", "address": "fa:16:3e:2e:e3:45", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6cd8015-e0", "ovs_interfaceid": "e6cd8015-e039-417d-af6f-957163cdae0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Converting VIF {"id": "e6cd8015-e039-417d-af6f-957163cdae0d", "address": "fa:16:3e:2e:e3:45", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6cd8015-e0", "ovs_interfaceid": "e6cd8015-e039-417d-af6f-957163cdae0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:e3:45,bridge_name='br-int',has_traffic_filtering=True,id=e6cd8015-e039-417d-af6f-957163cdae0d,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6cd8015-e0') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG os_vif [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:e3:45,bridge_name='br-int',has_traffic_filtering=True,id=e6cd8015-e039-417d-af6f-957163cdae0d,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6cd8015-e0') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6cd8015-e0, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:58:43 user nova-compute[73497]: INFO os_vif [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:e3:45,bridge_name='br-int',has_traffic_filtering=True,id=e6cd8015-e039-417d-af6f-957163cdae0d,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6cd8015-e0')
Aug 26 23:58:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMblgFXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:58:43 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:58:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[397c50ee-586b-411a-a322-068d13e1302b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbab9dc-26f6-4f88-89c0-e8a5862684ab]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 (non-flash)
Aug 26 23:58:43 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 (non-flash)
Aug 26 23:58:43 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282c68ed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6'): ({'sdb'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Removing single pathed devices sdb {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[de413224-e280-43cd-9fac-d9d684c7c303]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03f933d-b4ed-4898-82d9-5e3ebfb59d89]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Flushing IO for device /dev/sdb {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[04687413-1d60-4ebc-ab15-2f4da553a90f]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ea64ee-0a37-4cc9-8646-35df8416bb28]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_9aab9da9', '/dev/disk/by-id/scsi-23038626635326133', '/dev/disk/by-id/scsi-1SCST_BIO9aab9da9-08bf52a31a7d2926') {{(pid=84617) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7e4953-b0d5-417c-b5a3-eb832ca2de2c]: (4, None) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[51463f2d-4b9d-4494-b04f-4f201860b412]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:58:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:58:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:58:44 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e716e24-998f-4cbc-8747-1da445fc1ee2]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:58:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6, portal: 172.16.0.220,3260]
Aug 26 23:58:44 user nova-compute[73497]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6, portal: 172.16.0.220,3260] successful.
Aug 26 23:58:44 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:58:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:58:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:58:44 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d173b5d3-e01a-4c94-9318-14269911a340]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:58:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:58:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:58:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] <== disconnect_volume: return (296ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:58:44 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 23:58:44 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Deleting instance files /opt/stack/data/nova/instances/a2dc5340-84cd-44de-8f31-88b60a1eca81_del
Aug 26 23:58:44 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Deletion of /opt/stack/data/nova/instances/a2dc5340-84cd-44de-8f31-88b60a1eca81_del complete
Aug 26 23:58:44 user nova-compute[73497]: INFO nova.compute.manager [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 26 23:58:44 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 23:58:44 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 23:58:44 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 23:58:44 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:58:44 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:58:44 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Rebuilding the list of instances to heal {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 23:58:44 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Skipping network cache update for instance because it is being deleted. {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Aug 26 23:58:44 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Didn't find any instances for network info cache update. {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 23:58:44 user nova-compute[73497]: DEBUG nova.compute.manager [req-81184e7a-69fb-4d25-810f-50cabfaab191 req-afcb7441-6a6d-49af-881a-f7c08354082d service nova] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Received event network-vif-unplugged-e6cd8015-e039-417d-af6f-957163cdae0d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:58:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-81184e7a-69fb-4d25-810f-50cabfaab191 req-afcb7441-6a6d-49af-881a-f7c08354082d service nova] Acquiring lock "a2dc5340-84cd-44de-8f31-88b60a1eca81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:58:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-81184e7a-69fb-4d25-810f-50cabfaab191 req-afcb7441-6a6d-49af-881a-f7c08354082d service nova] Lock "a2dc5340-84cd-44de-8f31-88b60a1eca81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:58:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-81184e7a-69fb-4d25-810f-50cabfaab191 req-afcb7441-6a6d-49af-881a-f7c08354082d service nova] Lock "a2dc5340-84cd-44de-8f31-88b60a1eca81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:58:44 user nova-compute[73497]: DEBUG nova.compute.manager [req-81184e7a-69fb-4d25-810f-50cabfaab191 req-afcb7441-6a6d-49af-881a-f7c08354082d service nova] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] No waiting events found dispatching network-vif-unplugged-e6cd8015-e039-417d-af6f-957163cdae0d {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:58:44 user nova-compute[73497]: DEBUG nova.compute.manager [req-81184e7a-69fb-4d25-810f-50cabfaab191 req-afcb7441-6a6d-49af-881a-f7c08354082d service nova] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Received event network-vif-unplugged-e6cd8015-e039-417d-af6f-957163cdae0d for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 23:58:44 user nova-compute[73497]: DEBUG nova.compute.manager [req-81184e7a-69fb-4d25-810f-50cabfaab191 req-afcb7441-6a6d-49af-881a-f7c08354082d service nova] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Received event network-vif-plugged-e6cd8015-e039-417d-af6f-957163cdae0d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:58:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-81184e7a-69fb-4d25-810f-50cabfaab191 req-afcb7441-6a6d-49af-881a-f7c08354082d service nova] Acquiring lock "a2dc5340-84cd-44de-8f31-88b60a1eca81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:58:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-81184e7a-69fb-4d25-810f-50cabfaab191 req-afcb7441-6a6d-49af-881a-f7c08354082d service nova] Lock "a2dc5340-84cd-44de-8f31-88b60a1eca81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:58:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-81184e7a-69fb-4d25-810f-50cabfaab191 req-afcb7441-6a6d-49af-881a-f7c08354082d service nova] Lock "a2dc5340-84cd-44de-8f31-88b60a1eca81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:58:44 user nova-compute[73497]: DEBUG nova.compute.manager [req-81184e7a-69fb-4d25-810f-50cabfaab191 req-afcb7441-6a6d-49af-881a-f7c08354082d service nova] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] No waiting events found dispatching network-vif-plugged-e6cd8015-e039-417d-af6f-957163cdae0d {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:58:44 user nova-compute[73497]: WARNING nova.compute.manager [req-81184e7a-69fb-4d25-810f-50cabfaab191 req-afcb7441-6a6d-49af-881a-f7c08354082d service nova] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Received unexpected event network-vif-plugged-e6cd8015-e039-417d-af6f-957163cdae0d for instance with vm_state active and task_state deleting.
Aug 26 23:58:44 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:58:44 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Took 0.79 seconds to deallocate network for instance.
Aug 26 23:58:45 user nova-compute[73497]: INFO nova.compute.manager [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Took 0.81 seconds to detach 1 volumes for instance.
Aug 26 23:58:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:58:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:58:45 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:58:45 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:58:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.098s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:58:45 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Deleted allocations for instance a2dc5340-84cd-44de-8f31-88b60a1eca81
Aug 26 23:58:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-908ce690-51f0-4e18-bad2-d62357fef546 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "a2dc5340-84cd-44de-8f31-88b60a1eca81" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.073s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:58:46 user nova-compute[73497]: DEBUG nova.compute.manager [req-3debf155-6bbd-4f9f-bc73-a62dd3331382 req-71c61a03-9c58-462e-bb86-d064b0c049ac service nova] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Received event network-vif-deleted-e6cd8015-e039-417d-af6f-957163cdae0d {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:58:48 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:58:48 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:58:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:58:58 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693094323.70099, a2dc5340-84cd-44de-8f31-88b60a1eca81 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:58:58 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] VM Stopped (Lifecycle Event)
Aug 26 23:58:58 user nova-compute[73497]: DEBUG nova.compute.manager [None req-8e4ac9eb-c9bd-4235-973c-e1570da28533 None None] [instance: a2dc5340-84cd-44de-8f31-88b60a1eca81] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:58:58 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:59:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:59:08 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:59:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:59:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:59:21 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:59:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:59:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:59:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:59:21 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 23:59:21 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:59:21 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:59:21 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8906MB free_disk=25.054950714111328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 23:59:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:59:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:59:21 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 23:59:21 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 23:59:21 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:59:21 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:59:21 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 23:59:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:59:23 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:59:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:59:29 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:59:29 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:59:29 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 23:59:30 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:59:32 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:59:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:59:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "726bb85b-391e-4041-972f-f35062c9409b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:59:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "726bb85b-391e-4041-972f-f35062c9409b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:59:34 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 23:59:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:59:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:59:34 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 23:59:34 user nova-compute[73497]: INFO nova.compute.claims [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Claim successful on node user
Aug 26 23:59:35 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 23:59:35 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 23:59:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.186s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:59:35 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 23:59:35 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 23:59:35 user nova-compute[73497]: DEBUG nova.network.neutron [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 23:59:35 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 23:59:35 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 23:59:35 user nova-compute[73497]: INFO nova.virt.block_device [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Booting with volume 50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 at /dev/vda
Aug 26 23:59:35 user nova-compute[73497]: DEBUG os_brick.utils [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:59:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:59:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:59:35 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[028e0baf-4919-41fd-b78c-5396c4b10cf0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:59:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:59:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:59:35 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab7fa55-f922-4617-b69e-5d6cafe06ead]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:59:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:59:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:59:35 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddb3208-febd-4a7d-8974-956afe190ae9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:59:35 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7fce5d-4611-4227-852e-e4925a758479]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:59:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:59:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:59:35 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 23:59:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:59:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 23:59:35 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 23:59:35 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa24e19-8e9e-4b5b-815b-c4c9f6198c0b]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:59:35 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 23:59:35 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 23:59:35 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 23:59:35 user nova-compute[73497]: DEBUG os_brick.utils [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:59:35 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Updating existing volume attachment record: 09f885cf-d8cd-42a0-9e1d-70db19ef1349 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 23:59:35 user nova-compute[73497]: DEBUG nova.policy [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dbd048b30716490880ff4b28758536a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3491abf5cc4e77aed2997a5ac8aeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 23:59:36 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:59:36 user nova-compute[73497]: DEBUG nova.network.neutron [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Successfully created port: 52f7945c-939e-40d4-ac84-3827a07a9478 {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 23:59:37 user nova-compute[73497]: DEBUG nova.network.neutron [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Successfully updated port: 52f7945c-939e-40d4-ac84-3827a07a9478 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 23:59:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "refresh_cache-726bb85b-391e-4041-972f-f35062c9409b" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:59:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquired lock "refresh_cache-726bb85b-391e-4041-972f-f35062c9409b" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:59:37 user nova-compute[73497]: DEBUG nova.network.neutron [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 23:59:37 user nova-compute[73497]: DEBUG nova.compute.manager [req-344b19a0-87eb-4b7e-b700-acc1fd90af42 req-52edef42-c590-45da-b06d-29403c64f4fe service nova] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Received event network-changed-52f7945c-939e-40d4-ac84-3827a07a9478 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:59:37 user nova-compute[73497]: DEBUG nova.compute.manager [req-344b19a0-87eb-4b7e-b700-acc1fd90af42 req-52edef42-c590-45da-b06d-29403c64f4fe service nova] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Refreshing instance network info cache due to event network-changed-52f7945c-939e-40d4-ac84-3827a07a9478. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 23:59:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-344b19a0-87eb-4b7e-b700-acc1fd90af42 req-52edef42-c590-45da-b06d-29403c64f4fe service nova] Acquiring lock "refresh_cache-726bb85b-391e-4041-972f-f35062c9409b" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 23:59:37 user nova-compute[73497]: DEBUG nova.network.neutron [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 23:59:37 user nova-compute[73497]: DEBUG nova.network.neutron [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Updating instance_info_cache with network_info: [{"id": "52f7945c-939e-40d4-ac84-3827a07a9478", "address": "fa:16:3e:f5:15:a1", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52f7945c-93", "ovs_interfaceid": "52f7945c-939e-40d4-ac84-3827a07a9478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:59:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Releasing lock "refresh_cache-726bb85b-391e-4041-972f-f35062c9409b" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:59:37 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Instance network_info: |[{"id": "52f7945c-939e-40d4-ac84-3827a07a9478", "address": "fa:16:3e:f5:15:a1", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52f7945c-93", "ovs_interfaceid": "52f7945c-939e-40d4-ac84-3827a07a9478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 23:59:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-344b19a0-87eb-4b7e-b700-acc1fd90af42 req-52edef42-c590-45da-b06d-29403c64f4fe service nova] Acquired lock "refresh_cache-726bb85b-391e-4041-972f-f35062c9409b" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 23:59:37 user nova-compute[73497]: DEBUG nova.network.neutron [req-344b19a0-87eb-4b7e-b700-acc1fd90af42 req-52edef42-c590-45da-b06d-29403c64f4fe service nova] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Refreshing network info cache for port 52f7945c-939e-40d4-ac84-3827a07a9478 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 23:59:37 user nova-compute[73497]: DEBUG nova.network.neutron [req-344b19a0-87eb-4b7e-b700-acc1fd90af42 req-52edef42-c590-45da-b06d-29403c64f4fe service nova] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Updated VIF entry in instance network info cache for port 52f7945c-939e-40d4-ac84-3827a07a9478. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 23:59:37 user nova-compute[73497]: DEBUG nova.network.neutron [req-344b19a0-87eb-4b7e-b700-acc1fd90af42 req-52edef42-c590-45da-b06d-29403c64f4fe service nova] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Updating instance_info_cache with network_info: [{"id": "52f7945c-939e-40d4-ac84-3827a07a9478", "address": "fa:16:3e:f5:15:a1", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52f7945c-93", "ovs_interfaceid": "52f7945c-939e-40d4-ac84-3827a07a9478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 23:59:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-344b19a0-87eb-4b7e-b700-acc1fd90af42 req-52edef42-c590-45da-b06d-29403c64f4fe service nova] Releasing lock "refresh_cache-726bb85b-391e-4041-972f-f35062c9409b" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 23:59:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:59:39 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:59:39 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Cleaning up deleted instances with incomplete migration  {{(pid=73497) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 23:59:40 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:59:40 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:59:40 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:59:40 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:59:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:59:46 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:59:46 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 23:59:46 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Rebuilding the list of instances to heal {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 23:59:46 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Skipping network cache update for instance because it is Building. {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 26 23:59:46 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Didn't find any instances for network info cache update. {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 23:59:47 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 23:59:47 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Cleaning up deleted instances {{(pid=73497) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 23:59:47 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] There are 0 instances to clean {{(pid=73497) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 23:59:48 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:59:52 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 23:59:52 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 23:59:52 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Creating image(s)
Aug 26 23:59:52 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Did not create local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 23:59:52 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Ensure instance console log exists: /opt/stack/data/nova/instances/726bb85b-391e-4041-972f-f35062c9409b/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 23:59:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:59:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:59:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:59:52 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Start _get_guest_xml network_info=[{"id": "52f7945c-939e-40d4-ac84-3827a07a9478", "address": "fa:16:3e:f5:15:a1", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52f7945c-93", "ovs_interfaceid": "52f7945c-939e-40d4-ac84-3827a07a9478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '09f885cf-d8cd-42a0-9e1d-70db19ef1349', 'guest_format': None, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMblgFXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '726bb85b-391e-4041-972f-f35062c9409b', 'attached_at': '', 'detached_at': '', 'volume_id': '50abfef1-01fb-4df8-bb4a-e9f7832b3ef6', 'serial': '50abfef1-01fb-4df8-bb4a-e9f7832b3ef6'}, 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 23:59:52 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:59:52 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 23:59:52 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 23:59:52 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 23:59:52 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 23:59:52 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 23:59:52 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 23:59:52 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 23:59:52 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 23:59:52 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 23:59:52 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 23:59:52 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 23:59:52 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 23:59:52 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 23:59:52 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 23:59:52 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 23:59:52 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 23:59:52 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 23:59:52 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 23:59:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMblgFXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 23:59:52 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:59:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:59:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:59:52 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 23:59:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 23:59:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 23:59:52 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 23:59:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:59:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:59:52 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f947d1-68bd-4dd6-aa7e-fe9e04dd7f7a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:59:52 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 23:59:52 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:59:52 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27ed745-d874-43de-a3b7-d6a8d5493428]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6] added
Aug 26 23:59:53 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9c4617-03b1-47d2-9671-fd7657cb9dd1]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0f45e6-4833-417d-9bfe-361d17a9317c]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wMblgFXU {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wMblgFXU" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[269b7700-4308-4361-a1c7-8feb3c909a91]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wMblgFXU'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5da7ea-e055-486d-ab74-1f7b397998c3]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa6b3d2-4cea-4ab4-bafd-cf0768c65b72]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 23:59:53 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 23:59:53 user nova-compute[73497]:  {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:59:53 user nova-compute[73497]: WARNING os_brick.initiator.connectors.iscsi [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 23:59:53 user nova-compute[73497]: 
Aug 26 23:59:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61bcbad-5621-491d-b8e0-ed2aee1510de]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6, portal: 172.16.0.220,3260]
Aug 26 23:59:53 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6, portal: 172.16.0.220,3260] successful.
Aug 26 23:59:53 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb9c28f-eb3c-45ed-a29f-83ca1645fd51]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcb6226-1ec5-4eee-a3c8-5bc2de13ee8a]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 (non-flash)
Aug 26 23:59:53 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 (non-flash)
Aug 26 23:59:53 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[454d54e3-d87b-48ab-b745-6d2eec3154e0]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMblgFXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 23:59:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:59:54 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 23:59:54 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23038626635326133', 'path': '/dev/sdb'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 23:59:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038626635326133', 'path': '/dev/sdb'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 23:59:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:59:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-671362078',display_name='tempest-TestVolumeBootPattern-server-671362078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-671362078',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQ+N0pTaMhOCJarM3h1l7r/nXRl69icaKHUqFxozzTcIDFOjdkD/FQAV7dJ0BDWuRi4QUFih+uNp9B/6RxXoehOjwmxPJ6FmE8rwSmjVjNzJ4gi1FUwzweH3kRlzkgH2Q==',key_name='tempest-TestVolumeBootPattern-760141052',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba3491abf5cc4e77aed2997a5ac8aeee',ramdisk_id='',reservation_id='r-0f0lw0m5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-377601332',owner_user_name='tempest-TestVolumeBootPattern-377601332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:59:35Z,user_data=None,user_id='dbd048b30716490880ff4b28758536a5',uuid=726bb85b-391e-4041-972f-f35062c9409b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52f7945c-939e-40d4-ac84-3827a07a9478", "address": "fa:16:3e:f5:15:a1", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52f7945c-93", "ovs_interfaceid": "52f7945c-939e-40d4-ac84-3827a07a9478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 23:59:54 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Converting VIF {"id": "52f7945c-939e-40d4-ac84-3827a07a9478", "address": "fa:16:3e:f5:15:a1", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52f7945c-93", "ovs_interfaceid": "52f7945c-939e-40d4-ac84-3827a07a9478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:59:54 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:15:a1,bridge_name='br-int',has_traffic_filtering=True,id=52f7945c-939e-40d4-ac84-3827a07a9478,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52f7945c-93') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:59:54 user nova-compute[73497]: DEBUG nova.objects.instance [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lazy-loading 'pci_devices' on Instance uuid 726bb85b-391e-4041-972f-f35062c9409b {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 23:59:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] End _get_guest_xml xml=<domain type="kvm">
Aug 26 23:59:54 user nova-compute[73497]:   <uuid>726bb85b-391e-4041-972f-f35062c9409b</uuid>
Aug 26 23:59:54 user nova-compute[73497]:   <name>instance-00000033</name>
Aug 26 23:59:54 user nova-compute[73497]:   <memory>524288</memory>
Aug 26 23:59:54 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 26 23:59:54 user nova-compute[73497]:   <metadata>
Aug 26 23:59:54 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 23:59:54 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 26 23:59:54 user nova-compute[73497]:       <nova:name>tempest-TestVolumeBootPattern-server-671362078</nova:name>
Aug 26 23:59:54 user nova-compute[73497]:       <nova:creationTime>2023-08-26 23:59:52</nova:creationTime>
Aug 26 23:59:54 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 26 23:59:54 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 26 23:59:54 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 26 23:59:54 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 26 23:59:54 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 23:59:54 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 26 23:59:54 user nova-compute[73497]:       </nova:flavor>
Aug 26 23:59:54 user nova-compute[73497]:       <nova:owner>
Aug 26 23:59:54 user nova-compute[73497]:         <nova:user uuid="dbd048b30716490880ff4b28758536a5">tempest-TestVolumeBootPattern-377601332-project-member</nova:user>
Aug 26 23:59:54 user nova-compute[73497]:         <nova:project uuid="ba3491abf5cc4e77aed2997a5ac8aeee">tempest-TestVolumeBootPattern-377601332</nova:project>
Aug 26 23:59:54 user nova-compute[73497]:       </nova:owner>
Aug 26 23:59:54 user nova-compute[73497]:       <nova:ports>
Aug 26 23:59:54 user nova-compute[73497]:         <nova:port uuid="52f7945c-939e-40d4-ac84-3827a07a9478">
Aug 26 23:59:54 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 23:59:54 user nova-compute[73497]:         </nova:port>
Aug 26 23:59:54 user nova-compute[73497]:       </nova:ports>
Aug 26 23:59:54 user nova-compute[73497]:     </nova:instance>
Aug 26 23:59:54 user nova-compute[73497]:   </metadata>
Aug 26 23:59:54 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 26 23:59:54 user nova-compute[73497]:     <system>
Aug 26 23:59:54 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 23:59:54 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 26 23:59:54 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 26 23:59:54 user nova-compute[73497]:       <entry name="serial">726bb85b-391e-4041-972f-f35062c9409b</entry>
Aug 26 23:59:54 user nova-compute[73497]:       <entry name="uuid">726bb85b-391e-4041-972f-f35062c9409b</entry>
Aug 26 23:59:54 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 26 23:59:54 user nova-compute[73497]:     </system>
Aug 26 23:59:54 user nova-compute[73497]:   </sysinfo>
Aug 26 23:59:54 user nova-compute[73497]:   <os>
Aug 26 23:59:54 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 23:59:54 user nova-compute[73497]:     <boot dev="hd"/>
Aug 26 23:59:54 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 26 23:59:54 user nova-compute[73497]:   </os>
Aug 26 23:59:54 user nova-compute[73497]:   <features>
Aug 26 23:59:54 user nova-compute[73497]:     <acpi/>
Aug 26 23:59:54 user nova-compute[73497]:     <apic/>
Aug 26 23:59:54 user nova-compute[73497]:     <vmcoreinfo/>
Aug 26 23:59:54 user nova-compute[73497]:   </features>
Aug 26 23:59:54 user nova-compute[73497]:   <clock offset="utc">
Aug 26 23:59:54 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 23:59:54 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 23:59:54 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 26 23:59:54 user nova-compute[73497]:   </clock>
Aug 26 23:59:54 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 26 23:59:54 user nova-compute[73497]:     <model>Nehalem</model>
Aug 26 23:59:54 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 23:59:54 user nova-compute[73497]:   </cpu>
Aug 26 23:59:54 user nova-compute[73497]:   <devices>
Aug 26 23:59:54 user nova-compute[73497]:     <disk type="block" device="disk">
Aug 26 23:59:54 user nova-compute[73497]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 23:59:54 user nova-compute[73497]:       <source dev="/dev/sdb"/>
Aug 26 23:59:54 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 26 23:59:54 user nova-compute[73497]:       <serial>50abfef1-01fb-4df8-bb4a-e9f7832b3ef6</serial>
Aug 26 23:59:54 user nova-compute[73497]:     </disk>
Aug 26 23:59:54 user nova-compute[73497]:     <interface type="ethernet">
Aug 26 23:59:54 user nova-compute[73497]:       <mac address="fa:16:3e:f5:15:a1"/>
Aug 26 23:59:54 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:59:54 user nova-compute[73497]:       <mtu size="1442"/>
Aug 26 23:59:54 user nova-compute[73497]:       <target dev="tap52f7945c-93"/>
Aug 26 23:59:54 user nova-compute[73497]:     </interface>
Aug 26 23:59:54 user nova-compute[73497]:     <serial type="pty">
Aug 26 23:59:54 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/726bb85b-391e-4041-972f-f35062c9409b/console.log" append="off"/>
Aug 26 23:59:54 user nova-compute[73497]:     </serial>
Aug 26 23:59:54 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 23:59:54 user nova-compute[73497]:     <video>
Aug 26 23:59:54 user nova-compute[73497]:       <model type="virtio"/>
Aug 26 23:59:54 user nova-compute[73497]:     </video>
Aug 26 23:59:54 user nova-compute[73497]:     <rng model="virtio">
Aug 26 23:59:54 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 26 23:59:54 user nova-compute[73497]:     </rng>
Aug 26 23:59:54 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 26 23:59:54 user nova-compute[73497]:     <memballoon model="virtio">
Aug 26 23:59:54 user nova-compute[73497]:       <stats period="10"/>
Aug 26 23:59:54 user nova-compute[73497]:     </memballoon>
Aug 26 23:59:54 user nova-compute[73497]:   </devices>
Aug 26 23:59:54 user nova-compute[73497]: </domain>
Aug 26 23:59:54 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 23:59:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:59:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-671362078',display_name='tempest-TestVolumeBootPattern-server-671362078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-671362078',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQ+N0pTaMhOCJarM3h1l7r/nXRl69icaKHUqFxozzTcIDFOjdkD/FQAV7dJ0BDWuRi4QUFih+uNp9B/6RxXoehOjwmxPJ6FmE8rwSmjVjNzJ4gi1FUwzweH3kRlzkgH2Q==',key_name='tempest-TestVolumeBootPattern-760141052',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba3491abf5cc4e77aed2997a5ac8aeee',ramdisk_id='',reservation_id='r-0f0lw0m5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-377601332',owner_user_name='tempest-TestVolumeBootPattern-377601332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T23:59:35Z,user_data=None,user_id='dbd048b30716490880ff4b28758536a5',uuid=726bb85b-391e-4041-972f-f35062c9409b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52f7945c-939e-40d4-ac84-3827a07a9478", "address": "fa:16:3e:f5:15:a1", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52f7945c-93", "ovs_interfaceid": "52f7945c-939e-40d4-ac84-3827a07a9478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 23:59:54 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Converting VIF {"id": "52f7945c-939e-40d4-ac84-3827a07a9478", "address": "fa:16:3e:f5:15:a1", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52f7945c-93", "ovs_interfaceid": "52f7945c-939e-40d4-ac84-3827a07a9478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 23:59:54 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:15:a1,bridge_name='br-int',has_traffic_filtering=True,id=52f7945c-939e-40d4-ac84-3827a07a9478,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52f7945c-93') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 23:59:54 user nova-compute[73497]: DEBUG os_vif [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:15:a1,bridge_name='br-int',has_traffic_filtering=True,id=52f7945c-939e-40d4-ac84-3827a07a9478,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52f7945c-93') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 23:59:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:59:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:59:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 23:59:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:59:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap52f7945c-93, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:59:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap52f7945c-93, col_values=(('external_ids', {'iface-id': '52f7945c-939e-40d4-ac84-3827a07a9478', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:15:a1', 'vm-uuid': '726bb85b-391e-4041-972f-f35062c9409b'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 23:59:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:59:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 23:59:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:59:54 user nova-compute[73497]: INFO os_vif [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:15:a1,bridge_name='br-int',has_traffic_filtering=True,id=52f7945c-939e-40d4-ac84-3827a07a9478,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52f7945c-93')
Aug 26 23:59:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 23:59:54 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] No VIF found with MAC fa:16:3e:f5:15:a1, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 23:59:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:59:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:59:55 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:59:55 user nova-compute[73497]: DEBUG nova.compute.manager [req-4edc3a60-efb5-4177-871e-2252fc8c5d4c req-4e43b719-1a14-4b30-8dfb-ff03e53109e0 service nova] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Received event network-vif-plugged-52f7945c-939e-40d4-ac84-3827a07a9478 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:59:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4edc3a60-efb5-4177-871e-2252fc8c5d4c req-4e43b719-1a14-4b30-8dfb-ff03e53109e0 service nova] Acquiring lock "726bb85b-391e-4041-972f-f35062c9409b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:59:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4edc3a60-efb5-4177-871e-2252fc8c5d4c req-4e43b719-1a14-4b30-8dfb-ff03e53109e0 service nova] Lock "726bb85b-391e-4041-972f-f35062c9409b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:59:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-4edc3a60-efb5-4177-871e-2252fc8c5d4c req-4e43b719-1a14-4b30-8dfb-ff03e53109e0 service nova] Lock "726bb85b-391e-4041-972f-f35062c9409b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:59:55 user nova-compute[73497]: DEBUG nova.compute.manager [req-4edc3a60-efb5-4177-871e-2252fc8c5d4c req-4e43b719-1a14-4b30-8dfb-ff03e53109e0 service nova] [instance: 726bb85b-391e-4041-972f-f35062c9409b] No waiting events found dispatching network-vif-plugged-52f7945c-939e-40d4-ac84-3827a07a9478 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:59:55 user nova-compute[73497]: WARNING nova.compute.manager [req-4edc3a60-efb5-4177-871e-2252fc8c5d4c req-4e43b719-1a14-4b30-8dfb-ff03e53109e0 service nova] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Received unexpected event network-vif-plugged-52f7945c-939e-40d4-ac84-3827a07a9478 for instance with vm_state building and task_state spawning.
Aug 26 23:59:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:59:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:59:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:59:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:59:57 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693094397.751575, 726bb85b-391e-4041-972f-f35062c9409b => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:59:57 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 726bb85b-391e-4041-972f-f35062c9409b] VM Resumed (Lifecycle Event)
Aug 26 23:59:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 23:59:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 23:59:57 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Instance spawned successfully.
Aug 26 23:59:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 23:59:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:59:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:59:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:59:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:59:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:59:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:59:57 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 23:59:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:59:57 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 726bb85b-391e-4041-972f-f35062c9409b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:59:57 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693094397.7531204, 726bb85b-391e-4041-972f-f35062c9409b => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 23:59:57 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 726bb85b-391e-4041-972f-f35062c9409b] VM Started (Lifecycle Event)
Aug 26 23:59:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:59:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 23:59:57 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 726bb85b-391e-4041-972f-f35062c9409b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 23:59:57 user nova-compute[73497]: INFO nova.compute.manager [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Took 4.97 seconds to spawn the instance on the hypervisor.
Aug 26 23:59:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 23:59:57 user nova-compute[73497]: INFO nova.compute.manager [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Took 23.05 seconds to build instance.
Aug 26 23:59:57 user nova-compute[73497]: DEBUG nova.compute.manager [req-de6777b1-8925-41ca-a8ba-e5a6a7de38aa req-fadb3bdb-a6da-4d7f-810d-0a493d632b61 service nova] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Received event network-vif-plugged-52f7945c-939e-40d4-ac84-3827a07a9478 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 23:59:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-de6777b1-8925-41ca-a8ba-e5a6a7de38aa req-fadb3bdb-a6da-4d7f-810d-0a493d632b61 service nova] Acquiring lock "726bb85b-391e-4041-972f-f35062c9409b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 23:59:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-de6777b1-8925-41ca-a8ba-e5a6a7de38aa req-fadb3bdb-a6da-4d7f-810d-0a493d632b61 service nova] Lock "726bb85b-391e-4041-972f-f35062c9409b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 23:59:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-de6777b1-8925-41ca-a8ba-e5a6a7de38aa req-fadb3bdb-a6da-4d7f-810d-0a493d632b61 service nova] Lock "726bb85b-391e-4041-972f-f35062c9409b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:59:57 user nova-compute[73497]: DEBUG nova.compute.manager [req-de6777b1-8925-41ca-a8ba-e5a6a7de38aa req-fadb3bdb-a6da-4d7f-810d-0a493d632b61 service nova] [instance: 726bb85b-391e-4041-972f-f35062c9409b] No waiting events found dispatching network-vif-plugged-52f7945c-939e-40d4-ac84-3827a07a9478 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 23:59:57 user nova-compute[73497]: WARNING nova.compute.manager [req-de6777b1-8925-41ca-a8ba-e5a6a7de38aa req-fadb3bdb-a6da-4d7f-810d-0a493d632b61 service nova] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Received unexpected event network-vif-plugged-52f7945c-939e-40d4-ac84-3827a07a9478 for instance with vm_state active and task_state None.
Aug 26 23:59:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-9916fdfe-ba63-468b-bfb6-623c8a9675d9 tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "726bb85b-391e-4041-972f-f35062c9409b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.151s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 23:59:58 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 23:59:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:00:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:00:08 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_power_states {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:00:08 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Triggering sync for uuid 726bb85b-391e-4041-972f-f35062c9409b {{(pid=73497) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 00:00:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "726bb85b-391e-4041-972f-f35062c9409b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:00:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "726bb85b-391e-4041-972f-f35062c9409b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:00:08 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "726bb85b-391e-4041-972f-f35062c9409b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:00:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:00:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:00:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:00:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:00:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:00:21 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:00:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:00:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:00:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:00:21 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 00:00:21 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:00:21 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:00:21 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:00:21 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8831MB free_disk=25.053218841552734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 00:00:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:00:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:00:21 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 726bb85b-391e-4041-972f-f35062c9409b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:00:21 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 00:00:21 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 00:00:21 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:00:21 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:00:21 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 00:00:21 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:00:23 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:00:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:00:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:00:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:00:31 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:00:31 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:00:31 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:00:31 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 00:00:32 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:00:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:00:36 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:00:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:00:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:00:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 00:00:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:00:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:00:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:00:40 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:00:42 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:00:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:00:46 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:00:46 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 00:00:46 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Rebuilding the list of instances to heal {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 00:00:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-726bb85b-391e-4041-972f-f35062c9409b" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:00:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-726bb85b-391e-4041-972f-f35062c9409b" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:00:46 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 00:00:46 user nova-compute[73497]: DEBUG nova.objects.instance [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lazy-loading 'info_cache' on Instance uuid 726bb85b-391e-4041-972f-f35062c9409b {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:00:46 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Updating instance_info_cache with network_info: [{"id": "52f7945c-939e-40d4-ac84-3827a07a9478", "address": "fa:16:3e:f5:15:a1", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52f7945c-93", "ovs_interfaceid": "52f7945c-939e-40d4-ac84-3827a07a9478", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:00:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-726bb85b-391e-4041-972f-f35062c9409b" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:00:46 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 00:00:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:00:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:00:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:00:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 00:00:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:00:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:00:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:00:59 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:01:04 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:01:09 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:01:14 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:01:19 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:01:23 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:01:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:01:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:01:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:01:23 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 00:01:23 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:01:23 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:01:23 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:01:23 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8816MB free_disk=25.052589416503906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 00:01:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:01:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:01:23 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 726bb85b-391e-4041-972f-f35062c9409b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:01:23 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 00:01:23 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 00:01:23 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Refreshing inventories for resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 00:01:23 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Updating ProviderTree inventory for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 00:01:23 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Updating inventory in ProviderTree for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 00:01:23 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Refreshing aggregate associations for resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1, aggregates: None {{(pid=73497) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 00:01:23 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Refreshing trait associations for resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING {{(pid=73497) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 00:01:23 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:01:23 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:01:23 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 00:01:23 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.279s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:01:24 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:01:25 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:01:26 user nova-compute[73497]: DEBUG nova.compute.manager [req-9ce1b291-0efc-42a7-9ea1-af2881bb1dd8 req-51c47eea-e726-4a2b-8096-c28878e3c0b6 service nova] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Received event network-changed-52f7945c-939e-40d4-ac84-3827a07a9478 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:01:26 user nova-compute[73497]: DEBUG nova.compute.manager [req-9ce1b291-0efc-42a7-9ea1-af2881bb1dd8 req-51c47eea-e726-4a2b-8096-c28878e3c0b6 service nova] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Refreshing instance network info cache due to event network-changed-52f7945c-939e-40d4-ac84-3827a07a9478. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:01:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9ce1b291-0efc-42a7-9ea1-af2881bb1dd8 req-51c47eea-e726-4a2b-8096-c28878e3c0b6 service nova] Acquiring lock "refresh_cache-726bb85b-391e-4041-972f-f35062c9409b" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:01:26 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9ce1b291-0efc-42a7-9ea1-af2881bb1dd8 req-51c47eea-e726-4a2b-8096-c28878e3c0b6 service nova] Acquired lock "refresh_cache-726bb85b-391e-4041-972f-f35062c9409b" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:01:26 user nova-compute[73497]: DEBUG nova.network.neutron [req-9ce1b291-0efc-42a7-9ea1-af2881bb1dd8 req-51c47eea-e726-4a2b-8096-c28878e3c0b6 service nova] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Refreshing network info cache for port 52f7945c-939e-40d4-ac84-3827a07a9478 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:01:27 user nova-compute[73497]: DEBUG nova.network.neutron [req-9ce1b291-0efc-42a7-9ea1-af2881bb1dd8 req-51c47eea-e726-4a2b-8096-c28878e3c0b6 service nova] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Updated VIF entry in instance network info cache for port 52f7945c-939e-40d4-ac84-3827a07a9478. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:01:27 user nova-compute[73497]: DEBUG nova.network.neutron [req-9ce1b291-0efc-42a7-9ea1-af2881bb1dd8 req-51c47eea-e726-4a2b-8096-c28878e3c0b6 service nova] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Updating instance_info_cache with network_info: [{"id": "52f7945c-939e-40d4-ac84-3827a07a9478", "address": "fa:16:3e:f5:15:a1", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52f7945c-93", "ovs_interfaceid": "52f7945c-939e-40d4-ac84-3827a07a9478", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:01:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-9ce1b291-0efc-42a7-9ea1-af2881bb1dd8 req-51c47eea-e726-4a2b-8096-c28878e3c0b6 service nova] Releasing lock "refresh_cache-726bb85b-391e-4041-972f-f35062c9409b" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:01:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:01:29 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:01:32 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:01:32 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:01:32 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 00:01:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:01:33 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:01:34 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:01:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:01:37 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:01:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:01:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:01:40 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:01:41 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:01:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:01:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "7bf1189a-363f-44f1-97b0-a8012c9b4c45" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:01:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "7bf1189a-363f-44f1-97b0-a8012c9b4c45" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:01:43 user nova-compute[73497]: DEBUG nova.compute.manager [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 00:01:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:01:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:01:43 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 00:01:43 user nova-compute[73497]: INFO nova.compute.claims [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Claim successful on node user
Aug 27 00:01:43 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:01:43 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:01:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.225s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:01:44 user nova-compute[73497]: DEBUG nova.compute.manager [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 00:01:44 user nova-compute[73497]: DEBUG nova.compute.manager [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 00:01:44 user nova-compute[73497]: DEBUG nova.network.neutron [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 00:01:44 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 00:01:44 user nova-compute[73497]: DEBUG nova.compute.manager [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 00:01:44 user nova-compute[73497]: INFO nova.virt.block_device [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Booting with volume 887be19f-0150-4c5e-94ce-7fdba1e5e43a at /dev/vda
Aug 27 00:01:44 user nova-compute[73497]: DEBUG nova.policy [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dbd048b30716490880ff4b28758536a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3491abf5cc4e77aed2997a5ac8aeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 00:01:44 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:01:44 user nova-compute[73497]: DEBUG os_brick.utils [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:01:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:01:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:01:44 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5c285b-512e-45c2-9300-59e1fb050244]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:01:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:01:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:01:44 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[02646d07-ff82-4cf3-97c7-8e10fc6e1c09]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:01:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:01:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:01:44 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6c0e61-80b4-4166-8ab2-4fa984874fb1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:01:44 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e14f97-1b1f-44ba-8186-86d5462ba740]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:01:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:01:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:01:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 00:01:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:01:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:01:44 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 00:01:44 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab609e1f-6c45-4ffb-9af9-86ea00d49900]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:01:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 00:01:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 00:01:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 00:01:44 user nova-compute[73497]: DEBUG os_brick.utils [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:01:44 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Updating existing volume attachment record: 71cc0572-333c-4088-b595-e0f30295990f {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 00:01:44 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:01:44 user nova-compute[73497]: DEBUG nova.network.neutron [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Successfully created port: 192f9517-872b-4ba8-8f74-08381e068984 {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 00:01:45 user nova-compute[73497]: DEBUG nova.network.neutron [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Successfully updated port: 192f9517-872b-4ba8-8f74-08381e068984 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:01:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "refresh_cache-7bf1189a-363f-44f1-97b0-a8012c9b4c45" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:01:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquired lock "refresh_cache-7bf1189a-363f-44f1-97b0-a8012c9b4c45" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:01:45 user nova-compute[73497]: DEBUG nova.network.neutron [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:01:45 user nova-compute[73497]: DEBUG nova.compute.manager [req-8f5ecbb9-183c-4aed-80de-934a257c6de5 req-c986e457-16a3-4ac6-a0bf-2bfbfd76bbb3 service nova] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Received event network-changed-192f9517-872b-4ba8-8f74-08381e068984 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:01:45 user nova-compute[73497]: DEBUG nova.compute.manager [req-8f5ecbb9-183c-4aed-80de-934a257c6de5 req-c986e457-16a3-4ac6-a0bf-2bfbfd76bbb3 service nova] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Refreshing instance network info cache due to event network-changed-192f9517-872b-4ba8-8f74-08381e068984. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:01:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8f5ecbb9-183c-4aed-80de-934a257c6de5 req-c986e457-16a3-4ac6-a0bf-2bfbfd76bbb3 service nova] Acquiring lock "refresh_cache-7bf1189a-363f-44f1-97b0-a8012c9b4c45" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:01:45 user nova-compute[73497]: DEBUG nova.network.neutron [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 00:01:46 user nova-compute[73497]: DEBUG nova.network.neutron [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Updating instance_info_cache with network_info: [{"id": "192f9517-872b-4ba8-8f74-08381e068984", "address": "fa:16:3e:ea:9a:41", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap192f9517-87", "ovs_interfaceid": "192f9517-872b-4ba8-8f74-08381e068984", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:01:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Releasing lock "refresh_cache-7bf1189a-363f-44f1-97b0-a8012c9b4c45" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:01:46 user nova-compute[73497]: DEBUG nova.compute.manager [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Instance network_info: |[{"id": "192f9517-872b-4ba8-8f74-08381e068984", "address": "fa:16:3e:ea:9a:41", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap192f9517-87", "ovs_interfaceid": "192f9517-872b-4ba8-8f74-08381e068984", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 00:01:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8f5ecbb9-183c-4aed-80de-934a257c6de5 req-c986e457-16a3-4ac6-a0bf-2bfbfd76bbb3 service nova] Acquired lock "refresh_cache-7bf1189a-363f-44f1-97b0-a8012c9b4c45" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:01:46 user nova-compute[73497]: DEBUG nova.network.neutron [req-8f5ecbb9-183c-4aed-80de-934a257c6de5 req-c986e457-16a3-4ac6-a0bf-2bfbfd76bbb3 service nova] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Refreshing network info cache for port 192f9517-872b-4ba8-8f74-08381e068984 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:01:46 user nova-compute[73497]: DEBUG nova.network.neutron [req-8f5ecbb9-183c-4aed-80de-934a257c6de5 req-c986e457-16a3-4ac6-a0bf-2bfbfd76bbb3 service nova] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Updated VIF entry in instance network info cache for port 192f9517-872b-4ba8-8f74-08381e068984. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:01:46 user nova-compute[73497]: DEBUG nova.network.neutron [req-8f5ecbb9-183c-4aed-80de-934a257c6de5 req-c986e457-16a3-4ac6-a0bf-2bfbfd76bbb3 service nova] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Updating instance_info_cache with network_info: [{"id": "192f9517-872b-4ba8-8f74-08381e068984", "address": "fa:16:3e:ea:9a:41", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap192f9517-87", "ovs_interfaceid": "192f9517-872b-4ba8-8f74-08381e068984", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:01:46 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8f5ecbb9-183c-4aed-80de-934a257c6de5 req-c986e457-16a3-4ac6-a0bf-2bfbfd76bbb3 service nova] Releasing lock "refresh_cache-7bf1189a-363f-44f1-97b0-a8012c9b4c45" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:01:48 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:01:48 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 00:01:48 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Rebuilding the list of instances to heal {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 00:01:48 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Skipping network cache update for instance because it is Building. {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 27 00:01:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-726bb85b-391e-4041-972f-f35062c9409b" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:01:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-726bb85b-391e-4041-972f-f35062c9409b" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:01:48 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 00:01:48 user nova-compute[73497]: DEBUG nova.objects.instance [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lazy-loading 'info_cache' on Instance uuid 726bb85b-391e-4041-972f-f35062c9409b {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:01:48 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Updating instance_info_cache with network_info: [{"id": "52f7945c-939e-40d4-ac84-3827a07a9478", "address": "fa:16:3e:f5:15:a1", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52f7945c-93", "ovs_interfaceid": "52f7945c-939e-40d4-ac84-3827a07a9478", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:01:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-726bb85b-391e-4041-972f-f35062c9409b" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:01:48 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 00:01:49 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:01:54 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG nova.compute.manager [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 00:01:55 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Creating image(s)
Aug 27 00:01:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Did not create local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Ensure instance console log exists: /opt/stack/data/nova/instances/7bf1189a-363f-44f1-97b0-a8012c9b4c45/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Start _get_guest_xml network_info=[{"id": "192f9517-872b-4ba8-8f74-08381e068984", "address": "fa:16:3e:ea:9a:41", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap192f9517-87", "ovs_interfaceid": "192f9517-872b-4ba8-8f74-08381e068984", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '71cc0572-333c-4088-b595-e0f30295990f', 'guest_format': None, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nCKDRrlP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7bf1189a-363f-44f1-97b0-a8012c9b4c45', 'attached_at': '', 'detached_at': '', 'volume_id': '887be19f-0150-4c5e-94ce-7fdba1e5e43a', 'serial': '887be19f-0150-4c5e-94ce-7fdba1e5e43a'}, 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 00:01:55 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:01:55 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:01:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nCKDRrlP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:01:55 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:01:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:01:55 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:01:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:01:55 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 00:01:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[189836c6-c573-4b86-a35e-cd600de7167a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 00:01:55 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae74359-6420-4710-9c69-d472b9ceaf72]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a] added
Aug 27 00:01:55 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c52b9c-bbcd-478b-bee4-2fc1acb6f3ee]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a16c69-3d5a-4151-b8cf-5445905a9055]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nCKDRrlP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nCKDRrlP" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c2084b-bb2c-4757-9635-4dc333c64ff1]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nCKDRrlP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[febddc3b-bc17-47a6-b655-7493bb0b25cd]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da22d78-4a2e-43a1-b545-406e3e30feb1]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 (non-flash)
Aug 27 00:01:55 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 (non-flash)
Aug 27 00:01:55 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[07db6b6f-3f2e-4656-bcae-52bd40ed87ef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a, portal: 172.16.0.220,3260]
Aug 27 00:01:55 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a, portal: 172.16.0.220,3260] successful.
Aug 27 00:01:55 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b573ce-fdf1-47ba-a894-470d52b141c2]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[09dedae9-d0b7-4a57-ace2-d3af2d035b25]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 (non-flash)
Aug 27 00:01:55 user nova-compute[73497]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a (non-flash)
Aug 27 00:01:55 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 (non-flash)
Aug 27 00:01:55 user nova-compute[73497]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a (non-flash)
Aug 27 00:01:55 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] HCTL ('34', '-', '-', 0) found on session 63 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7feee712-e495-4bf2-bb86-57c0c8f957d9]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:01:55 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: None {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:01:56 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:01:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nCKDRrlP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 00:01:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:01:56 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23263366663643036', 'path': '/dev/sdc'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:01:56 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263366663643036', 'path': '/dev/sdc'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 00:01:56 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:01:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1549127304',display_name='tempest-TestVolumeBootPattern-server-1549127304',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1549127304',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQ+N0pTaMhOCJarM3h1l7r/nXRl69icaKHUqFxozzTcIDFOjdkD/FQAV7dJ0BDWuRi4QUFih+uNp9B/6RxXoehOjwmxPJ6FmE8rwSmjVjNzJ4gi1FUwzweH3kRlzkgH2Q==',key_name='tempest-TestVolumeBootPattern-760141052',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba3491abf5cc4e77aed2997a5ac8aeee',ramdisk_id='',reservation_id='r-stmvkiqt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-377601332',owner_user_name='tempest-TestVolumeBootPattern-377601332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:01:44Z,user_data=None,user_id='dbd048b30716490880ff4b28758536a5',uuid=7bf1189a-363f-44f1-97b0-a8012c9b4c45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "192f9517-872b-4ba8-8f74-08381e068984", "address": "fa:16:3e:ea:9a:41", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap192f9517-87", "ovs_interfaceid": "192f9517-872b-4ba8-8f74-08381e068984", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:01:56 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Converting VIF {"id": "192f9517-872b-4ba8-8f74-08381e068984", "address": "fa:16:3e:ea:9a:41", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap192f9517-87", "ovs_interfaceid": "192f9517-872b-4ba8-8f74-08381e068984", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:01:56 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:9a:41,bridge_name='br-int',has_traffic_filtering=True,id=192f9517-872b-4ba8-8f74-08381e068984,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap192f9517-87') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:01:56 user nova-compute[73497]: DEBUG nova.objects.instance [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lazy-loading 'pci_devices' on Instance uuid 7bf1189a-363f-44f1-97b0-a8012c9b4c45 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:01:56 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] End _get_guest_xml xml=<domain type="kvm">
Aug 27 00:01:56 user nova-compute[73497]:   <uuid>7bf1189a-363f-44f1-97b0-a8012c9b4c45</uuid>
Aug 27 00:01:56 user nova-compute[73497]:   <name>instance-00000034</name>
Aug 27 00:01:56 user nova-compute[73497]:   <memory>524288</memory>
Aug 27 00:01:56 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 27 00:01:56 user nova-compute[73497]:   <metadata>
Aug 27 00:01:56 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:01:56 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 27 00:01:56 user nova-compute[73497]:       <nova:name>tempest-TestVolumeBootPattern-server-1549127304</nova:name>
Aug 27 00:01:56 user nova-compute[73497]:       <nova:creationTime>2023-08-27 00:01:55</nova:creationTime>
Aug 27 00:01:56 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 27 00:01:56 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 27 00:01:56 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 27 00:01:56 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 27 00:01:56 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:01:56 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 27 00:01:56 user nova-compute[73497]:       </nova:flavor>
Aug 27 00:01:56 user nova-compute[73497]:       <nova:owner>
Aug 27 00:01:56 user nova-compute[73497]:         <nova:user uuid="dbd048b30716490880ff4b28758536a5">tempest-TestVolumeBootPattern-377601332-project-member</nova:user>
Aug 27 00:01:56 user nova-compute[73497]:         <nova:project uuid="ba3491abf5cc4e77aed2997a5ac8aeee">tempest-TestVolumeBootPattern-377601332</nova:project>
Aug 27 00:01:56 user nova-compute[73497]:       </nova:owner>
Aug 27 00:01:56 user nova-compute[73497]:       <nova:ports>
Aug 27 00:01:56 user nova-compute[73497]:         <nova:port uuid="192f9517-872b-4ba8-8f74-08381e068984">
Aug 27 00:01:56 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 27 00:01:56 user nova-compute[73497]:         </nova:port>
Aug 27 00:01:56 user nova-compute[73497]:       </nova:ports>
Aug 27 00:01:56 user nova-compute[73497]:     </nova:instance>
Aug 27 00:01:56 user nova-compute[73497]:   </metadata>
Aug 27 00:01:56 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 27 00:01:56 user nova-compute[73497]:     <system>
Aug 27 00:01:56 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 00:01:56 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 27 00:01:56 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 27 00:01:56 user nova-compute[73497]:       <entry name="serial">7bf1189a-363f-44f1-97b0-a8012c9b4c45</entry>
Aug 27 00:01:56 user nova-compute[73497]:       <entry name="uuid">7bf1189a-363f-44f1-97b0-a8012c9b4c45</entry>
Aug 27 00:01:56 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 27 00:01:56 user nova-compute[73497]:     </system>
Aug 27 00:01:56 user nova-compute[73497]:   </sysinfo>
Aug 27 00:01:56 user nova-compute[73497]:   <os>
Aug 27 00:01:56 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 00:01:56 user nova-compute[73497]:     <boot dev="hd"/>
Aug 27 00:01:56 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 27 00:01:56 user nova-compute[73497]:   </os>
Aug 27 00:01:56 user nova-compute[73497]:   <features>
Aug 27 00:01:56 user nova-compute[73497]:     <acpi/>
Aug 27 00:01:56 user nova-compute[73497]:     <apic/>
Aug 27 00:01:56 user nova-compute[73497]:     <vmcoreinfo/>
Aug 27 00:01:56 user nova-compute[73497]:   </features>
Aug 27 00:01:56 user nova-compute[73497]:   <clock offset="utc">
Aug 27 00:01:56 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 00:01:56 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 00:01:56 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 27 00:01:56 user nova-compute[73497]:   </clock>
Aug 27 00:01:56 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 27 00:01:56 user nova-compute[73497]:     <model>Nehalem</model>
Aug 27 00:01:56 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 00:01:56 user nova-compute[73497]:   </cpu>
Aug 27 00:01:56 user nova-compute[73497]:   <devices>
Aug 27 00:01:56 user nova-compute[73497]:     <disk type="block" device="disk">
Aug 27 00:01:56 user nova-compute[73497]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:01:56 user nova-compute[73497]:       <source dev="/dev/sdc"/>
Aug 27 00:01:56 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 27 00:01:56 user nova-compute[73497]:       <serial>887be19f-0150-4c5e-94ce-7fdba1e5e43a</serial>
Aug 27 00:01:56 user nova-compute[73497]:     </disk>
Aug 27 00:01:56 user nova-compute[73497]:     <interface type="ethernet">
Aug 27 00:01:56 user nova-compute[73497]:       <mac address="fa:16:3e:ea:9a:41"/>
Aug 27 00:01:56 user nova-compute[73497]:       <model type="virtio"/>
Aug 27 00:01:56 user nova-compute[73497]:       <mtu size="1442"/>
Aug 27 00:01:56 user nova-compute[73497]:       <target dev="tap192f9517-87"/>
Aug 27 00:01:56 user nova-compute[73497]:     </interface>
Aug 27 00:01:56 user nova-compute[73497]:     <serial type="pty">
Aug 27 00:01:56 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/7bf1189a-363f-44f1-97b0-a8012c9b4c45/console.log" append="off"/>
Aug 27 00:01:56 user nova-compute[73497]:     </serial>
Aug 27 00:01:56 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 00:01:56 user nova-compute[73497]:     <video>
Aug 27 00:01:56 user nova-compute[73497]:       <model type="virtio"/>
Aug 27 00:01:56 user nova-compute[73497]:     </video>
Aug 27 00:01:56 user nova-compute[73497]:     <rng model="virtio">
Aug 27 00:01:56 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 27 00:01:56 user nova-compute[73497]:     </rng>
Aug 27 00:01:56 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 27 00:01:56 user nova-compute[73497]:     <memballoon model="virtio">
Aug 27 00:01:56 user nova-compute[73497]:       <stats period="10"/>
Aug 27 00:01:56 user nova-compute[73497]:     </memballoon>
Aug 27 00:01:56 user nova-compute[73497]:   </devices>
Aug 27 00:01:56 user nova-compute[73497]: </domain>
Aug 27 00:01:56 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 00:01:56 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:01:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1549127304',display_name='tempest-TestVolumeBootPattern-server-1549127304',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1549127304',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQ+N0pTaMhOCJarM3h1l7r/nXRl69icaKHUqFxozzTcIDFOjdkD/FQAV7dJ0BDWuRi4QUFih+uNp9B/6RxXoehOjwmxPJ6FmE8rwSmjVjNzJ4gi1FUwzweH3kRlzkgH2Q==',key_name='tempest-TestVolumeBootPattern-760141052',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba3491abf5cc4e77aed2997a5ac8aeee',ramdisk_id='',reservation_id='r-stmvkiqt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-377601332',owner_user_name='tempest-TestVolumeBootPattern-377601332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:01:44Z,user_data=None,user_id='dbd048b30716490880ff4b28758536a5',uuid=7bf1189a-363f-44f1-97b0-a8012c9b4c45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "192f9517-872b-4ba8-8f74-08381e068984", "address": "fa:16:3e:ea:9a:41", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap192f9517-87", "ovs_interfaceid": "192f9517-872b-4ba8-8f74-08381e068984", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:01:56 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Converting VIF {"id": "192f9517-872b-4ba8-8f74-08381e068984", "address": "fa:16:3e:ea:9a:41", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap192f9517-87", "ovs_interfaceid": "192f9517-872b-4ba8-8f74-08381e068984", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:01:56 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:9a:41,bridge_name='br-int',has_traffic_filtering=True,id=192f9517-872b-4ba8-8f74-08381e068984,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap192f9517-87') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:01:56 user nova-compute[73497]: DEBUG os_vif [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:9a:41,bridge_name='br-int',has_traffic_filtering=True,id=192f9517-872b-4ba8-8f74-08381e068984,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap192f9517-87') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:01:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:01:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:01:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:01:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:01:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap192f9517-87, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:01:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap192f9517-87, col_values=(('external_ids', {'iface-id': '192f9517-872b-4ba8-8f74-08381e068984', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:9a:41', 'vm-uuid': '7bf1189a-363f-44f1-97b0-a8012c9b4c45'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:01:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:01:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:01:56 user nova-compute[73497]: INFO os_vif [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:9a:41,bridge_name='br-int',has_traffic_filtering=True,id=192f9517-872b-4ba8-8f74-08381e068984,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap192f9517-87')
Aug 27 00:01:56 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:01:56 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] No VIF found with MAC fa:16:3e:ea:9a:41, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:01:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:01:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:01:58 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:01:58 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:01:58 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:01:58 user nova-compute[73497]: DEBUG nova.compute.manager [req-39e3ecf8-6011-4c30-a903-20895542f4f2 req-fb985ad1-92fb-437a-af79-2af4ed2a213e service nova] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Received event network-vif-plugged-192f9517-872b-4ba8-8f74-08381e068984 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:01:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-39e3ecf8-6011-4c30-a903-20895542f4f2 req-fb985ad1-92fb-437a-af79-2af4ed2a213e service nova] Acquiring lock "7bf1189a-363f-44f1-97b0-a8012c9b4c45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:01:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-39e3ecf8-6011-4c30-a903-20895542f4f2 req-fb985ad1-92fb-437a-af79-2af4ed2a213e service nova] Lock "7bf1189a-363f-44f1-97b0-a8012c9b4c45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:01:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-39e3ecf8-6011-4c30-a903-20895542f4f2 req-fb985ad1-92fb-437a-af79-2af4ed2a213e service nova] Lock "7bf1189a-363f-44f1-97b0-a8012c9b4c45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:01:58 user nova-compute[73497]: DEBUG nova.compute.manager [req-39e3ecf8-6011-4c30-a903-20895542f4f2 req-fb985ad1-92fb-437a-af79-2af4ed2a213e service nova] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] No waiting events found dispatching network-vif-plugged-192f9517-872b-4ba8-8f74-08381e068984 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:01:58 user nova-compute[73497]: WARNING nova.compute.manager [req-39e3ecf8-6011-4c30-a903-20895542f4f2 req-fb985ad1-92fb-437a-af79-2af4ed2a213e service nova] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Received unexpected event network-vif-plugged-192f9517-872b-4ba8-8f74-08381e068984 for instance with vm_state building and task_state spawning.
Aug 27 00:02:00 user nova-compute[73497]: DEBUG nova.compute.manager [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 00:02:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 00:02:00 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693094520.0492415, 7bf1189a-363f-44f1-97b0-a8012c9b4c45 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:02:00 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] VM Resumed (Lifecycle Event)
Aug 27 00:02:00 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Instance spawned successfully.
Aug 27 00:02:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 00:02:00 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:02:00 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:02:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:02:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:02:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:02:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:02:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:02:00 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:02:00 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:02:00 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693094520.0495713, 7bf1189a-363f-44f1-97b0-a8012c9b4c45 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:02:00 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] VM Started (Lifecycle Event)
Aug 27 00:02:00 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:02:00 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:02:00 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:02:00 user nova-compute[73497]: INFO nova.compute.manager [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Took 4.94 seconds to spawn the instance on the hypervisor.
Aug 27 00:02:00 user nova-compute[73497]: DEBUG nova.compute.manager [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:02:00 user nova-compute[73497]: INFO nova.compute.manager [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Took 16.47 seconds to build instance.
Aug 27 00:02:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-a7ddbb04-7f6f-4745-9f4d-eaf7c28f72eb tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "7bf1189a-363f-44f1-97b0-a8012c9b4c45" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.569s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:02:00 user nova-compute[73497]: DEBUG nova.compute.manager [req-f73d119e-5837-4b0d-b18b-8178b650e410 req-c6a26c67-5c3c-4c64-9a27-3de67d778d42 service nova] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Received event network-vif-plugged-192f9517-872b-4ba8-8f74-08381e068984 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:02:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f73d119e-5837-4b0d-b18b-8178b650e410 req-c6a26c67-5c3c-4c64-9a27-3de67d778d42 service nova] Acquiring lock "7bf1189a-363f-44f1-97b0-a8012c9b4c45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:02:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f73d119e-5837-4b0d-b18b-8178b650e410 req-c6a26c67-5c3c-4c64-9a27-3de67d778d42 service nova] Lock "7bf1189a-363f-44f1-97b0-a8012c9b4c45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:02:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f73d119e-5837-4b0d-b18b-8178b650e410 req-c6a26c67-5c3c-4c64-9a27-3de67d778d42 service nova] Lock "7bf1189a-363f-44f1-97b0-a8012c9b4c45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:02:00 user nova-compute[73497]: DEBUG nova.compute.manager [req-f73d119e-5837-4b0d-b18b-8178b650e410 req-c6a26c67-5c3c-4c64-9a27-3de67d778d42 service nova] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] No waiting events found dispatching network-vif-plugged-192f9517-872b-4ba8-8f74-08381e068984 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:02:00 user nova-compute[73497]: WARNING nova.compute.manager [req-f73d119e-5837-4b0d-b18b-8178b650e410 req-c6a26c67-5c3c-4c64-9a27-3de67d778d42 service nova] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Received unexpected event network-vif-plugged-192f9517-872b-4ba8-8f74-08381e068984 for instance with vm_state active and task_state None.
Aug 27 00:02:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:02:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:02:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:02:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:02:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:02:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:02:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:02:23 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:02:25 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:02:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:02:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:02:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:02:25 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 00:02:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:02:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:02:25 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:02:25 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:02:25 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8678MB free_disk=25.050701141357422GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 00:02:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:02:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:02:25 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 726bb85b-391e-4041-972f-f35062c9409b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:02:25 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 7bf1189a-363f-44f1-97b0-a8012c9b4c45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:02:25 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 00:02:25 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 00:02:25 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:02:25 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:02:25 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 00:02:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:02:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:02:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:02:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:02:33 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:02:33 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:02:34 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:02:34 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 00:02:35 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:02:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:02:37 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:02:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:02:41 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:02:41 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:02:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:02:46 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:02:46 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:02:48 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:02:48 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 00:02:48 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Rebuilding the list of instances to heal {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 00:02:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-726bb85b-391e-4041-972f-f35062c9409b" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:02:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-726bb85b-391e-4041-972f-f35062c9409b" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:02:48 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 00:02:48 user nova-compute[73497]: DEBUG nova.objects.instance [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lazy-loading 'info_cache' on Instance uuid 726bb85b-391e-4041-972f-f35062c9409b {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:02:48 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Updating instance_info_cache with network_info: [{"id": "52f7945c-939e-40d4-ac84-3827a07a9478", "address": "fa:16:3e:f5:15:a1", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52f7945c-93", "ovs_interfaceid": "52f7945c-939e-40d4-ac84-3827a07a9478", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:02:48 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-726bb85b-391e-4041-972f-f35062c9409b" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:02:48 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 00:02:51 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:02:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:02:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:02:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 00:02:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:02:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:02:56 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:03:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:03:06 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:03:11 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:03:16 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:03:21 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:03:26 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:03:27 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:03:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:03:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:03:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:03:27 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 00:03:27 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:03:27 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:03:27 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:03:27 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:03:27 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8727MB free_disk=25.05008316040039GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 00:03:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:03:27 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:03:28 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 726bb85b-391e-4041-972f-f35062c9409b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:03:28 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 7bf1189a-363f-44f1-97b0-a8012c9b4c45 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:03:28 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 00:03:28 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 00:03:28 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:03:28 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:03:28 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 00:03:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.538s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:03:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:03:34 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:03:34 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:03:34 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:03:35 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:03:35 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 00:03:35 user nova-compute[73497]: DEBUG nova.compute.manager [req-6220ac5f-b199-44ae-8c1f-5e2453b64511 req-496a6301-9f98-447d-b060-d098152d17eb service nova] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Received event network-changed-192f9517-872b-4ba8-8f74-08381e068984 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:03:35 user nova-compute[73497]: DEBUG nova.compute.manager [req-6220ac5f-b199-44ae-8c1f-5e2453b64511 req-496a6301-9f98-447d-b060-d098152d17eb service nova] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Refreshing instance network info cache due to event network-changed-192f9517-872b-4ba8-8f74-08381e068984. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:03:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6220ac5f-b199-44ae-8c1f-5e2453b64511 req-496a6301-9f98-447d-b060-d098152d17eb service nova] Acquiring lock "refresh_cache-7bf1189a-363f-44f1-97b0-a8012c9b4c45" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:03:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6220ac5f-b199-44ae-8c1f-5e2453b64511 req-496a6301-9f98-447d-b060-d098152d17eb service nova] Acquired lock "refresh_cache-7bf1189a-363f-44f1-97b0-a8012c9b4c45" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:03:35 user nova-compute[73497]: DEBUG nova.network.neutron [req-6220ac5f-b199-44ae-8c1f-5e2453b64511 req-496a6301-9f98-447d-b060-d098152d17eb service nova] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Refreshing network info cache for port 192f9517-872b-4ba8-8f74-08381e068984 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:03:36 user nova-compute[73497]: DEBUG nova.network.neutron [req-6220ac5f-b199-44ae-8c1f-5e2453b64511 req-496a6301-9f98-447d-b060-d098152d17eb service nova] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Updated VIF entry in instance network info cache for port 192f9517-872b-4ba8-8f74-08381e068984. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:03:36 user nova-compute[73497]: DEBUG nova.network.neutron [req-6220ac5f-b199-44ae-8c1f-5e2453b64511 req-496a6301-9f98-447d-b060-d098152d17eb service nova] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Updating instance_info_cache with network_info: [{"id": "192f9517-872b-4ba8-8f74-08381e068984", "address": "fa:16:3e:ea:9a:41", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap192f9517-87", "ovs_interfaceid": "192f9517-872b-4ba8-8f74-08381e068984", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:03:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6220ac5f-b199-44ae-8c1f-5e2453b64511 req-496a6301-9f98-447d-b060-d098152d17eb service nova] Releasing lock "refresh_cache-7bf1189a-363f-44f1-97b0-a8012c9b4c45" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:03:36 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:03:37 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:03:37 user nova-compute[73497]: DEBUG nova.compute.manager [req-21b8e41c-4de8-4c51-87ba-d7dfda888ec1 req-36829aea-ad14-4103-aed5-d6dc6be2970b service nova] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Received event network-changed-192f9517-872b-4ba8-8f74-08381e068984 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:03:37 user nova-compute[73497]: DEBUG nova.compute.manager [req-21b8e41c-4de8-4c51-87ba-d7dfda888ec1 req-36829aea-ad14-4103-aed5-d6dc6be2970b service nova] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Refreshing instance network info cache due to event network-changed-192f9517-872b-4ba8-8f74-08381e068984. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:03:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-21b8e41c-4de8-4c51-87ba-d7dfda888ec1 req-36829aea-ad14-4103-aed5-d6dc6be2970b service nova] Acquiring lock "refresh_cache-7bf1189a-363f-44f1-97b0-a8012c9b4c45" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:03:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-21b8e41c-4de8-4c51-87ba-d7dfda888ec1 req-36829aea-ad14-4103-aed5-d6dc6be2970b service nova] Acquired lock "refresh_cache-7bf1189a-363f-44f1-97b0-a8012c9b4c45" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:03:37 user nova-compute[73497]: DEBUG nova.network.neutron [req-21b8e41c-4de8-4c51-87ba-d7dfda888ec1 req-36829aea-ad14-4103-aed5-d6dc6be2970b service nova] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Refreshing network info cache for port 192f9517-872b-4ba8-8f74-08381e068984 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:03:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "7bf1189a-363f-44f1-97b0-a8012c9b4c45" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:03:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "7bf1189a-363f-44f1-97b0-a8012c9b4c45" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:03:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "7bf1189a-363f-44f1-97b0-a8012c9b4c45-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:03:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "7bf1189a-363f-44f1-97b0-a8012c9b4c45-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:03:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "7bf1189a-363f-44f1-97b0-a8012c9b4c45-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:03:37 user nova-compute[73497]: INFO nova.compute.manager [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Terminating instance
Aug 27 00:03:37 user nova-compute[73497]: DEBUG nova.compute.manager [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 00:03:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:03:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG nova.compute.manager [req-8b650992-6901-4e8c-b49d-e8108d0151f1 req-c5976677-4ab2-4666-8676-cdcf047d8cda service nova] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Received event network-vif-unplugged-192f9517-872b-4ba8-8f74-08381e068984 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8b650992-6901-4e8c-b49d-e8108d0151f1 req-c5976677-4ab2-4666-8676-cdcf047d8cda service nova] Acquiring lock "7bf1189a-363f-44f1-97b0-a8012c9b4c45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8b650992-6901-4e8c-b49d-e8108d0151f1 req-c5976677-4ab2-4666-8676-cdcf047d8cda service nova] Lock "7bf1189a-363f-44f1-97b0-a8012c9b4c45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-8b650992-6901-4e8c-b49d-e8108d0151f1 req-c5976677-4ab2-4666-8676-cdcf047d8cda service nova] Lock "7bf1189a-363f-44f1-97b0-a8012c9b4c45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG nova.compute.manager [req-8b650992-6901-4e8c-b49d-e8108d0151f1 req-c5976677-4ab2-4666-8676-cdcf047d8cda service nova] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] No waiting events found dispatching network-vif-unplugged-192f9517-872b-4ba8-8f74-08381e068984 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG nova.compute.manager [req-8b650992-6901-4e8c-b49d-e8108d0151f1 req-c5976677-4ab2-4666-8676-cdcf047d8cda service nova] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Received event network-vif-unplugged-192f9517-872b-4ba8-8f74-08381e068984 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG nova.network.neutron [req-21b8e41c-4de8-4c51-87ba-d7dfda888ec1 req-36829aea-ad14-4103-aed5-d6dc6be2970b service nova] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Updated VIF entry in instance network info cache for port 192f9517-872b-4ba8-8f74-08381e068984. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG nova.network.neutron [req-21b8e41c-4de8-4c51-87ba-d7dfda888ec1 req-36829aea-ad14-4103-aed5-d6dc6be2970b service nova] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Updating instance_info_cache with network_info: [{"id": "192f9517-872b-4ba8-8f74-08381e068984", "address": "fa:16:3e:ea:9a:41", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap192f9517-87", "ovs_interfaceid": "192f9517-872b-4ba8-8f74-08381e068984", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-21b8e41c-4de8-4c51-87ba-d7dfda888ec1 req-36829aea-ad14-4103-aed5-d6dc6be2970b service nova] Releasing lock "refresh_cache-7bf1189a-363f-44f1-97b0-a8012c9b4c45" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:03:38 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Instance destroyed successfully.
Aug 27 00:03:38 user nova-compute[73497]: DEBUG nova.objects.instance [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lazy-loading 'resources' on Instance uuid 7bf1189a-363f-44f1-97b0-a8012c9b4c45 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:01:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1549127304',display_name='tempest-TestVolumeBootPattern-server-1549127304',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1549127304',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQ+N0pTaMhOCJarM3h1l7r/nXRl69icaKHUqFxozzTcIDFOjdkD/FQAV7dJ0BDWuRi4QUFih+uNp9B/6RxXoehOjwmxPJ6FmE8rwSmjVjNzJ4gi1FUwzweH3kRlzkgH2Q==',key_name='tempest-TestVolumeBootPattern-760141052',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:02:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba3491abf5cc4e77aed2997a5ac8aeee',ramdisk_id='',reservation_id='r-stmvkiqt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-377601332',owner_user_name='tempest-TestVolumeBootPattern-377601332-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:02:00Z,user_data=None,user_id='dbd048b30716490880ff4b28758536a5',uuid=7bf1189a-363f-44f1-97b0-a8012c9b4c45,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "192f9517-872b-4ba8-8f74-08381e068984", "address": "fa:16:3e:ea:9a:41", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap192f9517-87", "ovs_interfaceid": "192f9517-872b-4ba8-8f74-08381e068984", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Converting VIF {"id": "192f9517-872b-4ba8-8f74-08381e068984", "address": "fa:16:3e:ea:9a:41", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap192f9517-87", "ovs_interfaceid": "192f9517-872b-4ba8-8f74-08381e068984", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:9a:41,bridge_name='br-int',has_traffic_filtering=True,id=192f9517-872b-4ba8-8f74-08381e068984,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap192f9517-87') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG os_vif [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:9a:41,bridge_name='br-int',has_traffic_filtering=True,id=192f9517-872b-4ba8-8f74-08381e068984,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap192f9517-87') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap192f9517-87, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:03:38 user nova-compute[73497]: INFO os_vif [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:9a:41,bridge_name='br-int',has_traffic_filtering=True,id=192f9517-872b-4ba8-8f74-08381e068984,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap192f9517-87')
Aug 27 00:03:38 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nCKDRrlP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:03:38 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:03:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[60962176-714e-45df-9f0e-51e653c9a9c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9659be-dc6e-4ece-8756-bfe78c069595]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 (non-flash)
Aug 27 00:03:38 user nova-compute[73497]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a (non-flash)
Aug 27 00:03:38 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 (non-flash)
Aug 27 00:03:38 user nova-compute[73497]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a (non-flash)
Aug 27 00:03:38 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282c516680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a'): ({'sdc'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Removing single pathed devices sdc {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab6b9dd-80d1-46d7-b03a-9e2b0cfc6a64]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec88473-7a51-43ef-a50d-330a88c8af88]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Flushing IO for device /dev/sdc {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf3e637-f3d5-43e8-81cb-e19d63f87b8c]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[df973433-61de-4803-ae38-26305bd5323e]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] SCSI volumes sdc have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_ec4b634a', '/dev/disk/by-id/scsi-1SCST_BIOec4b634a-2c6fcd062ccb471a', '/dev/disk/by-id/scsi-23263366663643036') {{(pid=84617) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7c0ef4-8ac0-4835-ad4d-4daabfee31b9]: (4, None) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d2c572-cbf9-406f-beee-da322b5450cc]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbab2dc-83b6-4bf1-aeee-abaee2c92df8]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a, portal: 172.16.0.220,3260]
Aug 27 00:03:38 user nova-compute[73497]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a, portal: 172.16.0.220,3260] successful.
Aug 27 00:03:38 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887be19f-0150-4c5e-94ce-7fdba1e5e43a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[067ed6a0-a959-4cd5-93f2-b8bcd7311969]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] <== disconnect_volume: return (274ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 00:03:38 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Deleting instance files /opt/stack/data/nova/instances/7bf1189a-363f-44f1-97b0-a8012c9b4c45_del
Aug 27 00:03:38 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Deletion of /opt/stack/data/nova/instances/7bf1189a-363f-44f1-97b0-a8012c9b4c45_del complete
Aug 27 00:03:38 user nova-compute[73497]: INFO nova.compute.manager [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 27 00:03:38 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 00:03:38 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 00:03:39 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:03:39 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Took 0.50 seconds to deallocate network for instance.
Aug 27 00:03:40 user nova-compute[73497]: DEBUG nova.compute.manager [req-275a31b1-92d5-4a3f-9d6f-e24719f5516b req-39c9e016-dfdd-46c6-ba3d-aa248ed55025 service nova] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Received event network-vif-plugged-192f9517-872b-4ba8-8f74-08381e068984 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:03:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-275a31b1-92d5-4a3f-9d6f-e24719f5516b req-39c9e016-dfdd-46c6-ba3d-aa248ed55025 service nova] Acquiring lock "7bf1189a-363f-44f1-97b0-a8012c9b4c45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:03:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-275a31b1-92d5-4a3f-9d6f-e24719f5516b req-39c9e016-dfdd-46c6-ba3d-aa248ed55025 service nova] Lock "7bf1189a-363f-44f1-97b0-a8012c9b4c45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:03:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-275a31b1-92d5-4a3f-9d6f-e24719f5516b req-39c9e016-dfdd-46c6-ba3d-aa248ed55025 service nova] Lock "7bf1189a-363f-44f1-97b0-a8012c9b4c45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:03:40 user nova-compute[73497]: DEBUG nova.compute.manager [req-275a31b1-92d5-4a3f-9d6f-e24719f5516b req-39c9e016-dfdd-46c6-ba3d-aa248ed55025 service nova] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] No waiting events found dispatching network-vif-plugged-192f9517-872b-4ba8-8f74-08381e068984 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:03:40 user nova-compute[73497]: WARNING nova.compute.manager [req-275a31b1-92d5-4a3f-9d6f-e24719f5516b req-39c9e016-dfdd-46c6-ba3d-aa248ed55025 service nova] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Received unexpected event network-vif-plugged-192f9517-872b-4ba8-8f74-08381e068984 for instance with vm_state active and task_state deleting.
Aug 27 00:03:40 user nova-compute[73497]: DEBUG nova.compute.manager [req-275a31b1-92d5-4a3f-9d6f-e24719f5516b req-39c9e016-dfdd-46c6-ba3d-aa248ed55025 service nova] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Received event network-vif-deleted-192f9517-872b-4ba8-8f74-08381e068984 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:03:40 user nova-compute[73497]: INFO nova.compute.manager [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Took 0.84 seconds to detach 1 volumes for instance.
Aug 27 00:03:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:03:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:03:40 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:03:40 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:03:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.131s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:03:40 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Deleted allocations for instance 7bf1189a-363f-44f1-97b0-a8012c9b4c45
Aug 27 00:03:40 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-533c711d-4ee1-4aa0-ad26-1f58c1666afd tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "7bf1189a-363f-44f1-97b0-a8012c9b4c45" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.912s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:03:42 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:03:43 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:03:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:03:48 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:03:48 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:03:49 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:03:49 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 00:03:49 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Didn't find any instances for network info cache update. {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 00:03:53 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693094618.431274, 7bf1189a-363f-44f1-97b0-a8012c9b4c45 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:03:53 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] VM Stopped (Lifecycle Event)
Aug 27 00:03:53 user nova-compute[73497]: DEBUG nova.compute.manager [None req-7d050c6a-814f-4e3a-8c40-23e76b32919e None None] [instance: 7bf1189a-363f-44f1-97b0-a8012c9b4c45] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:03:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:03:58 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:04:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:04:08 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:04:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:04:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:04:23 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:04:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:04:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:04:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 00:04:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:04:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:04:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:04:29 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:04:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:04:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:04:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:04:29 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 00:04:29 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:04:29 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:04:29 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:04:29 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8776MB free_disk=25.049129486083984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 00:04:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:04:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:04:29 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance 726bb85b-391e-4041-972f-f35062c9409b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:04:29 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 00:04:29 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 00:04:29 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:04:29 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:04:29 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 00:04:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.310s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:04:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:04:33 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:04:34 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:04:35 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:04:35 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 00:04:38 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:04:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:04:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:04:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 00:04:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:04:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:04:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:04:39 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:04:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:04:42 user nova-compute[73497]: DEBUG nova.compute.manager [req-12b72e03-e9b0-48bb-9165-315a6d9a8e10 req-96d15c97-4b67-4dbb-99b7-ee798e54c545 service nova] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Received event network-changed-52f7945c-939e-40d4-ac84-3827a07a9478 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:04:42 user nova-compute[73497]: DEBUG nova.compute.manager [req-12b72e03-e9b0-48bb-9165-315a6d9a8e10 req-96d15c97-4b67-4dbb-99b7-ee798e54c545 service nova] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Refreshing instance network info cache due to event network-changed-52f7945c-939e-40d4-ac84-3827a07a9478. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:04:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-12b72e03-e9b0-48bb-9165-315a6d9a8e10 req-96d15c97-4b67-4dbb-99b7-ee798e54c545 service nova] Acquiring lock "refresh_cache-726bb85b-391e-4041-972f-f35062c9409b" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:04:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-12b72e03-e9b0-48bb-9165-315a6d9a8e10 req-96d15c97-4b67-4dbb-99b7-ee798e54c545 service nova] Acquired lock "refresh_cache-726bb85b-391e-4041-972f-f35062c9409b" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:04:42 user nova-compute[73497]: DEBUG nova.network.neutron [req-12b72e03-e9b0-48bb-9165-315a6d9a8e10 req-96d15c97-4b67-4dbb-99b7-ee798e54c545 service nova] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Refreshing network info cache for port 52f7945c-939e-40d4-ac84-3827a07a9478 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:04:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "726bb85b-391e-4041-972f-f35062c9409b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:04:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "726bb85b-391e-4041-972f-f35062c9409b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:04:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "726bb85b-391e-4041-972f-f35062c9409b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:04:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "726bb85b-391e-4041-972f-f35062c9409b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:04:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "726bb85b-391e-4041-972f-f35062c9409b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:04:42 user nova-compute[73497]: INFO nova.compute.manager [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Terminating instance
Aug 27 00:04:42 user nova-compute[73497]: DEBUG nova.compute.manager [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 00:04:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:04:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:04:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:04:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:04:42 user nova-compute[73497]: DEBUG nova.compute.manager [req-6cfd2785-bb32-4c6f-af62-3d7bb4b9d4bb req-c6bca7de-b32a-498a-8c4e-86cc55b66683 service nova] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Received event network-vif-unplugged-52f7945c-939e-40d4-ac84-3827a07a9478 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:04:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6cfd2785-bb32-4c6f-af62-3d7bb4b9d4bb req-c6bca7de-b32a-498a-8c4e-86cc55b66683 service nova] Acquiring lock "726bb85b-391e-4041-972f-f35062c9409b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:04:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6cfd2785-bb32-4c6f-af62-3d7bb4b9d4bb req-c6bca7de-b32a-498a-8c4e-86cc55b66683 service nova] Lock "726bb85b-391e-4041-972f-f35062c9409b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:04:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6cfd2785-bb32-4c6f-af62-3d7bb4b9d4bb req-c6bca7de-b32a-498a-8c4e-86cc55b66683 service nova] Lock "726bb85b-391e-4041-972f-f35062c9409b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:04:42 user nova-compute[73497]: DEBUG nova.compute.manager [req-6cfd2785-bb32-4c6f-af62-3d7bb4b9d4bb req-c6bca7de-b32a-498a-8c4e-86cc55b66683 service nova] [instance: 726bb85b-391e-4041-972f-f35062c9409b] No waiting events found dispatching network-vif-unplugged-52f7945c-939e-40d4-ac84-3827a07a9478 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:04:42 user nova-compute[73497]: DEBUG nova.compute.manager [req-6cfd2785-bb32-4c6f-af62-3d7bb4b9d4bb req-c6bca7de-b32a-498a-8c4e-86cc55b66683 service nova] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Received event network-vif-unplugged-52f7945c-939e-40d4-ac84-3827a07a9478 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG nova.network.neutron [req-12b72e03-e9b0-48bb-9165-315a6d9a8e10 req-96d15c97-4b67-4dbb-99b7-ee798e54c545 service nova] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Updated VIF entry in instance network info cache for port 52f7945c-939e-40d4-ac84-3827a07a9478. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG nova.network.neutron [req-12b72e03-e9b0-48bb-9165-315a6d9a8e10 req-96d15c97-4b67-4dbb-99b7-ee798e54c545 service nova] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Updating instance_info_cache with network_info: [{"id": "52f7945c-939e-40d4-ac84-3827a07a9478", "address": "fa:16:3e:f5:15:a1", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52f7945c-93", "ovs_interfaceid": "52f7945c-939e-40d4-ac84-3827a07a9478", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-12b72e03-e9b0-48bb-9165-315a6d9a8e10 req-96d15c97-4b67-4dbb-99b7-ee798e54c545 service nova] Releasing lock "refresh_cache-726bb85b-391e-4041-972f-f35062c9409b" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:04:43 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Instance destroyed successfully.
Aug 27 00:04:43 user nova-compute[73497]: DEBUG nova.objects.instance [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lazy-loading 'resources' on Instance uuid 726bb85b-391e-4041-972f-f35062c9409b {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T23:59:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-671362078',display_name='tempest-TestVolumeBootPattern-server-671362078',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-671362078',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQ+N0pTaMhOCJarM3h1l7r/nXRl69icaKHUqFxozzTcIDFOjdkD/FQAV7dJ0BDWuRi4QUFih+uNp9B/6RxXoehOjwmxPJ6FmE8rwSmjVjNzJ4gi1FUwzweH3kRlzkgH2Q==',key_name='tempest-TestVolumeBootPattern-760141052',keypairs=<?>,launch_index=0,launched_at=2023-08-26T23:59:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba3491abf5cc4e77aed2997a5ac8aeee',ramdisk_id='',reservation_id='r-0f0lw0m5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-377601332',owner_user_name='tempest-TestVolumeBootPattern-377601332-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T23:59:58Z,user_data=None,user_id='dbd048b30716490880ff4b28758536a5',uuid=726bb85b-391e-4041-972f-f35062c9409b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52f7945c-939e-40d4-ac84-3827a07a9478", "address": "fa:16:3e:f5:15:a1", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52f7945c-93", "ovs_interfaceid": "52f7945c-939e-40d4-ac84-3827a07a9478", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Converting VIF {"id": "52f7945c-939e-40d4-ac84-3827a07a9478", "address": "fa:16:3e:f5:15:a1", "network": {"id": "910e0fe2-5c86-4f0a-8aa1-e5d125118d99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-190162946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3491abf5cc4e77aed2997a5ac8aeee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52f7945c-93", "ovs_interfaceid": "52f7945c-939e-40d4-ac84-3827a07a9478", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:15:a1,bridge_name='br-int',has_traffic_filtering=True,id=52f7945c-939e-40d4-ac84-3827a07a9478,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52f7945c-93') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG os_vif [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:15:a1,bridge_name='br-int',has_traffic_filtering=True,id=52f7945c-939e-40d4-ac84-3827a07a9478,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52f7945c-93') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52f7945c-93, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:04:43 user nova-compute[73497]: INFO os_vif [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:15:a1,bridge_name='br-int',has_traffic_filtering=True,id=52f7945c-939e-40d4-ac84-3827a07a9478,network=Network(910e0fe2-5c86-4f0a-8aa1-e5d125118d99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52f7945c-93')
Aug 27 00:04:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMblgFXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:04:43 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:04:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedc84bd-ad6c-4d5b-a7fd-84820aa7c0fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[562f3b65-f563-4706-b5c7-7457337996d8]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 (non-flash)
Aug 27 00:04:43 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 (non-flash)
Aug 27 00:04:43 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28398d35b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6'): ({'sdb'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Removing single pathed devices sdb {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d63906-90d7-4e21-a5c5-ca0dc2401ec3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[231a02c0-46f2-4909-9374-e7c035ff00cd]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Flushing IO for device /dev/sdb {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdbf715-8f2c-4d25-b9df-dc8d764ae2ea]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac26623-bd7d-44ab-bbff-3030611bc009]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_9aab9da9', '/dev/disk/by-id/scsi-23038626635326133', '/dev/disk/by-id/scsi-1SCST_BIO9aab9da9-08bf52a31a7d2926') {{(pid=84617) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[31aa01a1-b5be-4df9-a7cd-23a0ac723f8b]: (4, None) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[09936c01-51e8-48f7-8157-19445e4004b7]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf64dc85-35b3-487c-a8fd-76916e95fc4c]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6, portal: 172.16.0.220,3260]
Aug 27 00:04:43 user nova-compute[73497]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6, portal: 172.16.0.220,3260] successful.
Aug 27 00:04:43 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50abfef1-01fb-4df8-bb4a-e9f7832b3ef6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[250860bc-1c7a-4597-bf02-6122f8a7e4ce]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] <== disconnect_volume: return (290ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 00:04:43 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Deleting instance files /opt/stack/data/nova/instances/726bb85b-391e-4041-972f-f35062c9409b_del
Aug 27 00:04:43 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Deletion of /opt/stack/data/nova/instances/726bb85b-391e-4041-972f-f35062c9409b_del complete
Aug 27 00:04:43 user nova-compute[73497]: INFO nova.compute.manager [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 27 00:04:43 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 00:04:43 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 726bb85b-391e-4041-972f-f35062c9409b] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 00:04:44 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:04:44 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Took 0.49 seconds to deallocate network for instance.
Aug 27 00:04:44 user nova-compute[73497]: DEBUG nova.compute.manager [req-b2827a16-1dec-4852-a7c4-98c115f391b1 req-d231f08f-f0ad-40d4-9fde-898cda315e81 service nova] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Received event network-vif-deleted-52f7945c-939e-40d4-ac84-3827a07a9478 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:04:44 user nova-compute[73497]: DEBUG nova.compute.manager [req-06a9f11e-f9bf-4649-a047-c31f6ac2525f req-287ae1bf-bb8d-4906-ab43-cc74b0e006c0 service nova] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Received event network-vif-plugged-52f7945c-939e-40d4-ac84-3827a07a9478 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:04:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-06a9f11e-f9bf-4649-a047-c31f6ac2525f req-287ae1bf-bb8d-4906-ab43-cc74b0e006c0 service nova] Acquiring lock "726bb85b-391e-4041-972f-f35062c9409b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:04:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-06a9f11e-f9bf-4649-a047-c31f6ac2525f req-287ae1bf-bb8d-4906-ab43-cc74b0e006c0 service nova] Lock "726bb85b-391e-4041-972f-f35062c9409b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:04:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-06a9f11e-f9bf-4649-a047-c31f6ac2525f req-287ae1bf-bb8d-4906-ab43-cc74b0e006c0 service nova] Lock "726bb85b-391e-4041-972f-f35062c9409b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:04:44 user nova-compute[73497]: DEBUG nova.compute.manager [req-06a9f11e-f9bf-4649-a047-c31f6ac2525f req-287ae1bf-bb8d-4906-ab43-cc74b0e006c0 service nova] [instance: 726bb85b-391e-4041-972f-f35062c9409b] No waiting events found dispatching network-vif-plugged-52f7945c-939e-40d4-ac84-3827a07a9478 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:04:44 user nova-compute[73497]: WARNING nova.compute.manager [req-06a9f11e-f9bf-4649-a047-c31f6ac2525f req-287ae1bf-bb8d-4906-ab43-cc74b0e006c0 service nova] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Received unexpected event network-vif-plugged-52f7945c-939e-40d4-ac84-3827a07a9478 for instance with vm_state active and task_state deleting.
Aug 27 00:04:45 user nova-compute[73497]: INFO nova.compute.manager [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Took 0.76 seconds to detach 1 volumes for instance.
Aug 27 00:04:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:04:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:04:45 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:04:45 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:04:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.102s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:04:45 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Deleted allocations for instance 726bb85b-391e-4041-972f-f35062c9409b
Aug 27 00:04:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-3f439aa5-aea9-43e1-9534-9728159acccc tempest-TestVolumeBootPattern-377601332 tempest-TestVolumeBootPattern-377601332-project-member] Lock "726bb85b-391e-4041-972f-f35062c9409b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.640s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:04:47 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:04:47 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Cleaning up deleted instances with incomplete migration  {{(pid=73497) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 00:04:47 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:04:48 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:04:50 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:04:51 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:04:51 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 00:04:51 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Rebuilding the list of instances to heal {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 00:04:51 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Didn't find any instances for network info cache update. {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 00:04:53 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:04:53 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Cleaning up deleted instances {{(pid=73497) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 00:04:53 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] There are 0 instances to clean {{(pid=73497) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 00:04:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:04:58 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693094683.4076896, 726bb85b-391e-4041-972f-f35062c9409b => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:04:58 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: 726bb85b-391e-4041-972f-f35062c9409b] VM Stopped (Lifecycle Event)
Aug 27 00:04:58 user nova-compute[73497]: DEBUG nova.compute.manager [None req-f86fb988-11cb-42b6-86b9-56ae059ff747 None None] [instance: 726bb85b-391e-4041-972f-f35062c9409b] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:04:58 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:04:58 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:04:58 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 00:04:58 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:04:58 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:04:58 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:05:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:05:08 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:05:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:05:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:05:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 00:05:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:05:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:05:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:05:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:05:23 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:05:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:05:29 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:05:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:05:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:05:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:05:29 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 00:05:29 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:05:29 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:05:29 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8912MB free_disk=25.04825210571289GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 00:05:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:05:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:05:29 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 00:05:29 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 00:05:29 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:05:29 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:05:29 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 00:05:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:05:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:05:34 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:05:35 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:05:36 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:05:36 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 00:05:38 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:05:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:05:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:05:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 00:05:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:05:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:05:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:05:40 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:05:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:05:43 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:05:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:05:45 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:05:45 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:05:48 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:05:48 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:05:50 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:05:53 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:05:53 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 00:05:53 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Rebuilding the list of instances to heal {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 00:05:53 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Didn't find any instances for network info cache update. {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 00:05:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:05:58 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:06:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:06:08 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:06:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:06:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:06:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:06:20 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:06:23 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:06:23 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:06:25 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:06:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:06:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:06:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:06:29 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:06:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:06:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:06:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:06:29 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 00:06:29 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:06:29 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:06:29 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8631MB free_disk=25.035049438476562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 00:06:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:06:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:06:29 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 00:06:29 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 00:06:29 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Refreshing inventories for resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 00:06:29 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Updating ProviderTree inventory for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 00:06:29 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Updating inventory in ProviderTree for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 00:06:29 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Refreshing aggregate associations for resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1, aggregates: None {{(pid=73497) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 00:06:29 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Refreshing trait associations for resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING {{(pid=73497) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 00:06:29 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:06:30 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:06:30 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 00:06:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.337s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:06:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:06:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:06:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Acquiring lock "c373d8f9-57d1-4177-89c0-7e7106255b52" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:06:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:06:33 user nova-compute[73497]: DEBUG nova.compute.manager [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Starting instance... {{(pid=73497) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 00:06:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:06:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:06:33 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73497) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 00:06:33 user nova-compute[73497]: INFO nova.compute.claims [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Claim successful on node user
Aug 27 00:06:34 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:06:34 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:06:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.233s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:06:34 user nova-compute[73497]: DEBUG nova.compute.manager [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Start building networks asynchronously for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 00:06:34 user nova-compute[73497]: DEBUG nova.compute.manager [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Allocating IP information in the background. {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 00:06:34 user nova-compute[73497]: DEBUG nova.network.neutron [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] allocate_for_instance() {{(pid=73497) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 00:06:34 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 00:06:34 user nova-compute[73497]: DEBUG nova.compute.manager [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Start building block device mappings for instance. {{(pid=73497) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 00:06:34 user nova-compute[73497]: DEBUG nova.policy [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0124d1f42eaf4ee4aad064f04e4b9e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee81ff5f91a454abdf376e50e1486e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73497) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 00:06:34 user nova-compute[73497]: DEBUG nova.compute.manager [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Start spawning the instance on the hypervisor. {{(pid=73497) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 00:06:34 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Creating instance directory {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 00:06:34 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Creating image(s)
Aug 27 00:06:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Acquiring lock "/opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:06:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "/opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:06:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "/opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:06:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:06:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.192s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:06:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Acquiring lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:06:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:06:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:06:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.179s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:06:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk 1073741824 {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:06:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981,backing_fmt=raw /opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk 1073741824" returned: 0 in 0.049s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:06:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "0329cd0ac9e7f4717219a84dae97d40eb87ee981" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:06:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:06:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0329cd0ac9e7f4717219a84dae97d40eb87ee981 --force-share --output=json" returned: 0 in 0.204s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:06:35 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk. size=1073741824 {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 00:06:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:06:35 user nova-compute[73497]: DEBUG nova.network.neutron [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Successfully created port: 257cd460-3bb6-4dbc-9fac-2ca81a309ef9 {{(pid=73497) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 00:06:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:06:35 user nova-compute[73497]: DEBUG nova.virt.disk.api [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Cannot resize image /opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk to a smaller size. {{(pid=73497) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 00:06:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Created local disks {{(pid=73497) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 00:06:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Ensure instance console log exists: /opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/console.log {{(pid=73497) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 00:06:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:06:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:06:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:06:36 user nova-compute[73497]: DEBUG nova.network.neutron [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Successfully updated port: 257cd460-3bb6-4dbc-9fac-2ca81a309ef9 {{(pid=73497) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:06:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Acquiring lock "refresh_cache-c373d8f9-57d1-4177-89c0-7e7106255b52" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:06:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Acquired lock "refresh_cache-c373d8f9-57d1-4177-89c0-7e7106255b52" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:06:36 user nova-compute[73497]: DEBUG nova.network.neutron [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Building network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:06:36 user nova-compute[73497]: DEBUG nova.compute.manager [req-55a8b8fa-3189-47aa-86ce-51ead4433d10 req-a749fdb5-7c54-4f25-98fb-51eeee474dfc service nova] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Received event network-changed-257cd460-3bb6-4dbc-9fac-2ca81a309ef9 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:06:36 user nova-compute[73497]: DEBUG nova.compute.manager [req-55a8b8fa-3189-47aa-86ce-51ead4433d10 req-a749fdb5-7c54-4f25-98fb-51eeee474dfc service nova] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Refreshing instance network info cache due to event network-changed-257cd460-3bb6-4dbc-9fac-2ca81a309ef9. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:06:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-55a8b8fa-3189-47aa-86ce-51ead4433d10 req-a749fdb5-7c54-4f25-98fb-51eeee474dfc service nova] Acquiring lock "refresh_cache-c373d8f9-57d1-4177-89c0-7e7106255b52" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:06:36 user nova-compute[73497]: DEBUG nova.network.neutron [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Instance cache missing network info. {{(pid=73497) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG nova.network.neutron [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Updating instance_info_cache with network_info: [{"id": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "address": "fa:16:3e:1a:d3:69", "network": {"id": "ccecce66-f550-4ea7-8ff4-366acda30a47", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1307360466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee81ff5f91a454abdf376e50e1486e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap257cd460-3b", "ovs_interfaceid": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Releasing lock "refresh_cache-c373d8f9-57d1-4177-89c0-7e7106255b52" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG nova.compute.manager [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Instance network_info: |[{"id": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "address": "fa:16:3e:1a:d3:69", "network": {"id": "ccecce66-f550-4ea7-8ff4-366acda30a47", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1307360466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee81ff5f91a454abdf376e50e1486e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap257cd460-3b", "ovs_interfaceid": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73497) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-55a8b8fa-3189-47aa-86ce-51ead4433d10 req-a749fdb5-7c54-4f25-98fb-51eeee474dfc service nova] Acquired lock "refresh_cache-c373d8f9-57d1-4177-89c0-7e7106255b52" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG nova.network.neutron [req-55a8b8fa-3189-47aa-86ce-51ead4433d10 req-a749fdb5-7c54-4f25-98fb-51eeee474dfc service nova] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Refreshing network info cache for port 257cd460-3bb6-4dbc-9fac-2ca81a309ef9 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Start _get_guest_xml network_info=[{"id": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "address": "fa:16:3e:1a:d3:69", "network": {"id": "ccecce66-f550-4ea7-8ff4-366acda30a47", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1307360466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee81ff5f91a454abdf376e50e1486e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap257cd460-3b", "ovs_interfaceid": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'image_id': '0c532d88-7808-4cc1-8183-4c200f1ab99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 00:06:37 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:06:37 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:06:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] CPU controller missing on host. {{(pid=73497) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.host [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] CPU controller found on host. {{(pid=73497) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73497) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T23:09:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T23:09:11Z,direct_url=<?>,disk_format='qcow2',id=0c532d88-7808-4cc1-8183-4c200f1ab99a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a72e239cc180405f8d119376217b6f9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T23:09:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Flavor limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Image limits 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Flavor pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Image pref 0:0:0 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Got 1 possible topologies {{(pid=73497) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG nova.virt.hardware [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73497) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:06:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-177684427',display_name='tempest-SnapshotDataIntegrityTests-server-177684427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-177684427',id=53,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDovkcNfhv2GMR/ZjXiQveIQo0EcA6pmWdi7HIlrMm831pHMu221e1CegsQxNLOQqKd0a9fRpEMlyHmGnFY/lgIFiXSyG+8aYpQ97egKlVHMV3DZZwLa8QqxyMNtnE4XjA==',key_name='tempest-keypair-1241101889',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ee81ff5f91a454abdf376e50e1486e8',ramdisk_id='',reservation_id='r-ipwzzxrg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-316164581',owner_user_name='tempest-SnapshotDataIntegrityTests-316164581-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:06:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0124d1f42eaf4ee4aad064f04e4b9e07',uuid=c373d8f9-57d1-4177-89c0-7e7106255b52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "address": "fa:16:3e:1a:d3:69", "network": {"id": "ccecce66-f550-4ea7-8ff4-366acda30a47", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1307360466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee81ff5f91a454abdf376e50e1486e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap257cd460-3b", "ovs_interfaceid": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73497) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Converting VIF {"id": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "address": "fa:16:3e:1a:d3:69", "network": {"id": "ccecce66-f550-4ea7-8ff4-366acda30a47", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1307360466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee81ff5f91a454abdf376e50e1486e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap257cd460-3b", "ovs_interfaceid": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:d3:69,bridge_name='br-int',has_traffic_filtering=True,id=257cd460-3bb6-4dbc-9fac-2ca81a309ef9,network=Network(ccecce66-f550-4ea7-8ff4-366acda30a47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap257cd460-3b') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG nova.objects.instance [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lazy-loading 'pci_devices' on Instance uuid c373d8f9-57d1-4177-89c0-7e7106255b52 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] End _get_guest_xml xml=<domain type="kvm">
Aug 27 00:06:37 user nova-compute[73497]:   <uuid>c373d8f9-57d1-4177-89c0-7e7106255b52</uuid>
Aug 27 00:06:37 user nova-compute[73497]:   <name>instance-00000035</name>
Aug 27 00:06:37 user nova-compute[73497]:   <memory>524288</memory>
Aug 27 00:06:37 user nova-compute[73497]:   <vcpu>1</vcpu>
Aug 27 00:06:37 user nova-compute[73497]:   <metadata>
Aug 27 00:06:37 user nova-compute[73497]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:06:37 user nova-compute[73497]:       <nova:package version="0.0.0"/>
Aug 27 00:06:37 user nova-compute[73497]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-177684427</nova:name>
Aug 27 00:06:37 user nova-compute[73497]:       <nova:creationTime>2023-08-27 00:06:37</nova:creationTime>
Aug 27 00:06:37 user nova-compute[73497]:       <nova:flavor name="m1.tiny">
Aug 27 00:06:37 user nova-compute[73497]:         <nova:memory>512</nova:memory>
Aug 27 00:06:37 user nova-compute[73497]:         <nova:disk>1</nova:disk>
Aug 27 00:06:37 user nova-compute[73497]:         <nova:swap>0</nova:swap>
Aug 27 00:06:37 user nova-compute[73497]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:06:37 user nova-compute[73497]:         <nova:vcpus>1</nova:vcpus>
Aug 27 00:06:37 user nova-compute[73497]:       </nova:flavor>
Aug 27 00:06:37 user nova-compute[73497]:       <nova:owner>
Aug 27 00:06:37 user nova-compute[73497]:         <nova:user uuid="0124d1f42eaf4ee4aad064f04e4b9e07">tempest-SnapshotDataIntegrityTests-316164581-project-member</nova:user>
Aug 27 00:06:37 user nova-compute[73497]:         <nova:project uuid="4ee81ff5f91a454abdf376e50e1486e8">tempest-SnapshotDataIntegrityTests-316164581</nova:project>
Aug 27 00:06:37 user nova-compute[73497]:       </nova:owner>
Aug 27 00:06:37 user nova-compute[73497]:       <nova:root type="image" uuid="0c532d88-7808-4cc1-8183-4c200f1ab99a"/>
Aug 27 00:06:37 user nova-compute[73497]:       <nova:ports>
Aug 27 00:06:37 user nova-compute[73497]:         <nova:port uuid="257cd460-3bb6-4dbc-9fac-2ca81a309ef9">
Aug 27 00:06:37 user nova-compute[73497]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 27 00:06:37 user nova-compute[73497]:         </nova:port>
Aug 27 00:06:37 user nova-compute[73497]:       </nova:ports>
Aug 27 00:06:37 user nova-compute[73497]:     </nova:instance>
Aug 27 00:06:37 user nova-compute[73497]:   </metadata>
Aug 27 00:06:37 user nova-compute[73497]:   <sysinfo type="smbios">
Aug 27 00:06:37 user nova-compute[73497]:     <system>
Aug 27 00:06:37 user nova-compute[73497]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 00:06:37 user nova-compute[73497]:       <entry name="product">OpenStack Nova</entry>
Aug 27 00:06:37 user nova-compute[73497]:       <entry name="version">0.0.0</entry>
Aug 27 00:06:37 user nova-compute[73497]:       <entry name="serial">c373d8f9-57d1-4177-89c0-7e7106255b52</entry>
Aug 27 00:06:37 user nova-compute[73497]:       <entry name="uuid">c373d8f9-57d1-4177-89c0-7e7106255b52</entry>
Aug 27 00:06:37 user nova-compute[73497]:       <entry name="family">Virtual Machine</entry>
Aug 27 00:06:37 user nova-compute[73497]:     </system>
Aug 27 00:06:37 user nova-compute[73497]:   </sysinfo>
Aug 27 00:06:37 user nova-compute[73497]:   <os>
Aug 27 00:06:37 user nova-compute[73497]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 00:06:37 user nova-compute[73497]:     <boot dev="hd"/>
Aug 27 00:06:37 user nova-compute[73497]:     <smbios mode="sysinfo"/>
Aug 27 00:06:37 user nova-compute[73497]:   </os>
Aug 27 00:06:37 user nova-compute[73497]:   <features>
Aug 27 00:06:37 user nova-compute[73497]:     <acpi/>
Aug 27 00:06:37 user nova-compute[73497]:     <apic/>
Aug 27 00:06:37 user nova-compute[73497]:     <vmcoreinfo/>
Aug 27 00:06:37 user nova-compute[73497]:   </features>
Aug 27 00:06:37 user nova-compute[73497]:   <clock offset="utc">
Aug 27 00:06:37 user nova-compute[73497]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 00:06:37 user nova-compute[73497]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 00:06:37 user nova-compute[73497]:     <timer name="hpet" present="no"/>
Aug 27 00:06:37 user nova-compute[73497]:   </clock>
Aug 27 00:06:37 user nova-compute[73497]:   <cpu mode="custom" match="exact">
Aug 27 00:06:37 user nova-compute[73497]:     <model>Nehalem</model>
Aug 27 00:06:37 user nova-compute[73497]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 00:06:37 user nova-compute[73497]:   </cpu>
Aug 27 00:06:37 user nova-compute[73497]:   <devices>
Aug 27 00:06:37 user nova-compute[73497]:     <disk type="file" device="disk">
Aug 27 00:06:37 user nova-compute[73497]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 00:06:37 user nova-compute[73497]:       <source file="/opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk"/>
Aug 27 00:06:37 user nova-compute[73497]:       <target dev="vda" bus="virtio"/>
Aug 27 00:06:37 user nova-compute[73497]:     </disk>
Aug 27 00:06:37 user nova-compute[73497]:     <interface type="ethernet">
Aug 27 00:06:37 user nova-compute[73497]:       <mac address="fa:16:3e:1a:d3:69"/>
Aug 27 00:06:37 user nova-compute[73497]:       <model type="virtio"/>
Aug 27 00:06:37 user nova-compute[73497]:       <mtu size="1442"/>
Aug 27 00:06:37 user nova-compute[73497]:       <target dev="tap257cd460-3b"/>
Aug 27 00:06:37 user nova-compute[73497]:     </interface>
Aug 27 00:06:37 user nova-compute[73497]:     <serial type="pty">
Aug 27 00:06:37 user nova-compute[73497]:       <log file="/opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/console.log" append="off"/>
Aug 27 00:06:37 user nova-compute[73497]:     </serial>
Aug 27 00:06:37 user nova-compute[73497]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 00:06:37 user nova-compute[73497]:     <video>
Aug 27 00:06:37 user nova-compute[73497]:       <model type="virtio"/>
Aug 27 00:06:37 user nova-compute[73497]:     </video>
Aug 27 00:06:37 user nova-compute[73497]:     <rng model="virtio">
Aug 27 00:06:37 user nova-compute[73497]:       <backend model="random">/dev/urandom</backend>
Aug 27 00:06:37 user nova-compute[73497]:     </rng>
Aug 27 00:06:37 user nova-compute[73497]:     <controller type="usb" index="0" model="none"/>
Aug 27 00:06:37 user nova-compute[73497]:     <memballoon model="virtio">
Aug 27 00:06:37 user nova-compute[73497]:       <stats period="10"/>
Aug 27 00:06:37 user nova-compute[73497]:     </memballoon>
Aug 27 00:06:37 user nova-compute[73497]:   </devices>
Aug 27 00:06:37 user nova-compute[73497]: </domain>
Aug 27 00:06:37 user nova-compute[73497]:  {{(pid=73497) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:06:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-177684427',display_name='tempest-SnapshotDataIntegrityTests-server-177684427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-177684427',id=53,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDovkcNfhv2GMR/ZjXiQveIQo0EcA6pmWdi7HIlrMm831pHMu221e1CegsQxNLOQqKd0a9fRpEMlyHmGnFY/lgIFiXSyG+8aYpQ97egKlVHMV3DZZwLa8QqxyMNtnE4XjA==',key_name='tempest-keypair-1241101889',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ee81ff5f91a454abdf376e50e1486e8',ramdisk_id='',reservation_id='r-ipwzzxrg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-316164581',owner_user_name='tempest-SnapshotDataIntegrityTests-316164581-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:06:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0124d1f42eaf4ee4aad064f04e4b9e07',uuid=c373d8f9-57d1-4177-89c0-7e7106255b52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "address": "fa:16:3e:1a:d3:69", "network": {"id": "ccecce66-f550-4ea7-8ff4-366acda30a47", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1307360466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee81ff5f91a454abdf376e50e1486e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap257cd460-3b", "ovs_interfaceid": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Converting VIF {"id": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "address": "fa:16:3e:1a:d3:69", "network": {"id": "ccecce66-f550-4ea7-8ff4-366acda30a47", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1307360466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee81ff5f91a454abdf376e50e1486e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap257cd460-3b", "ovs_interfaceid": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:d3:69,bridge_name='br-int',has_traffic_filtering=True,id=257cd460-3bb6-4dbc-9fac-2ca81a309ef9,network=Network(ccecce66-f550-4ea7-8ff4-366acda30a47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap257cd460-3b') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG os_vif [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:d3:69,bridge_name='br-int',has_traffic_filtering=True,id=257cd460-3bb6-4dbc-9fac-2ca81a309ef9,network=Network(ccecce66-f550-4ea7-8ff4-366acda30a47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap257cd460-3b') {{(pid=73497) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap257cd460-3b, may_exist=True, interface_attrs={}) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap257cd460-3b, col_values=(('external_ids', {'iface-id': '257cd460-3bb6-4dbc-9fac-2ca81a309ef9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:d3:69', 'vm-uuid': 'c373d8f9-57d1-4177-89c0-7e7106255b52'}),), if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:06:37 user nova-compute[73497]: INFO os_vif [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:d3:69,bridge_name='br-int',has_traffic_filtering=True,id=257cd460-3bb6-4dbc-9fac-2ca81a309ef9,network=Network(ccecce66-f550-4ea7-8ff4-366acda30a47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap257cd460-3b')
Aug 27 00:06:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] No VIF found with MAC fa:16:3e:1a:d3:69, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG nova.network.neutron [req-55a8b8fa-3189-47aa-86ce-51ead4433d10 req-a749fdb5-7c54-4f25-98fb-51eeee474dfc service nova] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Updated VIF entry in instance network info cache for port 257cd460-3bb6-4dbc-9fac-2ca81a309ef9. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG nova.network.neutron [req-55a8b8fa-3189-47aa-86ce-51ead4433d10 req-a749fdb5-7c54-4f25-98fb-51eeee474dfc service nova] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Updating instance_info_cache with network_info: [{"id": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "address": "fa:16:3e:1a:d3:69", "network": {"id": "ccecce66-f550-4ea7-8ff4-366acda30a47", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1307360466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee81ff5f91a454abdf376e50e1486e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap257cd460-3b", "ovs_interfaceid": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:06:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-55a8b8fa-3189-47aa-86ce-51ead4433d10 req-a749fdb5-7c54-4f25-98fb-51eeee474dfc service nova] Releasing lock "refresh_cache-c373d8f9-57d1-4177-89c0-7e7106255b52" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:06:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:06:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:06:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:06:39 user nova-compute[73497]: DEBUG nova.compute.manager [req-09da2a6b-eaed-40c8-93ce-9d95cd9956a1 req-0d4e1e95-8fdb-4738-b483-fff8631908c4 service nova] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Received event network-vif-plugged-257cd460-3bb6-4dbc-9fac-2ca81a309ef9 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:06:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-09da2a6b-eaed-40c8-93ce-9d95cd9956a1 req-0d4e1e95-8fdb-4738-b483-fff8631908c4 service nova] Acquiring lock "c373d8f9-57d1-4177-89c0-7e7106255b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:06:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-09da2a6b-eaed-40c8-93ce-9d95cd9956a1 req-0d4e1e95-8fdb-4738-b483-fff8631908c4 service nova] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:06:39 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-09da2a6b-eaed-40c8-93ce-9d95cd9956a1 req-0d4e1e95-8fdb-4738-b483-fff8631908c4 service nova] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:06:39 user nova-compute[73497]: DEBUG nova.compute.manager [req-09da2a6b-eaed-40c8-93ce-9d95cd9956a1 req-0d4e1e95-8fdb-4738-b483-fff8631908c4 service nova] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] No waiting events found dispatching network-vif-plugged-257cd460-3bb6-4dbc-9fac-2ca81a309ef9 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:06:39 user nova-compute[73497]: WARNING nova.compute.manager [req-09da2a6b-eaed-40c8-93ce-9d95cd9956a1 req-0d4e1e95-8fdb-4738-b483-fff8631908c4 service nova] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Received unexpected event network-vif-plugged-257cd460-3bb6-4dbc-9fac-2ca81a309ef9 for instance with vm_state building and task_state spawning.
Aug 27 00:06:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:06:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:06:39 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:06:40 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:06:41 user nova-compute[73497]: DEBUG nova.compute.manager [req-6069203a-a414-4455-b00d-02c3f24588fe req-bf7350fa-0fac-4f56-87ea-97aecef1b390 service nova] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Received event network-vif-plugged-257cd460-3bb6-4dbc-9fac-2ca81a309ef9 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:06:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6069203a-a414-4455-b00d-02c3f24588fe req-bf7350fa-0fac-4f56-87ea-97aecef1b390 service nova] Acquiring lock "c373d8f9-57d1-4177-89c0-7e7106255b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:06:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6069203a-a414-4455-b00d-02c3f24588fe req-bf7350fa-0fac-4f56-87ea-97aecef1b390 service nova] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:06:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-6069203a-a414-4455-b00d-02c3f24588fe req-bf7350fa-0fac-4f56-87ea-97aecef1b390 service nova] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:06:41 user nova-compute[73497]: DEBUG nova.compute.manager [req-6069203a-a414-4455-b00d-02c3f24588fe req-bf7350fa-0fac-4f56-87ea-97aecef1b390 service nova] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] No waiting events found dispatching network-vif-plugged-257cd460-3bb6-4dbc-9fac-2ca81a309ef9 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:06:41 user nova-compute[73497]: WARNING nova.compute.manager [req-6069203a-a414-4455-b00d-02c3f24588fe req-bf7350fa-0fac-4f56-87ea-97aecef1b390 service nova] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Received unexpected event network-vif-plugged-257cd460-3bb6-4dbc-9fac-2ca81a309ef9 for instance with vm_state building and task_state spawning.
Aug 27 00:06:41 user nova-compute[73497]: DEBUG nova.compute.manager [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Instance event wait completed in 0 seconds for  {{(pid=73497) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 00:06:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Guest created on hypervisor {{(pid=73497) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 00:06:41 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693094801.732857, c373d8f9-57d1-4177-89c0-7e7106255b52 => Resumed> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:06:41 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] VM Resumed (Lifecycle Event)
Aug 27 00:06:41 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Instance spawned successfully.
Aug 27 00:06:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 00:06:41 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:06:41 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:06:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Found default for hw_cdrom_bus of ide {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:06:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Found default for hw_disk_bus of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:06:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Found default for hw_input_bus of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:06:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Found default for hw_pointer_model of None {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:06:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Found default for hw_video_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:06:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Found default for hw_vif_model of virtio {{(pid=73497) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:06:41 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:06:41 user nova-compute[73497]: DEBUG nova.virt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Emitting event <LifecycleEvent: 1693094801.7360044, c373d8f9-57d1-4177-89c0-7e7106255b52 => Started> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:06:41 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] VM Started (Lifecycle Event)
Aug 27 00:06:41 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:06:41 user nova-compute[73497]: DEBUG nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73497) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:06:41 user nova-compute[73497]: INFO nova.compute.manager [None req-637e650d-452d-4192-8976-09f50273a439 None None] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:06:41 user nova-compute[73497]: INFO nova.compute.manager [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Took 7.40 seconds to spawn the instance on the hypervisor.
Aug 27 00:06:41 user nova-compute[73497]: DEBUG nova.compute.manager [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:06:41 user nova-compute[73497]: INFO nova.compute.manager [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Took 8.00 seconds to build instance.
Aug 27 00:06:41 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8b6c3d09-bee4-4dde-8495-2c389db718f5 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.192s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:06:42 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:06:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:06:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:06:45 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:06:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:06:50 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:06:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:06:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:06:55 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:06:55 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 00:06:55 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Rebuilding the list of instances to heal {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 00:06:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-c373d8f9-57d1-4177-89c0-7e7106255b52" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:06:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-c373d8f9-57d1-4177-89c0-7e7106255b52" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:06:55 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 00:06:55 user nova-compute[73497]: DEBUG nova.objects.instance [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lazy-loading 'info_cache' on Instance uuid c373d8f9-57d1-4177-89c0-7e7106255b52 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:06:55 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Updating instance_info_cache with network_info: [{"id": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "address": "fa:16:3e:1a:d3:69", "network": {"id": "ccecce66-f550-4ea7-8ff4-366acda30a47", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1307360466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee81ff5f91a454abdf376e50e1486e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap257cd460-3b", "ovs_interfaceid": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:06:55 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-c373d8f9-57d1-4177-89c0-7e7106255b52" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:06:55 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 00:06:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:06:58 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:07:01 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:07:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:07:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:07:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:07:08 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:07:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:07:13 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:07:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:07:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:07:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:07:29 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:07:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:07:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:07:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:07:29 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 00:07:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:07:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:07:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:07:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:07:30 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:07:30 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:07:30 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8588MB free_disk=24.994407653808594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 00:07:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:07:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:07:30 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance c373d8f9-57d1-4177-89c0-7e7106255b52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:07:30 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 00:07:30 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 00:07:30 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:07:30 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:07:30 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 00:07:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.506s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:07:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:07:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:07:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:07:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 00:07:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:07:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:07:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:07:39 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:07:39 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:07:39 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:07:39 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 00:07:40 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:07:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:07:43 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:07:46 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:07:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:07:49 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:07:50 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:07:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:07:57 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:07:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 00:07:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Rebuilding the list of instances to heal {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 00:07:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-c373d8f9-57d1-4177-89c0-7e7106255b52" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:07:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-c373d8f9-57d1-4177-89c0-7e7106255b52" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:07:57 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 00:07:57 user nova-compute[73497]: DEBUG nova.objects.instance [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lazy-loading 'info_cache' on Instance uuid c373d8f9-57d1-4177-89c0-7e7106255b52 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:07:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:07:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:07:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 00:07:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:07:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:07:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:07:57 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Updating instance_info_cache with network_info: [{"id": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "address": "fa:16:3e:1a:d3:69", "network": {"id": "ccecce66-f550-4ea7-8ff4-366acda30a47", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1307360466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee81ff5f91a454abdf376e50e1486e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap257cd460-3b", "ovs_interfaceid": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:07:57 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-c373d8f9-57d1-4177-89c0-7e7106255b52" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:07:57 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 00:08:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:08:03 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:08:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:08:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:08:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:08:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 00:08:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:08:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:08:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:08:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:08:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:08:25 user nova-compute[73497]: DEBUG nova.compute.manager [req-f725f963-8880-49a7-bccd-371d9e072c9c req-8fdc4f25-b9f7-412c-9934-479a82bcf183 service nova] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Received event network-changed-257cd460-3bb6-4dbc-9fac-2ca81a309ef9 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:08:25 user nova-compute[73497]: DEBUG nova.compute.manager [req-f725f963-8880-49a7-bccd-371d9e072c9c req-8fdc4f25-b9f7-412c-9934-479a82bcf183 service nova] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Refreshing instance network info cache due to event network-changed-257cd460-3bb6-4dbc-9fac-2ca81a309ef9. {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:08:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f725f963-8880-49a7-bccd-371d9e072c9c req-8fdc4f25-b9f7-412c-9934-479a82bcf183 service nova] Acquiring lock "refresh_cache-c373d8f9-57d1-4177-89c0-7e7106255b52" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:08:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f725f963-8880-49a7-bccd-371d9e072c9c req-8fdc4f25-b9f7-412c-9934-479a82bcf183 service nova] Acquired lock "refresh_cache-c373d8f9-57d1-4177-89c0-7e7106255b52" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:08:25 user nova-compute[73497]: DEBUG nova.network.neutron [req-f725f963-8880-49a7-bccd-371d9e072c9c req-8fdc4f25-b9f7-412c-9934-479a82bcf183 service nova] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Refreshing network info cache for port 257cd460-3bb6-4dbc-9fac-2ca81a309ef9 {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:08:25 user nova-compute[73497]: DEBUG nova.network.neutron [req-f725f963-8880-49a7-bccd-371d9e072c9c req-8fdc4f25-b9f7-412c-9934-479a82bcf183 service nova] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Updated VIF entry in instance network info cache for port 257cd460-3bb6-4dbc-9fac-2ca81a309ef9. {{(pid=73497) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:08:25 user nova-compute[73497]: DEBUG nova.network.neutron [req-f725f963-8880-49a7-bccd-371d9e072c9c req-8fdc4f25-b9f7-412c-9934-479a82bcf183 service nova] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Updating instance_info_cache with network_info: [{"id": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "address": "fa:16:3e:1a:d3:69", "network": {"id": "ccecce66-f550-4ea7-8ff4-366acda30a47", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1307360466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee81ff5f91a454abdf376e50e1486e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap257cd460-3b", "ovs_interfaceid": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:08:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-f725f963-8880-49a7-bccd-371d9e072c9c req-8fdc4f25-b9f7-412c-9934-479a82bcf183 service nova] Releasing lock "refresh_cache-c373d8f9-57d1-4177-89c0-7e7106255b52" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:08:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:08:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:08:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 00:08:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:08:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:08:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:08:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:08:29 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:08:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:08:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:08:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:08:29 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 00:08:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:08:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:08:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:08:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:08:30 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:08:30 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:08:30 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8719MB free_disk=24.992176055908203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 00:08:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:08:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:08:30 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance c373d8f9-57d1-4177-89c0-7e7106255b52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:08:30 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 00:08:30 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 00:08:30 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:08:30 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:08:30 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 00:08:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:08:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Acquiring lock "c373d8f9-57d1-4177-89c0-7e7106255b52" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:08:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:08:30 user nova-compute[73497]: DEBUG nova.objects.instance [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lazy-loading 'flavor' on Instance uuid c373d8f9-57d1-4177-89c0-7e7106255b52 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:08:30 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:08:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Acquiring lock "c373d8f9-57d1-4177-89c0-7e7106255b52" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:08:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:08:31 user nova-compute[73497]: INFO nova.compute.manager [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Attaching volume 7405e57a-dbb5-4028-9d58-053ef59e03e8 to /dev/vdb
Aug 27 00:08:31 user nova-compute[73497]: DEBUG os_brick.utils [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:08:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:08:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:08:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc8ddae-ee12-46c8-845a-b3f0ab44d734]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:08:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:08:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:08:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5dbc8e-c60f-44d5-a60f-1fd15a5632a9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:08:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:08:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:08:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9871b42-8e87-4110-b6d5-185506148529]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:08:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7791ed8-56ee-403d-8248-b803a481b5eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:08:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:08:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:08:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 00:08:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:08:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:08:31 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 00:08:31 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3692380b-7578-468b-b7d4-78d655e0f345]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:08:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 00:08:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 00:08:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 00:08:31 user nova-compute[73497]: DEBUG os_brick.utils [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:08:31 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Updating existing volume attachment record: 1df294f6-ed5d-4242-84b7-e1284c934608 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 00:08:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:08:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:08:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:08:40 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:08:40 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:08:40 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:08:40 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 00:08:42 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:08:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:08:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:08:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 00:08:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:08:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:08:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:08:43 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:08:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:08:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:08:44 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:08:46 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:08:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:08:49 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 00:08:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSPXMtTI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:08:49 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:08:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:08:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:08:49 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:08:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:08:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:08:49 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 00:08:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:08:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:08:49 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[175032c1-dd68-4469-a62f-04c1b71ab8f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:08:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 00:08:49 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:08:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:08:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:08:49 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3f1624-7c75-458f-bf21-1179cbaf043a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:08:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8] added
Aug 27 00:08:49 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:08:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:08:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:08:49 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[05499804-9f94-4923-ac5a-de261501ffb3]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:08:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:08:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:08:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:08:49 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed232b5b-d8dd-44d7-9794-64f9087b0192]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:08:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:08:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kSPXMtTI {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:08:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kSPXMtTI" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:08:49 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7ab070-cfdd-4e65-ac41-d06d437f512d]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:08:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kSPXMtTI'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:08:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:08:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:08:49 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7ffabe-79aa-4ba1-9e0f-f87964769159]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:08:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:08:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:08:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:08:49 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe9be66-361f-45dc-912a-9f3c673ca7d3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:08:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 00:08:49 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:08:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 00:08:49 user nova-compute[73497]:  {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:08:49 user nova-compute[73497]: WARNING os_brick.initiator.connectors.iscsi [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 00:08:49 user nova-compute[73497]: 
Aug 27 00:08:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:08:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:08:50 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d289bd-b3e7-4bff-a993-2f201c239d96]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:08:50 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8, portal: 172.16.0.220,3260]
Aug 27 00:08:50 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8, portal: 172.16.0.220,3260] successful.
Aug 27 00:08:50 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:08:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:08:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:08:50 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[903e958e-45aa-47c7-921d-d95439bf933f]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:08:50 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:08:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:08:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:08:50 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0d9c4f-8abe-4e53-b3ee-48536aaf6c99]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:08:50 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8 (non-flash)
Aug 27 00:08:50 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:08:50 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8 (non-flash)
Aug 27 00:08:50 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:08:50 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:08:50 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 00:08:50 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 00:08:50 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 00:08:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:08:50 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:08:50 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[68879656-6970-4156-a0e0-c39b55f201a8]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:08:50 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:08:50 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSPXMtTI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 00:08:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:08:51 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26332343864613530', 'path': '/dev/sdb'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332343864613530', 'path': '/dev/sdb'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 00:08:51 user nova-compute[73497]: DEBUG nova.objects.instance [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lazy-loading 'flavor' on Instance uuid c373d8f9-57d1-4177-89c0-7e7106255b52 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 00:08:51 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:08:51 user nova-compute[73497]:   <source dev="/dev/sdb"/>
Aug 27 00:08:51 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 27 00:08:51 user nova-compute[73497]:   <serial>7405e57a-dbb5-4028-9d58-053ef59e03e8</serial>
Aug 27 00:08:51 user nova-compute[73497]: </disk>
Aug 27 00:08:51 user nova-compute[73497]:  {{(pid=73497) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 00:08:51 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:08:51 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] No VIF found with MAC fa:16:3e:1a:d3:69, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:08:51 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-d540cfc9-8e43-4f82-8c14-b0887075356d tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.648s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:08:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:08:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:08:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:08:58 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:08:58 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 00:08:58 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Rebuilding the list of instances to heal {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 00:08:58 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:08:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-c373d8f9-57d1-4177-89c0-7e7106255b52" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:08:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-c373d8f9-57d1-4177-89c0-7e7106255b52" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:08:58 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 00:08:58 user nova-compute[73497]: DEBUG nova.objects.instance [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lazy-loading 'info_cache' on Instance uuid c373d8f9-57d1-4177-89c0-7e7106255b52 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:08:58 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Updating instance_info_cache with network_info: [{"id": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "address": "fa:16:3e:1a:d3:69", "network": {"id": "ccecce66-f550-4ea7-8ff4-366acda30a47", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1307360466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee81ff5f91a454abdf376e50e1486e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap257cd460-3b", "ovs_interfaceid": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:08:58 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-c373d8f9-57d1-4177-89c0-7e7106255b52" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:08:58 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 00:09:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:09:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:09:08 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:09:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:09:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:09:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:09:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 00:09:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:09:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:09:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:09:18 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:09:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:09:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-28cbf18f-7b86-452e-bafb-aace80357c02 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Acquiring lock "c373d8f9-57d1-4177-89c0-7e7106255b52" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:09:24 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-28cbf18f-7b86-452e-bafb-aace80357c02 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:09:24 user nova-compute[73497]: INFO nova.compute.manager [None req-28cbf18f-7b86-452e-bafb-aace80357c02 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Detaching volume 7405e57a-dbb5-4028-9d58-053ef59e03e8
Aug 27 00:09:24 user nova-compute[73497]: INFO nova.virt.block_device [None req-28cbf18f-7b86-452e-bafb-aace80357c02 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Attempting to driver detach volume 7405e57a-dbb5-4028-9d58-053ef59e03e8 from mountpoint /dev/vdb
Aug 27 00:09:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-28cbf18f-7b86-452e-bafb-aace80357c02 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Attempting to detach device vdb from instance c373d8f9-57d1-4177-89c0-7e7106255b52 from the persistent domain config. {{(pid=73497) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 00:09:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-28cbf18f-7b86-452e-bafb-aace80357c02 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 00:09:24 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:09:24 user nova-compute[73497]:   <source dev="/dev/sdb"/>
Aug 27 00:09:24 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 27 00:09:24 user nova-compute[73497]:   <serial>7405e57a-dbb5-4028-9d58-053ef59e03e8</serial>
Aug 27 00:09:24 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 00:09:24 user nova-compute[73497]: </disk>
Aug 27 00:09:24 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 00:09:24 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-28cbf18f-7b86-452e-bafb-aace80357c02 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Successfully detached device vdb from instance c373d8f9-57d1-4177-89c0-7e7106255b52 from the persistent domain config.
Aug 27 00:09:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-28cbf18f-7b86-452e-bafb-aace80357c02 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c373d8f9-57d1-4177-89c0-7e7106255b52 from the live domain config. {{(pid=73497) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 00:09:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-28cbf18f-7b86-452e-bafb-aace80357c02 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 00:09:24 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:09:24 user nova-compute[73497]:   <source dev="/dev/sdb"/>
Aug 27 00:09:24 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 27 00:09:24 user nova-compute[73497]:   <serial>7405e57a-dbb5-4028-9d58-053ef59e03e8</serial>
Aug 27 00:09:24 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 00:09:24 user nova-compute[73497]: </disk>
Aug 27 00:09:24 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 00:09:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Received event <DeviceRemovedEvent: 1693094964.8450541, c373d8f9-57d1-4177-89c0-7e7106255b52 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73497) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 00:09:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-28cbf18f-7b86-452e-bafb-aace80357c02 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c373d8f9-57d1-4177-89c0-7e7106255b52 {{(pid=73497) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 00:09:24 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-28cbf18f-7b86-452e-bafb-aace80357c02 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Successfully detached device vdb from instance c373d8f9-57d1-4177-89c0-7e7106255b52 from the live domain config.
Aug 27 00:09:24 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28cbf18f-7b86-452e-bafb-aace80357c02 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 00:09:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cbf18f-7b86-452e-bafb-aace80357c02 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSPXMtTI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:09:24 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-28cbf18f-7b86-452e-bafb-aace80357c02 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:09:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-28cbf18f-7b86-452e-bafb-aace80357c02 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:09:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-28cbf18f-7b86-452e-bafb-aace80357c02 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:09:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cbf18f-7b86-452e-bafb-aace80357c02 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 00:09:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:09:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:09:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbfb5c4-1d07-4ad5-8f57-1b0a7bd07449]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:09:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:09:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:09:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5743a0d-9a18-4f26-a1a4-5bfc2a00b474]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:09:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cbf18f-7b86-452e-bafb-aace80357c02 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8 (non-flash)
Aug 27 00:09:24 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:09:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cbf18f-7b86-452e-bafb-aace80357c02 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8 (non-flash)
Aug 27 00:09:24 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:09:24 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cbf18f-7b86-452e-bafb-aace80357c02 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281c4c1cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8'): ({'sdb'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 00:09:24 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-28cbf18f-7b86-452e-bafb-aace80357c02 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Removing single pathed devices sdb {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 00:09:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:09:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:09:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce15ce92-fa62-46fe-a93b-b02cdd828aec]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:09:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:09:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:09:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db31ed2-c7c7-4e42-a0f4-68e126982fca]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:09:24 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-28cbf18f-7b86-452e-bafb-aace80357c02 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Flushing IO for device /dev/sdb {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 00:09:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:09:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:09:24 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac67fc26-6186-48de-bd71-33483d2d45e2]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:09:24 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-28cbf18f-7b86-452e-bafb-aace80357c02 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 00:09:24 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:09:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:09:25 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fc0b23-c523-468b-a57e-f33ee6d36693]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:09:25 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-28cbf18f-7b86-452e-bafb-aace80357c02 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 00:09:25 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-28cbf18f-7b86-452e-bafb-aace80357c02 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 00:09:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cbf18f-7b86-452e-bafb-aace80357c02 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 00:09:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:09:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:09:25 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b5964f-44e8-48d8-b02c-113e4fd267b8]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:09:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cbf18f-7b86-452e-bafb-aace80357c02 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:09:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:09:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:09:25 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[50defc6b-a78d-4594-9715-83238b935233]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:09:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cbf18f-7b86-452e-bafb-aace80357c02 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8, portal: 172.16.0.220,3260]
Aug 27 00:09:25 user nova-compute[73497]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8, portal: 172.16.0.220,3260] successful.
Aug 27 00:09:25 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:09:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:09:25 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7405e57a-dbb5-4028-9d58-053ef59e03e8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:09:25 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f58bdfb-342a-43f5-86b5-033309d75b21]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:09:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cbf18f-7b86-452e-bafb-aace80357c02 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:09:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-28cbf18f-7b86-452e-bafb-aace80357c02 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:09:25 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cbf18f-7b86-452e-bafb-aace80357c02 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] <== disconnect_volume: return (267ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:09:25 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28cbf18f-7b86-452e-bafb-aace80357c02 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 00:09:25 user nova-compute[73497]: DEBUG nova.objects.instance [None req-28cbf18f-7b86-452e-bafb-aace80357c02 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lazy-loading 'flavor' on Instance uuid c373d8f9-57d1-4177-89c0-7e7106255b52 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:09:25 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-28cbf18f-7b86-452e-bafb-aace80357c02 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.716s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:09:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:09:31 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:09:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:09:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:09:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:09:31 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 00:09:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:09:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:09:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:09:31 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:09:32 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:09:32 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:09:32 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8746MB free_disk=24.990631103515625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 00:09:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:09:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:09:32 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance c373d8f9-57d1-4177-89c0-7e7106255b52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:09:32 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 00:09:32 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 00:09:32 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:09:32 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:09:32 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 00:09:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:09:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:09:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:09:41 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:09:41 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:09:41 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:09:41 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 00:09:42 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:09:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:09:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:09:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 00:09:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:09:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:09:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:09:46 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:09:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:09:48 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:09:52 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:09:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:09:53 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:09:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:09:58 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:09:58 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Cleaning up deleted instances with incomplete migration  {{(pid=73497) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 00:09:59 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:10:00 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:10:00 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 00:10:00 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Rebuilding the list of instances to heal {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 00:10:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-c373d8f9-57d1-4177-89c0-7e7106255b52" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:10:00 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-c373d8f9-57d1-4177-89c0-7e7106255b52" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:10:00 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 00:10:00 user nova-compute[73497]: DEBUG nova.objects.instance [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lazy-loading 'info_cache' on Instance uuid c373d8f9-57d1-4177-89c0-7e7106255b52 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:10:01 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Updating instance_info_cache with network_info: [{"id": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "address": "fa:16:3e:1a:d3:69", "network": {"id": "ccecce66-f550-4ea7-8ff4-366acda30a47", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1307360466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee81ff5f91a454abdf376e50e1486e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap257cd460-3b", "ovs_interfaceid": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:10:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-c373d8f9-57d1-4177-89c0-7e7106255b52" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:10:01 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 00:10:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:10:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:10:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 00:10:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:10:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:10:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:10:05 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:10:05 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Cleaning up deleted instances {{(pid=73497) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 00:10:05 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] There are 0 instances to clean {{(pid=73497) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 00:10:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:10:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:10:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:10:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Acquiring lock "c373d8f9-57d1-4177-89c0-7e7106255b52" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:10:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:10:19 user nova-compute[73497]: DEBUG nova.objects.instance [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lazy-loading 'flavor' on Instance uuid c373d8f9-57d1-4177-89c0-7e7106255b52 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:10:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:10:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Acquiring lock "c373d8f9-57d1-4177-89c0-7e7106255b52" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:10:19 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:10:19 user nova-compute[73497]: INFO nova.compute.manager [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Attaching volume c1a26e05-8a32-434a-aa04-398fdf66c770 to /dev/vdb
Aug 27 00:10:19 user nova-compute[73497]: DEBUG os_brick.utils [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:10:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:10:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:10:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b354244-a3ef-4012-a831-0e29721c2578]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:10:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:10:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:10:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[568558cb-8320-4588-bed6-9079b8f506f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:10:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:10:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:10:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c9364d-1c41-4d08-85be-3dda5f01d06a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:10:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd07da94-024f-4293-875c-a7cf4ab86e67]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:10:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:10:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:10:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 00:10:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:10:19 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:10:19 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 00:10:19 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6c149e-5513-46bb-9cf6-8f1141f5be46]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:10:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 00:10:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 00:10:19 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 00:10:19 user nova-compute[73497]: DEBUG os_brick.utils [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:10:19 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Updating existing volume attachment record: d882de0f-2ab4-447f-bf23-90d92c5ae7ea {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 00:10:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:10:23 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:10:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:10:28 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_power_states {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:10:28 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Triggering sync for uuid c373d8f9-57d1-4177-89c0-7e7106255b52 {{(pid=73497) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 00:10:28 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "c373d8f9-57d1-4177-89c0-7e7106255b52" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gCqfybNz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:10:30 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:10:30 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:10:30 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:10:30 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:10:30 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 00:10:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[26617691-2a97-458c-bcab-a4843a26f00a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 00:10:30 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef66e828-a56f-449b-a446-3b7b1fab3fab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770] added
Aug 27 00:10:30 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96819ef-b593-4b04-b8de-d2f349033bdb]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f17eb94-7213-4ad5-9114-12531140d778]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gCqfybNz {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gCqfybNz" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eed0922-aef6-4aa6-a4c3-a7793cf98852]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gCqfybNz'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b5ab6b-7058-4d44-ab70-41c5b326a90e]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4760e5-dc19-4fd5-96c7-a19934a015f2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 00:10:30 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 00:10:30 user nova-compute[73497]:  {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:10:30 user nova-compute[73497]: WARNING os_brick.initiator.connectors.iscsi [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 00:10:30 user nova-compute[73497]: 
Aug 27 00:10:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cdbcb5-7e3d-4852-a641-070386c51a80]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770, portal: 172.16.0.220,3260]
Aug 27 00:10:30 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770, portal: 172.16.0.220,3260] successful.
Aug 27 00:10:30 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3508db5a-f867-4889-bc3c-9d22de6847e5]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b129e6c-1f54-4a1a-aa75-6a606e2496ce]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770 (non-flash)
Aug 27 00:10:30 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770 (non-flash)
Aug 27 00:10:30 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c153bdc-11de-47a7-ba17-14af9168e205]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:10:30 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gCqfybNz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 00:10:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:10:31 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26131333264656538', 'path': '/dev/sdb'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:10:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131333264656538', 'path': '/dev/sdb'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 00:10:31 user nova-compute[73497]: DEBUG nova.objects.instance [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lazy-loading 'flavor' on Instance uuid c373d8f9-57d1-4177-89c0-7e7106255b52 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:10:31 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 00:10:31 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:10:31 user nova-compute[73497]:   <source dev="/dev/sdb"/>
Aug 27 00:10:31 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 27 00:10:31 user nova-compute[73497]:   <serial>c1a26e05-8a32-434a-aa04-398fdf66c770</serial>
Aug 27 00:10:31 user nova-compute[73497]: </disk>
Aug 27 00:10:31 user nova-compute[73497]:  {{(pid=73497) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 00:10:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:10:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:10:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] No VIF found with MAC fa:16:3e:1a:d3:69, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:10:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:10:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:10:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 00:10:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:10:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:10:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:10:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-8a8219ac-75ab-4ce7-91de-6c1dd11355be tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.854s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:10:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.032s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:10:32 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.022s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:10:33 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:10:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:10:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:10:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:10:33 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 00:10:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:10:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:10:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:10:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:10:33 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73497) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:10:34 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:10:34 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:10:34 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8750MB free_disk=24.99298858642578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 00:10:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:10:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:10:34 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance c373d8f9-57d1-4177-89c0-7e7106255b52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:10:34 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 00:10:34 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 00:10:34 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:10:34 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:10:34 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 00:10:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:10:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-29743d69-399c-4e80-adb7-6dc4103ee2c0 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Acquiring lock "c373d8f9-57d1-4177-89c0-7e7106255b52" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:10:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-29743d69-399c-4e80-adb7-6dc4103ee2c0 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:10:35 user nova-compute[73497]: INFO nova.compute.manager [None req-29743d69-399c-4e80-adb7-6dc4103ee2c0 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Detaching volume c1a26e05-8a32-434a-aa04-398fdf66c770
Aug 27 00:10:35 user nova-compute[73497]: INFO nova.virt.block_device [None req-29743d69-399c-4e80-adb7-6dc4103ee2c0 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Attempting to driver detach volume c1a26e05-8a32-434a-aa04-398fdf66c770 from mountpoint /dev/vdb
Aug 27 00:10:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-29743d69-399c-4e80-adb7-6dc4103ee2c0 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Attempting to detach device vdb from instance c373d8f9-57d1-4177-89c0-7e7106255b52 from the persistent domain config. {{(pid=73497) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 00:10:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-29743d69-399c-4e80-adb7-6dc4103ee2c0 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 00:10:35 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:10:35 user nova-compute[73497]:   <source dev="/dev/sdb"/>
Aug 27 00:10:35 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 27 00:10:35 user nova-compute[73497]:   <serial>c1a26e05-8a32-434a-aa04-398fdf66c770</serial>
Aug 27 00:10:35 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 00:10:35 user nova-compute[73497]: </disk>
Aug 27 00:10:35 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 00:10:35 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-29743d69-399c-4e80-adb7-6dc4103ee2c0 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Successfully detached device vdb from instance c373d8f9-57d1-4177-89c0-7e7106255b52 from the persistent domain config.
Aug 27 00:10:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-29743d69-399c-4e80-adb7-6dc4103ee2c0 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c373d8f9-57d1-4177-89c0-7e7106255b52 from the live domain config. {{(pid=73497) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 00:10:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-29743d69-399c-4e80-adb7-6dc4103ee2c0 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 00:10:35 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:10:35 user nova-compute[73497]:   <source dev="/dev/sdb"/>
Aug 27 00:10:35 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 27 00:10:35 user nova-compute[73497]:   <serial>c1a26e05-8a32-434a-aa04-398fdf66c770</serial>
Aug 27 00:10:35 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 00:10:35 user nova-compute[73497]: </disk>
Aug 27 00:10:35 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 00:10:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Received event <DeviceRemovedEvent: 1693095035.8009846, c373d8f9-57d1-4177-89c0-7e7106255b52 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73497) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 00:10:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-29743d69-399c-4e80-adb7-6dc4103ee2c0 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c373d8f9-57d1-4177-89c0-7e7106255b52 {{(pid=73497) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 00:10:35 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-29743d69-399c-4e80-adb7-6dc4103ee2c0 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Successfully detached device vdb from instance c373d8f9-57d1-4177-89c0-7e7106255b52 from the live domain config.
Aug 27 00:10:35 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29743d69-399c-4e80-adb7-6dc4103ee2c0 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 00:10:35 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-29743d69-399c-4e80-adb7-6dc4103ee2c0 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gCqfybNz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:10:35 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-29743d69-399c-4e80-adb7-6dc4103ee2c0 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:10:35 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-29743d69-399c-4e80-adb7-6dc4103ee2c0 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:10:35 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-29743d69-399c-4e80-adb7-6dc4103ee2c0 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:10:35 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-29743d69-399c-4e80-adb7-6dc4103ee2c0 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 00:10:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:10:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:10:35 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d27eee-c643-421e-a5e8-f65670cbaf73]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:10:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:10:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:10:35 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7036ab8-cdd4-40b0-bf05-a5c144e2308b]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:10:35 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-29743d69-399c-4e80-adb7-6dc4103ee2c0 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770 (non-flash)
Aug 27 00:10:35 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:10:35 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-29743d69-399c-4e80-adb7-6dc4103ee2c0 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770 (non-flash)
Aug 27 00:10:35 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:10:35 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-29743d69-399c-4e80-adb7-6dc4103ee2c0 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281c56fa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770'): ({'sdb'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 00:10:35 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-29743d69-399c-4e80-adb7-6dc4103ee2c0 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Removing single pathed devices sdb {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 00:10:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:10:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:10:35 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e2b296-1e6a-41f0-995c-bd418912c367]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:10:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:10:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:10:35 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d935cd34-1c08-44a9-8ad6-b8ad01dec479]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:10:35 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-29743d69-399c-4e80-adb7-6dc4103ee2c0 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Flushing IO for device /dev/sdb {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 00:10:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:10:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:10:35 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e03682b-5c50-4508-82be-86e7e82d74df]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:10:35 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-29743d69-399c-4e80-adb7-6dc4103ee2c0 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 00:10:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:10:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:10:35 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8fa6a6-be63-4825-9888-8316caefedb4]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:10:35 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-29743d69-399c-4e80-adb7-6dc4103ee2c0 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 00:10:35 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-29743d69-399c-4e80-adb7-6dc4103ee2c0 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 00:10:35 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-29743d69-399c-4e80-adb7-6dc4103ee2c0 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 00:10:35 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:10:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:10:36 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b308c69-ac4e-41d9-818f-ef3bf4368b75]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:10:36 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-29743d69-399c-4e80-adb7-6dc4103ee2c0 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:10:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:10:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:10:36 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7e1e50-4509-49dc-9e6e-60c29f83deba]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:10:36 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-29743d69-399c-4e80-adb7-6dc4103ee2c0 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770, portal: 172.16.0.220,3260]
Aug 27 00:10:36 user nova-compute[73497]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770, portal: 172.16.0.220,3260] successful.
Aug 27 00:10:36 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:10:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:10:36 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1a26e05-8a32-434a-aa04-398fdf66c770 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:10:36 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7937fb-2e53-4e7c-8e1f-1a29748957c5]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:10:36 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-29743d69-399c-4e80-adb7-6dc4103ee2c0 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:10:36 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-29743d69-399c-4e80-adb7-6dc4103ee2c0 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:10:36 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-29743d69-399c-4e80-adb7-6dc4103ee2c0 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] <== disconnect_volume: return (268ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:10:36 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29743d69-399c-4e80-adb7-6dc4103ee2c0 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 00:10:36 user nova-compute[73497]: DEBUG nova.objects.instance [None req-29743d69-399c-4e80-adb7-6dc4103ee2c0 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lazy-loading 'flavor' on Instance uuid c373d8f9-57d1-4177-89c0-7e7106255b52 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:10:36 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-29743d69-399c-4e80-adb7-6dc4103ee2c0 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.635s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:10:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:10:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:10:38 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:10:40 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:10:41 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:10:41 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:10:41 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 00:10:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:10:44 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:10:47 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:10:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:10:49 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:10:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:10:55 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:10:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:11:01 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:11:01 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 00:11:01 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Rebuilding the list of instances to heal {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 00:11:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-c373d8f9-57d1-4177-89c0-7e7106255b52" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:11:01 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-c373d8f9-57d1-4177-89c0-7e7106255b52" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:11:01 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 00:11:01 user nova-compute[73497]: DEBUG nova.objects.instance [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lazy-loading 'info_cache' on Instance uuid c373d8f9-57d1-4177-89c0-7e7106255b52 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:11:02 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Updating instance_info_cache with network_info: [{"id": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "address": "fa:16:3e:1a:d3:69", "network": {"id": "ccecce66-f550-4ea7-8ff4-366acda30a47", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1307360466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee81ff5f91a454abdf376e50e1486e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap257cd460-3b", "ovs_interfaceid": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:11:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-c373d8f9-57d1-4177-89c0-7e7106255b52" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:11:02 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 00:11:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:11:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:11:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:11:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:11:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:11:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:11:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Acquiring lock "c373d8f9-57d1-4177-89c0-7e7106255b52" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:11:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:11:29 user nova-compute[73497]: DEBUG nova.objects.instance [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lazy-loading 'flavor' on Instance uuid c373d8f9-57d1-4177-89c0-7e7106255b52 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:11:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:11:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Acquiring lock "c373d8f9-57d1-4177-89c0-7e7106255b52" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:11:29 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:11:29 user nova-compute[73497]: INFO nova.compute.manager [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Attaching volume dfb43baf-e07d-4aef-b094-33ab9b475006 to /dev/vdb
Aug 27 00:11:29 user nova-compute[73497]: DEBUG os_brick.utils [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:11:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:11:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:11:29 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a254ccb-5c85-4172-bb7d-a1dd5e7a2021]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:11:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:11:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:11:29 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[144cd2e0-cc49-4847-8f13-0c88a994fb9b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:11:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:11:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:11:29 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db6d200-e2a0-48e5-8aef-28f4ef9fc1eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:11:29 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88ed2ec-61a9-49df-961d-44d3b614c07f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:11:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:11:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:11:29 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 00:11:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:11:29 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:11:29 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 00:11:29 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[badfba2f-2a89-4ed0-bb04-5ce3a0c53f78]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:11:29 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 00:11:29 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 00:11:29 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 00:11:29 user nova-compute[73497]: DEBUG os_brick.utils [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:11:29 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Updating existing volume attachment record: 97c92883-549c-46c5-81ff-9c02809b91c4 {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 00:11:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:11:33 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:11:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:11:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:11:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:11:33 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 00:11:33 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:11:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:11:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:11:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:11:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:11:34 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:11:34 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:11:34 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8763MB free_disk=24.992084503173828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 00:11:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:11:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:11:34 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance c373d8f9-57d1-4177-89c0-7e7106255b52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:11:34 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 00:11:34 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 00:11:34 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Refreshing inventories for resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 00:11:34 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Updating ProviderTree inventory for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 00:11:34 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Updating inventory in ProviderTree for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 00:11:34 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Refreshing aggregate associations for resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1, aggregates: None {{(pid=73497) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 00:11:34 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Refreshing trait associations for resource provider 10adb234-fb0d-4578-975f-a62ca871f8a1, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING {{(pid=73497) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 00:11:34 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:11:34 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:11:34 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 00:11:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.269s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:11:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fuBqrgEM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:11:40 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:11:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:11:40 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:11:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:11:40 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 00:11:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e4cc04-1270-4ad7-b1d2-db633d8c110b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 00:11:40 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ded06f7-f21f-43a4-a469-042d2b7a4a97]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006] added
Aug 27 00:11:40 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6964fd-2628-4904-bfcb-0db7896e3e51]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc75768-c48e-4ae0-9935-5aced1ff0814]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fuBqrgEM {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fuBqrgEM" returned: 0 in 0.022s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33fb6f0-0bf3-4ff4-b12c-28042265d4ba]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fuBqrgEM'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4cdcc6-6ba0-4081-b6f2-18994fee15ee]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[85655496-509d-43f7-8b75-2194485a5925]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 00:11:40 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 00:11:40 user nova-compute[73497]:  {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:11:40 user nova-compute[73497]: WARNING os_brick.initiator.connectors.iscsi [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 00:11:40 user nova-compute[73497]: 
Aug 27 00:11:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f7dc3d-3751-4634-a8f3-a276fa6a9d69]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006, portal: 172.16.0.220,3260]
Aug 27 00:11:40 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006, portal: 172.16.0.220,3260] successful.
Aug 27 00:11:40 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f358351-d3c0-4791-8f69-38ae27455fa4]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e8651d-4420-4efc-a47b-f40f2cad7346]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006 (non-flash)
Aug 27 00:11:40 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006 (non-flash)
Aug 27 00:11:40 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7499cfa5-d462-4c62-bcd5-be1105a9ae74]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:11:40 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:11:41 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:11:41 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fuBqrgEM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 00:11:41 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:11:41 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26138356562373463', 'path': '/dev/sdb'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:11:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138356562373463', 'path': '/dev/sdb'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 00:11:41 user nova-compute[73497]: DEBUG nova.objects.instance [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lazy-loading 'flavor' on Instance uuid c373d8f9-57d1-4177-89c0-7e7106255b52 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:11:41 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 00:11:41 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:11:41 user nova-compute[73497]:   <source dev="/dev/sdb"/>
Aug 27 00:11:41 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 27 00:11:41 user nova-compute[73497]:   <serial>dfb43baf-e07d-4aef-b094-33ab9b475006</serial>
Aug 27 00:11:41 user nova-compute[73497]: </disk>
Aug 27 00:11:41 user nova-compute[73497]:  {{(pid=73497) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 00:11:42 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:11:42 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:11:42 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] No VIF found with MAC fa:16:3e:1a:d3:69, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:11:42 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-f446132c-44c6-481c-8453-7afdee1ca343 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.591s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:11:42 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:11:42 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:11:42 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:11:42 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 00:11:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:11:43 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b600f3c8-4e29-41e2-a34a-a5fe0c40b955 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Acquiring lock "c373d8f9-57d1-4177-89c0-7e7106255b52" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b600f3c8-4e29-41e2-a34a-a5fe0c40b955 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:11:44 user nova-compute[73497]: INFO nova.compute.manager [None req-b600f3c8-4e29-41e2-a34a-a5fe0c40b955 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Detaching volume dfb43baf-e07d-4aef-b094-33ab9b475006
Aug 27 00:11:44 user nova-compute[73497]: INFO nova.virt.block_device [None req-b600f3c8-4e29-41e2-a34a-a5fe0c40b955 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Attempting to driver detach volume dfb43baf-e07d-4aef-b094-33ab9b475006 from mountpoint /dev/vdb
Aug 27 00:11:44 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b600f3c8-4e29-41e2-a34a-a5fe0c40b955 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Attempting to detach device vdb from instance c373d8f9-57d1-4177-89c0-7e7106255b52 from the persistent domain config. {{(pid=73497) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-b600f3c8-4e29-41e2-a34a-a5fe0c40b955 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 00:11:44 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:11:44 user nova-compute[73497]:   <source dev="/dev/sdb"/>
Aug 27 00:11:44 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 27 00:11:44 user nova-compute[73497]:   <serial>dfb43baf-e07d-4aef-b094-33ab9b475006</serial>
Aug 27 00:11:44 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 00:11:44 user nova-compute[73497]: </disk>
Aug 27 00:11:44 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 00:11:44 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-b600f3c8-4e29-41e2-a34a-a5fe0c40b955 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Successfully detached device vdb from instance c373d8f9-57d1-4177-89c0-7e7106255b52 from the persistent domain config.
Aug 27 00:11:44 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b600f3c8-4e29-41e2-a34a-a5fe0c40b955 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c373d8f9-57d1-4177-89c0-7e7106255b52 from the live domain config. {{(pid=73497) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-b600f3c8-4e29-41e2-a34a-a5fe0c40b955 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 00:11:44 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:11:44 user nova-compute[73497]:   <source dev="/dev/sdb"/>
Aug 27 00:11:44 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 27 00:11:44 user nova-compute[73497]:   <serial>dfb43baf-e07d-4aef-b094-33ab9b475006</serial>
Aug 27 00:11:44 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 00:11:44 user nova-compute[73497]: </disk>
Aug 27 00:11:44 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Received event <DeviceRemovedEvent: 1693095104.7167332, c373d8f9-57d1-4177-89c0-7e7106255b52 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73497) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-b600f3c8-4e29-41e2-a34a-a5fe0c40b955 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c373d8f9-57d1-4177-89c0-7e7106255b52 {{(pid=73497) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 00:11:44 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-b600f3c8-4e29-41e2-a34a-a5fe0c40b955 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Successfully detached device vdb from instance c373d8f9-57d1-4177-89c0-7e7106255b52 from the live domain config.
Aug 27 00:11:44 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b600f3c8-4e29-41e2-a34a-a5fe0c40b955 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b600f3c8-4e29-41e2-a34a-a5fe0c40b955 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fuBqrgEM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:11:44 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-b600f3c8-4e29-41e2-a34a-a5fe0c40b955 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:11:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-b600f3c8-4e29-41e2-a34a-a5fe0c40b955 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-b600f3c8-4e29-41e2-a34a-a5fe0c40b955 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b600f3c8-4e29-41e2-a34a-a5fe0c40b955 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef389aff-1fbd-4372-aab9-4bfc3b711fc6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d08532-1bec-4c31-9458-4a0c10074d48]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b600f3c8-4e29-41e2-a34a-a5fe0c40b955 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006 (non-flash)
Aug 27 00:11:44 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b600f3c8-4e29-41e2-a34a-a5fe0c40b955 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006 (non-flash)
Aug 27 00:11:44 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b600f3c8-4e29-41e2-a34a-a5fe0c40b955 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281c25b370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006'): ({'sdb'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-b600f3c8-4e29-41e2-a34a-a5fe0c40b955 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Removing single pathed devices sdb {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7553739c-69e9-4c83-8a58-5cd56a5cdc8a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d505ef-5f9f-40c6-baa0-709768b017b3]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-b600f3c8-4e29-41e2-a34a-a5fe0c40b955 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Flushing IO for device /dev/sdb {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[511766ce-3700-4b6a-bc8b-17f01f8da14b]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-b600f3c8-4e29-41e2-a34a-a5fe0c40b955 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa842a6-397b-4385-ad2a-b88a4c4ff4ba]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-b600f3c8-4e29-41e2-a34a-a5fe0c40b955 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-b600f3c8-4e29-41e2-a34a-a5fe0c40b955 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b600f3c8-4e29-41e2-a34a-a5fe0c40b955 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37dcee8-9965-40a6-9013-de3ba35e0e03]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b600f3c8-4e29-41e2-a34a-a5fe0c40b955 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e961bac1-67f5-4a31-b251-ad9ec5c7ae72]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b600f3c8-4e29-41e2-a34a-a5fe0c40b955 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006, portal: 172.16.0.220,3260]
Aug 27 00:11:44 user nova-compute[73497]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006, portal: 172.16.0.220,3260] successful.
Aug 27 00:11:44 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb43baf-e07d-4aef-b094-33ab9b475006 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5066d4-0195-447c-8112-3eb1a846ac4f]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b600f3c8-4e29-41e2-a34a-a5fe0c40b955 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-b600f3c8-4e29-41e2-a34a-a5fe0c40b955 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-b600f3c8-4e29-41e2-a34a-a5fe0c40b955 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] <== disconnect_volume: return (269ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:11:44 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b600f3c8-4e29-41e2-a34a-a5fe0c40b955 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 00:11:45 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:11:45 user nova-compute[73497]: DEBUG nova.objects.instance [None req-b600f3c8-4e29-41e2-a34a-a5fe0c40b955 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lazy-loading 'flavor' on Instance uuid c373d8f9-57d1-4177-89c0-7e7106255b52 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:11:45 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-b600f3c8-4e29-41e2-a34a-a5fe0c40b955 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.618s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:11:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:11:48 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:11:49 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:11:50 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:11:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:11:55 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:11:57 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:11:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:11:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:11:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 00:11:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:11:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:11:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:12:02 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:12:02 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 00:12:02 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Rebuilding the list of instances to heal {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 00:12:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-c373d8f9-57d1-4177-89c0-7e7106255b52" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:12:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-c373d8f9-57d1-4177-89c0-7e7106255b52" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:12:02 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 00:12:02 user nova-compute[73497]: DEBUG nova.objects.instance [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lazy-loading 'info_cache' on Instance uuid c373d8f9-57d1-4177-89c0-7e7106255b52 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:12:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:12:02 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Updating instance_info_cache with network_info: [{"id": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "address": "fa:16:3e:1a:d3:69", "network": {"id": "ccecce66-f550-4ea7-8ff4-366acda30a47", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1307360466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee81ff5f91a454abdf376e50e1486e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap257cd460-3b", "ovs_interfaceid": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:12:02 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-c373d8f9-57d1-4177-89c0-7e7106255b52" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:12:02 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 00:12:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:12:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:12:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 00:12:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:12:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:12:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:12:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:12:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:12:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:12:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 00:12:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:12:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:12:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:12:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:12:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:12:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:12:33 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:12:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:12:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:12:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:12:33 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 00:12:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:12:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:12:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:12:33 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:12:34 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:12:34 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:12:34 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8757MB free_disk=24.99127197265625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 00:12:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:12:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:12:34 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance c373d8f9-57d1-4177-89c0-7e7106255b52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:12:34 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 00:12:34 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 00:12:34 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:12:34 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:12:34 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 00:12:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.348s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:12:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:12:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Acquiring lock "c373d8f9-57d1-4177-89c0-7e7106255b52" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:12:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:12:38 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:12:38 user nova-compute[73497]: DEBUG nova.objects.instance [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lazy-loading 'flavor' on Instance uuid c373d8f9-57d1-4177-89c0-7e7106255b52 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:12:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:12:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Acquiring lock "c373d8f9-57d1-4177-89c0-7e7106255b52" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:12:38 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:12:38 user nova-compute[73497]: INFO nova.compute.manager [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Attaching volume 2781e7a4-2a10-4781-885f-d5a5f024cd75 to /dev/vdb
Aug 27 00:12:38 user nova-compute[73497]: DEBUG os_brick.utils [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:12:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:12:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:12:38 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aae3a68-b849-4c43-9a0d-74a226b338a0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:68b7a13afaa8\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:12:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:12:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:12:38 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f395bf-1999-488f-83f8-d3b4d0a71c29]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:12:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:12:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:12:38 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a250e00a-b920-4726-8381-03323d361409]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:12:38 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a29b07-dbe2-476d-8a17-44c1fac9baea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:12:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Running cmd (subprocess): nvme version {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:12:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] 'nvme version' failed. Not Retrying. {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:12:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] nvme not present on system {{(pid=73497) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 00:12:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:12:38 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:12:38 user nova-compute[73497]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 00:12:38 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fc4045-819f-4122-aa31-f78afebb195d]: (4, '') {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:12:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73497) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 00:12:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 00:12:38 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.lightos [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] LIGHTOS: no hostnqn found. {{(pid=73497) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 00:12:38 user nova-compute[73497]: DEBUG os_brick.utils [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:68b7a13afaa8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:12:38 user nova-compute[73497]: DEBUG nova.virt.block_device [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Updating existing volume attachment record: a80cbef8-5738-4eb0-a102-f3ed9dc61f5d {{(pid=73497) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 00:12:42 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:12:42 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:12:42 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:12:42 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 00:12:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:12:47 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:12:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:12:48 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Calling os-brick to attach iSCSI Volume {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 00:12:48 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XZdSKhNf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:12:48 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:12:48 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:12:48 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:12:48 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:12:48 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:12:48 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:12:48 user nova-compute[73497]: INFO os_brick.initiator.connectors.iscsi [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 00:12:48 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75 -p 172.16.0.220:3260 {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3b88ce-4bb7-430e-a258-0f54661ba193]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 00:12:49 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75 -p 172.16.0.220:3260 --interface default --op new {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c311c936-f7b7-4182-b948-77be8348a582]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75] added\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75] added
Aug 27 00:12:49 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc47b4a-3787-4b1b-8c92-a3e0c9951455]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ec73e7-8e91-4371-9b90-133ffefb7866]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XZdSKhNf {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XZdSKhNf" returned: 0 in 0.029s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf85639-723b-4a5c-b5c0-273fc707ebd6]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XZdSKhNf'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b552d1d0-b3b3-4507-83f4-5a6dd5d7fdbc]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[31bae1a7-cd5a-4076-8268-730ceb72adad]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 00:12:49 user nova-compute[73497]:  {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 00:12:49 user nova-compute[73497]:  {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:12:49 user nova-compute[73497]: WARNING os_brick.initiator.connectors.iscsi [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 00:12:49 user nova-compute[73497]: 
Aug 27 00:12:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75 -p 172.16.0.220:3260 --login {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5f2bbc-4d8f-4a83-9dda-7fa5da2b60e7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75, portal: 172.16.0.220,3260]
Aug 27 00:12:49 user nova-compute[73497]: Login to [iface: default, target: iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75, portal: 172.16.0.220,3260] successful.
Aug 27 00:12:49 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[534b75e4-b887-4507-8dd6-cd32aafe0ab9]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b100007b-a18e-4e50-a6c8-ed0a786e9ccf]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75 (non-flash)
Aug 27 00:12:49 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75 (non-flash)
Aug 27 00:12:49 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Connected to 172.16.0.220:3260 {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=73497) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73497) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e9e999-ae59-46cc-b200-66615da0e2d0]: (4, ('- - 0', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73497) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:12:49 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XZdSKhNf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73497) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 00:12:50 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:12:50 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:12:50 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23632336132396637', 'path': '/dev/sdb'} {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:12:50 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632336132396637', 'path': '/dev/sdb'} {{(pid=73497) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 00:12:50 user nova-compute[73497]: DEBUG nova.objects.instance [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lazy-loading 'flavor' on Instance uuid c373d8f9-57d1-4177-89c0-7e7106255b52 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:12:50 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 00:12:50 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:12:50 user nova-compute[73497]:   <source dev="/dev/sdb"/>
Aug 27 00:12:50 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 27 00:12:50 user nova-compute[73497]:   <serial>2781e7a4-2a10-4781-885f-d5a5f024cd75</serial>
Aug 27 00:12:50 user nova-compute[73497]: </disk>
Aug 27 00:12:50 user nova-compute[73497]:  {{(pid=73497) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 00:12:50 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] No BDM found with device name vda, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:12:50 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73497) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:12:50 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] No VIF found with MAC fa:16:3e:1a:d3:69, not building metadata {{(pid=73497) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:12:50 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-46f17e9f-820d-46bc-9b95-226fd34cd2e4 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.308s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:12:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:12:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4d9c99fa-fd5b-4e3c-be3a-5fe641d6aec3 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Acquiring lock "c373d8f9-57d1-4177-89c0-7e7106255b52" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:12:52 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4d9c99fa-fd5b-4e3c-be3a-5fe641d6aec3 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:12:52 user nova-compute[73497]: INFO nova.compute.manager [None req-4d9c99fa-fd5b-4e3c-be3a-5fe641d6aec3 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Detaching volume 2781e7a4-2a10-4781-885f-d5a5f024cd75
Aug 27 00:12:53 user nova-compute[73497]: INFO nova.virt.block_device [None req-4d9c99fa-fd5b-4e3c-be3a-5fe641d6aec3 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Attempting to driver detach volume 2781e7a4-2a10-4781-885f-d5a5f024cd75 from mountpoint /dev/vdb
Aug 27 00:12:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4d9c99fa-fd5b-4e3c-be3a-5fe641d6aec3 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Attempting to detach device vdb from instance c373d8f9-57d1-4177-89c0-7e7106255b52 from the persistent domain config. {{(pid=73497) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-4d9c99fa-fd5b-4e3c-be3a-5fe641d6aec3 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 00:12:53 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:12:53 user nova-compute[73497]:   <source dev="/dev/sdb"/>
Aug 27 00:12:53 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 27 00:12:53 user nova-compute[73497]:   <serial>2781e7a4-2a10-4781-885f-d5a5f024cd75</serial>
Aug 27 00:12:53 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 00:12:53 user nova-compute[73497]: </disk>
Aug 27 00:12:53 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 00:12:53 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-4d9c99fa-fd5b-4e3c-be3a-5fe641d6aec3 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Successfully detached device vdb from instance c373d8f9-57d1-4177-89c0-7e7106255b52 from the persistent domain config.
Aug 27 00:12:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4d9c99fa-fd5b-4e3c-be3a-5fe641d6aec3 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c373d8f9-57d1-4177-89c0-7e7106255b52 from the live domain config. {{(pid=73497) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.guest [None req-4d9c99fa-fd5b-4e3c-be3a-5fe641d6aec3 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 00:12:53 user nova-compute[73497]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:12:53 user nova-compute[73497]:   <source dev="/dev/sdb"/>
Aug 27 00:12:53 user nova-compute[73497]:   <target dev="vdb" bus="virtio"/>
Aug 27 00:12:53 user nova-compute[73497]:   <serial>2781e7a4-2a10-4781-885f-d5a5f024cd75</serial>
Aug 27 00:12:53 user nova-compute[73497]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 00:12:53 user nova-compute[73497]: </disk>
Aug 27 00:12:53 user nova-compute[73497]:  {{(pid=73497) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-637e650d-452d-4192-8976-09f50273a439 None None] Received event <DeviceRemovedEvent: 1693095173.4941707, c373d8f9-57d1-4177-89c0-7e7106255b52 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73497) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.driver [None req-4d9c99fa-fd5b-4e3c-be3a-5fe641d6aec3 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c373d8f9-57d1-4177-89c0-7e7106255b52 {{(pid=73497) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 00:12:53 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-4d9c99fa-fd5b-4e3c-be3a-5fe641d6aec3 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Successfully detached device vdb from instance c373d8f9-57d1-4177-89c0-7e7106255b52 from the live domain config.
Aug 27 00:12:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d9c99fa-fd5b-4e3c-be3a-5fe641d6aec3 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] calling os-brick to detach iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d9c99fa-fd5b-4e3c-be3a-5fe641d6aec3 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f282c21c160>, {'target_iqns': ['iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XZdSKhNf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:12:53 user nova-compute[73497]: WARNING os_brick.initiator.connectors.base [None req-4d9c99fa-fd5b-4e3c-be3a-5fe641d6aec3 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:12:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-4d9c99fa-fd5b-4e3c-be3a-5fe641d6aec3 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-4d9c99fa-fd5b-4e3c-be3a-5fe641d6aec3 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d9c99fa-fd5b-4e3c-be3a-5fe641d6aec3 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75', 0)] {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c4f5a6-d293-4eab-8662-eb40fffc27c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5c9d63-5638-4073-a454-a331cb475b03]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75 (non-flash)\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d9c99fa-fd5b-4e3c-be3a-5fe641d6aec3 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75 (non-flash)
Aug 27 00:12:53 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d9c99fa-fd5b-4e3c-be3a-5fe641d6aec3 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75 (non-flash)
Aug 27 00:12:53 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d9c99fa-fd5b-4e3c-be3a-5fe641d6aec3 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282c3d09d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75'): ({'sdb'}, set())}) {{(pid=73497) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-4d9c99fa-fd5b-4e3c-be3a-5fe641d6aec3 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Removing single pathed devices sdb {{(pid=73497) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa79c096-3be4-4f97-866e-449e2a1e6541]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdfd209-c6fc-4d91-8c10-0b2380ef4d3c]: (4, ('ok\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-4d9c99fa-fd5b-4e3c-be3a-5fe641d6aec3 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Flushing IO for device /dev/sdb {{(pid=73497) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70bfc19-6e95-4d1e-8c70-cd7f62ec9998]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-4d9c99fa-fd5b-4e3c-be3a-5fe641d6aec3 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73497) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b5c9fd-4eb0-4f98-b212-755bdd127381]: (4, ('1', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-4d9c99fa-fd5b-4e3c-be3a-5fe641d6aec3 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG os_brick.initiator.linuxscsi [None req-4d9c99fa-fd5b-4e3c-be3a-5fe641d6aec3 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] SCSI volumes sdb have been removed. {{(pid=73497) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d9c99fa-fd5b-4e3c-be3a-5fe641d6aec3 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75')] {{(pid=73497) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32dc0df-5ae3-4b62-a4f7-7cdc6fed97a5]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d9c99fa-fd5b-4e3c-be3a-5fe641d6aec3 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75 -p 172.16.0.220:3260 --logout {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[60be5e38-85c2-452a-ada0-2f0b1649ef12]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d9c99fa-fd5b-4e3c-be3a-5fe641d6aec3 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75, portal: 172.16.0.220,3260]
Aug 27 00:12:53 user nova-compute[73497]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75, portal: 172.16.0.220,3260] successful.
Aug 27 00:12:53 user nova-compute[73497]:  stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75 -p 172.16.0.220:3260 --op delete {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2781e7a4-2a10-4781-885f-d5a5f024cd75 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9a5321-aa79-4ad4-9103-c489021f1694]: (4, ('', '')) {{(pid=84617) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d9c99fa-fd5b-4e3c-be3a-5fe641d6aec3 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73497) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.base [None req-4d9c99fa-fd5b-4e3c-be3a-5fe641d6aec3 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.260s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d9c99fa-fd5b-4e3c-be3a-5fe641d6aec3 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] <== disconnect_volume: return (261ms) None {{(pid=73497) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:12:53 user nova-compute[73497]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d9c99fa-fd5b-4e3c-be3a-5fe641d6aec3 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Disconnected iSCSI Volume {{(pid=73497) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 00:12:54 user nova-compute[73497]: DEBUG nova.objects.instance [None req-4d9c99fa-fd5b-4e3c-be3a-5fe641d6aec3 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lazy-loading 'flavor' on Instance uuid c373d8f9-57d1-4177-89c0-7e7106255b52 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:12:54 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-4d9c99fa-fd5b-4e3c-be3a-5fe641d6aec3 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.622s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:12:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:12:58 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:13:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:13:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:13:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 00:13:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:13:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:13:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:13:04 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:13:04 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 00:13:04 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Rebuilding the list of instances to heal {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 00:13:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-c373d8f9-57d1-4177-89c0-7e7106255b52" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:13:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-c373d8f9-57d1-4177-89c0-7e7106255b52" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:13:04 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 00:13:04 user nova-compute[73497]: DEBUG nova.objects.instance [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lazy-loading 'info_cache' on Instance uuid c373d8f9-57d1-4177-89c0-7e7106255b52 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:13:04 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Updating instance_info_cache with network_info: [{"id": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "address": "fa:16:3e:1a:d3:69", "network": {"id": "ccecce66-f550-4ea7-8ff4-366acda30a47", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1307360466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee81ff5f91a454abdf376e50e1486e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap257cd460-3b", "ovs_interfaceid": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:13:04 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-c373d8f9-57d1-4177-89c0-7e7106255b52" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:13:04 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 00:13:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:13:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:13:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:13:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:13:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:13:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:13:34 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:13:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:13:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:13:34 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:13:34 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 00:13:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:13:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:13:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk --force-share --output=json {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:13:34 user nova-compute[73497]: DEBUG oslo_concurrency.processutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73497) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:13:35 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:13:35 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:13:35 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8745MB free_disk=24.990249633789062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 00:13:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:13:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:13:35 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Instance c373d8f9-57d1-4177-89c0-7e7106255b52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73497) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:13:35 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 00:13:35 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 00:13:35 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:13:35 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:13:35 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 00:13:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:13:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:13:42 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:13:42 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:13:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:13:43 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:13:43 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 00:13:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:13:48 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:13:51 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:13:52 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:13:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:13:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:13:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 00:13:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:13:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:13:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:13:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:13:58 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:13:58 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:14:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:14:05 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:14:05 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 00:14:05 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Rebuilding the list of instances to heal {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 00:14:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "refresh_cache-c373d8f9-57d1-4177-89c0-7e7106255b52" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:14:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquired lock "refresh_cache-c373d8f9-57d1-4177-89c0-7e7106255b52" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:14:05 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Forcefully refreshing network info cache for instance {{(pid=73497) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 00:14:05 user nova-compute[73497]: DEBUG nova.objects.instance [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lazy-loading 'info_cache' on Instance uuid c373d8f9-57d1-4177-89c0-7e7106255b52 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:14:05 user nova-compute[73497]: DEBUG nova.network.neutron [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Updating instance_info_cache with network_info: [{"id": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "address": "fa:16:3e:1a:d3:69", "network": {"id": "ccecce66-f550-4ea7-8ff4-366acda30a47", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1307360466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee81ff5f91a454abdf376e50e1486e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap257cd460-3b", "ovs_interfaceid": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:14:05 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Releasing lock "refresh_cache-c373d8f9-57d1-4177-89c0-7e7106255b52" {{(pid=73497) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:14:05 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Updated the network info_cache for instance {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 00:14:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:14:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:14:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:14:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:14:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:14:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-6a1e03f1-b965-4889-933e-cdc53e18b6a1 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Acquiring lock "c373d8f9-57d1-4177-89c0-7e7106255b52" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:14:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-6a1e03f1-b965-4889-933e-cdc53e18b6a1 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:14:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-6a1e03f1-b965-4889-933e-cdc53e18b6a1 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Acquiring lock "c373d8f9-57d1-4177-89c0-7e7106255b52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:14:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-6a1e03f1-b965-4889-933e-cdc53e18b6a1 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:14:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-6a1e03f1-b965-4889-933e-cdc53e18b6a1 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:14:31 user nova-compute[73497]: INFO nova.compute.manager [None req-6a1e03f1-b965-4889-933e-cdc53e18b6a1 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Terminating instance
Aug 27 00:14:31 user nova-compute[73497]: DEBUG nova.compute.manager [None req-6a1e03f1-b965-4889-933e-cdc53e18b6a1 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Start destroying the instance on the hypervisor. {{(pid=73497) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 00:14:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:14:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:14:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:14:31 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:14:31 user nova-compute[73497]: DEBUG nova.compute.manager [req-ec235224-6d43-4919-9a03-3e33b3019c42 req-661e71bb-a912-4baf-b3cf-13c996121d05 service nova] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Received event network-vif-unplugged-257cd460-3bb6-4dbc-9fac-2ca81a309ef9 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:14:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ec235224-6d43-4919-9a03-3e33b3019c42 req-661e71bb-a912-4baf-b3cf-13c996121d05 service nova] Acquiring lock "c373d8f9-57d1-4177-89c0-7e7106255b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:14:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ec235224-6d43-4919-9a03-3e33b3019c42 req-661e71bb-a912-4baf-b3cf-13c996121d05 service nova] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:14:31 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-ec235224-6d43-4919-9a03-3e33b3019c42 req-661e71bb-a912-4baf-b3cf-13c996121d05 service nova] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:14:31 user nova-compute[73497]: DEBUG nova.compute.manager [req-ec235224-6d43-4919-9a03-3e33b3019c42 req-661e71bb-a912-4baf-b3cf-13c996121d05 service nova] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] No waiting events found dispatching network-vif-unplugged-257cd460-3bb6-4dbc-9fac-2ca81a309ef9 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:14:31 user nova-compute[73497]: DEBUG nova.compute.manager [req-ec235224-6d43-4919-9a03-3e33b3019c42 req-661e71bb-a912-4baf-b3cf-13c996121d05 service nova] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Received event network-vif-unplugged-257cd460-3bb6-4dbc-9fac-2ca81a309ef9 for instance with task_state deleting. {{(pid=73497) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 00:14:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:14:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:14:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:14:32 user nova-compute[73497]: INFO nova.virt.libvirt.driver [-] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Instance destroyed successfully.
Aug 27 00:14:32 user nova-compute[73497]: DEBUG nova.objects.instance [None req-6a1e03f1-b965-4889-933e-cdc53e18b6a1 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lazy-loading 'resources' on Instance uuid c373d8f9-57d1-4177-89c0-7e7106255b52 {{(pid=73497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:14:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:14:32 user nova-compute[73497]: DEBUG nova.virt.libvirt.vif [None req-6a1e03f1-b965-4889-933e-cdc53e18b6a1 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:06:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-177684427',display_name='tempest-SnapshotDataIntegrityTests-server-177684427',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-177684427',id=53,image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDovkcNfhv2GMR/ZjXiQveIQo0EcA6pmWdi7HIlrMm831pHMu221e1CegsQxNLOQqKd0a9fRpEMlyHmGnFY/lgIFiXSyG+8aYpQ97egKlVHMV3DZZwLa8QqxyMNtnE4XjA==',key_name='tempest-keypair-1241101889',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:06:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ee81ff5f91a454abdf376e50e1486e8',ramdisk_id='',reservation_id='r-ipwzzxrg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0c532d88-7808-4cc1-8183-4c200f1ab99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-316164581',owner_user_name='tempest-SnapshotDataIntegrityTests-316164581-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:06:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0124d1f42eaf4ee4aad064f04e4b9e07',uuid=c373d8f9-57d1-4177-89c0-7e7106255b52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "address": "fa:16:3e:1a:d3:69", "network": {"id": "ccecce66-f550-4ea7-8ff4-366acda30a47", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1307360466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee81ff5f91a454abdf376e50e1486e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap257cd460-3b", "ovs_interfaceid": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 00:14:32 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-6a1e03f1-b965-4889-933e-cdc53e18b6a1 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Converting VIF {"id": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "address": "fa:16:3e:1a:d3:69", "network": {"id": "ccecce66-f550-4ea7-8ff4-366acda30a47", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1307360466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ee81ff5f91a454abdf376e50e1486e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap257cd460-3b", "ovs_interfaceid": "257cd460-3bb6-4dbc-9fac-2ca81a309ef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:14:32 user nova-compute[73497]: DEBUG nova.network.os_vif_util [None req-6a1e03f1-b965-4889-933e-cdc53e18b6a1 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:d3:69,bridge_name='br-int',has_traffic_filtering=True,id=257cd460-3bb6-4dbc-9fac-2ca81a309ef9,network=Network(ccecce66-f550-4ea7-8ff4-366acda30a47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap257cd460-3b') {{(pid=73497) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:14:32 user nova-compute[73497]: DEBUG os_vif [None req-6a1e03f1-b965-4889-933e-cdc53e18b6a1 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:d3:69,bridge_name='br-int',has_traffic_filtering=True,id=257cd460-3bb6-4dbc-9fac-2ca81a309ef9,network=Network(ccecce66-f550-4ea7-8ff4-366acda30a47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap257cd460-3b') {{(pid=73497) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 00:14:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:14:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap257cd460-3b, bridge=br-int, if_exists=True) {{(pid=73497) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:14:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:14:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:14:32 user nova-compute[73497]: INFO os_vif [None req-6a1e03f1-b965-4889-933e-cdc53e18b6a1 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:d3:69,bridge_name='br-int',has_traffic_filtering=True,id=257cd460-3bb6-4dbc-9fac-2ca81a309ef9,network=Network(ccecce66-f550-4ea7-8ff4-366acda30a47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap257cd460-3b')
Aug 27 00:14:32 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-6a1e03f1-b965-4889-933e-cdc53e18b6a1 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Deleting instance files /opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52_del
Aug 27 00:14:32 user nova-compute[73497]: INFO nova.virt.libvirt.driver [None req-6a1e03f1-b965-4889-933e-cdc53e18b6a1 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Deletion of /opt/stack/data/nova/instances/c373d8f9-57d1-4177-89c0-7e7106255b52_del complete
Aug 27 00:14:32 user nova-compute[73497]: INFO nova.compute.manager [None req-6a1e03f1-b965-4889-933e-cdc53e18b6a1 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 27 00:14:32 user nova-compute[73497]: DEBUG oslo.service.loopingcall [None req-6a1e03f1-b965-4889-933e-cdc53e18b6a1 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73497) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 00:14:32 user nova-compute[73497]: DEBUG nova.compute.manager [-] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Deallocating network for instance {{(pid=73497) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 00:14:32 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] deallocate_for_instance() {{(pid=73497) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 00:14:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:14:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:14:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:14:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:14:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:14:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:14:33 user nova-compute[73497]: DEBUG nova.network.neutron [-] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Updating instance_info_cache with network_info: [] {{(pid=73497) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:14:33 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Took 0.95 seconds to deallocate network for instance.
Aug 27 00:14:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-6a1e03f1-b965-4889-933e-cdc53e18b6a1 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:14:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-6a1e03f1-b965-4889-933e-cdc53e18b6a1 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:14:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-e86e7e0c-19a4-4add-8422-4567c136d8d4 req-662e9529-c4a2-4147-b070-a727a21b3804 service nova] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Received event network-vif-deleted-257cd460-3bb6-4dbc-9fac-2ca81a309ef9 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:14:33 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-6a1e03f1-b965-4889-933e-cdc53e18b6a1 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:14:33 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-6a1e03f1-b965-4889-933e-cdc53e18b6a1 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:14:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-6a1e03f1-b965-4889-933e-cdc53e18b6a1 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.124s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:14:33 user nova-compute[73497]: INFO nova.scheduler.client.report [None req-6a1e03f1-b965-4889-933e-cdc53e18b6a1 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Deleted allocations for instance c373d8f9-57d1-4177-89c0-7e7106255b52
Aug 27 00:14:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-6a1e03f1-b965-4889-933e-cdc53e18b6a1 tempest-SnapshotDataIntegrityTests-316164581 tempest-SnapshotDataIntegrityTests-316164581-project-member] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.168s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:14:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-64cdd2a7-83d3-4a99-b624-5556ee3709ef req-a44ad412-d79e-4572-b841-b9fe733bbb50 service nova] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Received event network-vif-plugged-257cd460-3bb6-4dbc-9fac-2ca81a309ef9 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:14:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-64cdd2a7-83d3-4a99-b624-5556ee3709ef req-a44ad412-d79e-4572-b841-b9fe733bbb50 service nova] Acquiring lock "c373d8f9-57d1-4177-89c0-7e7106255b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:14:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-64cdd2a7-83d3-4a99-b624-5556ee3709ef req-a44ad412-d79e-4572-b841-b9fe733bbb50 service nova] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:14:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-64cdd2a7-83d3-4a99-b624-5556ee3709ef req-a44ad412-d79e-4572-b841-b9fe733bbb50 service nova] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:14:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-64cdd2a7-83d3-4a99-b624-5556ee3709ef req-a44ad412-d79e-4572-b841-b9fe733bbb50 service nova] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] No waiting events found dispatching network-vif-plugged-257cd460-3bb6-4dbc-9fac-2ca81a309ef9 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:14:33 user nova-compute[73497]: WARNING nova.compute.manager [req-64cdd2a7-83d3-4a99-b624-5556ee3709ef req-a44ad412-d79e-4572-b841-b9fe733bbb50 service nova] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Received unexpected event network-vif-plugged-257cd460-3bb6-4dbc-9fac-2ca81a309ef9 for instance with vm_state deleted and task_state None.
Aug 27 00:14:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-64cdd2a7-83d3-4a99-b624-5556ee3709ef req-a44ad412-d79e-4572-b841-b9fe733bbb50 service nova] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Received event network-vif-plugged-257cd460-3bb6-4dbc-9fac-2ca81a309ef9 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:14:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-64cdd2a7-83d3-4a99-b624-5556ee3709ef req-a44ad412-d79e-4572-b841-b9fe733bbb50 service nova] Acquiring lock "c373d8f9-57d1-4177-89c0-7e7106255b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:14:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-64cdd2a7-83d3-4a99-b624-5556ee3709ef req-a44ad412-d79e-4572-b841-b9fe733bbb50 service nova] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:14:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-64cdd2a7-83d3-4a99-b624-5556ee3709ef req-a44ad412-d79e-4572-b841-b9fe733bbb50 service nova] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:14:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-64cdd2a7-83d3-4a99-b624-5556ee3709ef req-a44ad412-d79e-4572-b841-b9fe733bbb50 service nova] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] No waiting events found dispatching network-vif-plugged-257cd460-3bb6-4dbc-9fac-2ca81a309ef9 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:14:33 user nova-compute[73497]: WARNING nova.compute.manager [req-64cdd2a7-83d3-4a99-b624-5556ee3709ef req-a44ad412-d79e-4572-b841-b9fe733bbb50 service nova] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Received unexpected event network-vif-plugged-257cd460-3bb6-4dbc-9fac-2ca81a309ef9 for instance with vm_state deleted and task_state None.
Aug 27 00:14:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-64cdd2a7-83d3-4a99-b624-5556ee3709ef req-a44ad412-d79e-4572-b841-b9fe733bbb50 service nova] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Received event network-vif-plugged-257cd460-3bb6-4dbc-9fac-2ca81a309ef9 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:14:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-64cdd2a7-83d3-4a99-b624-5556ee3709ef req-a44ad412-d79e-4572-b841-b9fe733bbb50 service nova] Acquiring lock "c373d8f9-57d1-4177-89c0-7e7106255b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:14:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-64cdd2a7-83d3-4a99-b624-5556ee3709ef req-a44ad412-d79e-4572-b841-b9fe733bbb50 service nova] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:14:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-64cdd2a7-83d3-4a99-b624-5556ee3709ef req-a44ad412-d79e-4572-b841-b9fe733bbb50 service nova] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:14:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-64cdd2a7-83d3-4a99-b624-5556ee3709ef req-a44ad412-d79e-4572-b841-b9fe733bbb50 service nova] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] No waiting events found dispatching network-vif-plugged-257cd460-3bb6-4dbc-9fac-2ca81a309ef9 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:14:33 user nova-compute[73497]: WARNING nova.compute.manager [req-64cdd2a7-83d3-4a99-b624-5556ee3709ef req-a44ad412-d79e-4572-b841-b9fe733bbb50 service nova] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Received unexpected event network-vif-plugged-257cd460-3bb6-4dbc-9fac-2ca81a309ef9 for instance with vm_state deleted and task_state None.
Aug 27 00:14:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-64cdd2a7-83d3-4a99-b624-5556ee3709ef req-a44ad412-d79e-4572-b841-b9fe733bbb50 service nova] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Received event network-vif-unplugged-257cd460-3bb6-4dbc-9fac-2ca81a309ef9 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:14:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-64cdd2a7-83d3-4a99-b624-5556ee3709ef req-a44ad412-d79e-4572-b841-b9fe733bbb50 service nova] Acquiring lock "c373d8f9-57d1-4177-89c0-7e7106255b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:14:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-64cdd2a7-83d3-4a99-b624-5556ee3709ef req-a44ad412-d79e-4572-b841-b9fe733bbb50 service nova] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:14:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-64cdd2a7-83d3-4a99-b624-5556ee3709ef req-a44ad412-d79e-4572-b841-b9fe733bbb50 service nova] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:14:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-64cdd2a7-83d3-4a99-b624-5556ee3709ef req-a44ad412-d79e-4572-b841-b9fe733bbb50 service nova] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] No waiting events found dispatching network-vif-unplugged-257cd460-3bb6-4dbc-9fac-2ca81a309ef9 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:14:33 user nova-compute[73497]: WARNING nova.compute.manager [req-64cdd2a7-83d3-4a99-b624-5556ee3709ef req-a44ad412-d79e-4572-b841-b9fe733bbb50 service nova] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Received unexpected event network-vif-unplugged-257cd460-3bb6-4dbc-9fac-2ca81a309ef9 for instance with vm_state deleted and task_state None.
Aug 27 00:14:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-64cdd2a7-83d3-4a99-b624-5556ee3709ef req-a44ad412-d79e-4572-b841-b9fe733bbb50 service nova] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Received event network-vif-plugged-257cd460-3bb6-4dbc-9fac-2ca81a309ef9 {{(pid=73497) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:14:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-64cdd2a7-83d3-4a99-b624-5556ee3709ef req-a44ad412-d79e-4572-b841-b9fe733bbb50 service nova] Acquiring lock "c373d8f9-57d1-4177-89c0-7e7106255b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:14:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-64cdd2a7-83d3-4a99-b624-5556ee3709ef req-a44ad412-d79e-4572-b841-b9fe733bbb50 service nova] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:14:33 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [req-64cdd2a7-83d3-4a99-b624-5556ee3709ef req-a44ad412-d79e-4572-b841-b9fe733bbb50 service nova] Lock "c373d8f9-57d1-4177-89c0-7e7106255b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:14:33 user nova-compute[73497]: DEBUG nova.compute.manager [req-64cdd2a7-83d3-4a99-b624-5556ee3709ef req-a44ad412-d79e-4572-b841-b9fe733bbb50 service nova] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] No waiting events found dispatching network-vif-plugged-257cd460-3bb6-4dbc-9fac-2ca81a309ef9 {{(pid=73497) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:14:33 user nova-compute[73497]: WARNING nova.compute.manager [req-64cdd2a7-83d3-4a99-b624-5556ee3709ef req-a44ad412-d79e-4572-b841-b9fe733bbb50 service nova] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Received unexpected event network-vif-plugged-257cd460-3bb6-4dbc-9fac-2ca81a309ef9 for instance with vm_state deleted and task_state None.
Aug 27 00:14:35 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:14:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:14:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:14:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:14:35 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 00:14:35 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:14:35 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:14:35 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=8863MB free_disk=25.001541137695312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 00:14:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:14:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:14:35 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 00:14:35 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 00:14:35 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:14:35 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:14:35 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 00:14:35 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:14:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:14:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:14:43 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:14:43 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:14:43 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 00:14:44 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:14:47 user nova-compute[73497]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693095272.236908, c373d8f9-57d1-4177-89c0-7e7106255b52 => Stopped> {{(pid=73497) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:14:47 user nova-compute[73497]: INFO nova.compute.manager [-] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] VM Stopped (Lifecycle Event)
Aug 27 00:14:47 user nova-compute[73497]: DEBUG nova.compute.manager [None req-3930a079-8f58-4f15-9315-7c4dc7c20d8e None None] [instance: c373d8f9-57d1-4177-89c0-7e7106255b52] Checking state {{(pid=73497) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:14:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:14:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:14:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 00:14:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:14:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:14:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:14:48 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:14:52 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:14:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:14:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:14:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 00:14:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:14:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:14:52 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:14:53 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:14:57 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:14:59 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:15:02 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:15:04 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:15:04 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Cleaning up deleted instances with incomplete migration  {{(pid=73497) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 00:15:05 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:15:05 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Starting heal instance info cache {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 00:15:05 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Rebuilding the list of instances to heal {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 00:15:05 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Didn't find any instances for network info cache update. {{(pid=73497) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 00:15:07 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:15:10 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:15:12 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:15:12 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Cleaning up deleted instances {{(pid=73497) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 00:15:12 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] There are 0 instances to clean {{(pid=73497) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 00:15:12 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:15:17 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:15:22 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:15:25 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:15:25 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:15:27 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:15:28 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:15:32 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:15:37 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:15:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:15:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:15:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:15:37 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Auditing locally available compute resources for user (node: user) {{(pid=73497) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 00:15:37 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:15:37 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:15:37 user nova-compute[73497]: WARNING nova.virt.libvirt.driver [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:15:37 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Hypervisor/Node resource view: name=user free_ram=9013MB free_disk=25.000160217285156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73497) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 00:15:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:15:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:15:37 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 00:15:37 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73497) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 00:15:37 user nova-compute[73497]: DEBUG nova.compute.provider_tree [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed in ProviderTree for provider: 10adb234-fb0d-4578-975f-a62ca871f8a1 {{(pid=73497) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:15:37 user nova-compute[73497]: DEBUG nova.scheduler.client.report [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Inventory has not changed for provider 10adb234-fb0d-4578-975f-a62ca871f8a1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73497) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:15:37 user nova-compute[73497]: DEBUG nova.compute.resource_tracker [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Compute_service record updated for user:user {{(pid=73497) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 00:15:37 user nova-compute[73497]: DEBUG oslo_concurrency.lockutils [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.129s {{(pid=73497) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:15:42 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:15:44 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:15:44 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:15:44 user nova-compute[73497]: DEBUG nova.compute.manager [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73497) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 00:15:45 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:15:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:15:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:15:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73497) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 00:15:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:15:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73497) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:15:47 user nova-compute[73497]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73497) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:15:48 user nova-compute[73497]: DEBUG oslo_service.periodic_task [None req-595ccd26-7f4c-44e3-af70-8792490a853b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73497) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}